nemo
/
stackshare-dataset
mirror of https://github.com/captn3m0/stackshare-dataset.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity

add note about methodology

This commit is contained in:
Nemo 2024-01-23 13:40:07 +05:30
parent a2f2aa1fbd
commit 040bf1c1c5
1 changed files with 17 additions and 0 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

17
README.md
View File

@ -24,3 +24,20 @@ As long as you:
* **Attribute**: You must attribute any public use of the database, or works produced from the database, in the manner specified in the ODbL. For any use or redistribution of the database, or works produced from it, you must make clear to others the license of the database and keep intact any notices on the original database.
* **Share-Alike**: If you publicly use any adapted version of this database, or works produced from an adapted database, you must also offer that adapted database under the ODbL.
* **Keep open**: If you redistribute the database, or an adapted version of it, then you may use technological measures that restrict the work (such as DRM) as long as you also redistribute a version without such measures.
## Generating
Ensure you have GNU Make, Python, and wget installed
```
make tools.csv
make packages.csv
```
The scraper uses the following as sources:
1. Sitemap (https://stackshare.io/sitemap.xml)
2. StackShare Search for enriching service results (https://stackshare.io/search)
The package results are not enriched, since much better data for those is available elsewhere.