Currently, we attempt to load all known wikis. Private wikis will never have a dump file, so this is just noise and should be filtered out before attempting.
Code to review:
https://gitlab.com/wmde/technical-wishes/scrape-wiki-html-dump/-/merge_requests/67
| Status | Subtype | Assigned | Task | ||
|---|---|---|---|---|---|
| Resolved | None | T345411 Scraper: destroy Cloud VPS runner instance | |||
| Resolved | None | T341751 Publish dump scraper reports | |||
| Resolved | None | T335411 Scraper: produce spreadsheet of scraped statistics for comparing wikis | |||
| Resolved | awight | T332032 Create baseline statistics for reference usage (2023) | |||
| Resolved | None | T337449 Scraper: filter out private wikis |