In order to use the Wikimedia Airflow "artifact" mechanism, we'll need to move https://gitlab.com/wmde/technical-wishes/scrape-wiki-html-dump/ to the Wikimedia Gitlab infrastructure. This was discovered when the production Airflow failed to load our packaged binary from gitlab.com
Steps:
- [x] Create WMDE Technical wishes group on gitlab.wikimedia.org
- https://gitlab.wikimedia.org/repos/wmde/technical-wishes
- Unfortunately, we can't "direct transfer":
> Importing groups by direct transfer is currently disabled. Please ask your Administrator to enable it in the Admin settings. Remember to enable it also on the instance you are migrating from.
- [x] Fork scraper repository to gitlab.wikimedia.org
- https://gitlab.wikimedia.org/repos/wmde/technical-wishes/scrape-wiki-html-snapshot
- [x] Make sure that CI runs correctly in the new context.
- https://gitlab.wikimedia.org/repos/wmde/technical-wishes/scrape-wiki-html-snapshot/-/pipelines/171245
- All jobs succeeded, including the key "release"
- [x] Build and publish binary package via CI.
- [ ] Mark gitlab.com repo as deprecated.