We are ready to migrate the pipeline that builds our DataHub (https://datahub.wikimedia.org) packages to GitLab.
The source repository is https://gerrit.wikimedia.org/r/analytics/datahub and the .pipeline directory is in a branch named wmf
However we would like to migrate only the .pipline directory, which contains eight subdirectories, each of which contains only a blubber.yaml file.
The existing repository analytics/datahub was created as a fork of the upstream project: https://github.com/datahub-project/datahub
From that point until now, we have maintained our PipelineLib files and very minor modifications to the upstream source in this wmf branch.
Upgrading DataHub required pulling from upstream, rebasing the wmf branch against a new tag, fixing issues, force-pushing the wmf branch etc.
This process of maintaining our own fork was a little unweildy, so we have now modified all of the blubber.yaml files to make them totally independent of any accompanying source files.
They now clone the upstream datahub source from GitHub as part of the build process and we build against these pristine sources.
Therefore, I believe that we are now ready to migrate the eight blubber files to GitLab and the .pipeline/config.yaml to .gitlab-ci.yml.
I can create a repository at https://gitlab.wikimedia.org/repos/data-engineering/datahub and begin the process myself, if it helps, or I can pause and await further guidance from Release-Engineering-Team