Page MenuHomePhabricator

Publish all wmf-sparksqlclidriver-*.jar versions to GitLab Package Registry
Closed, ResolvedPublic

Description

Only the latest version is available in the GitLab Package Registry of the repository https://gitlab.wikimedia.org/repos/data-engineering/patches/wmf-sparksqlclidriver, but since there are Airflow DAGs using the older versions, they're pulling those artifacts from Archiva at the moment.

Please create new tagged branches that release the following versions to the same GitLab Package Registry as the latest one:

  • wmf-sparksqlclidriver-1.0.0.jar
  • wmf-sparksqlclidriver-3_3_2-2.0.0.jar

Details

Related Changes in GitLab:
TitleReferenceAuthorSource BranchDest Branch
Document the release lines and their maintenance branchesrepos/data-engineering/patches/wmf-sparksqlclidriver!8xcollazoreadme-line-layoutmain
Pull older wmf-sparksqlclidriver-*.jar dependencies from Gitlab instead of Archivarepos/data-engineering/airflow-dags!2548xcollazofix-wmf-sparksqlclidriver-1.0.0.jarmain
Trigger release for Spark 3.2.1 artifactrepos/data-engineering/patches/wmf-sparksqlclidriver!7xcollazotrigger-spark321-releasespark312-maintenance
Customize query in GitLab

Event Timeline

xcollazo opened https://gitlab.wikimedia.org/repos/data-engineering/airflow-dags/-/merge_requests/2548

Pull older wmf-sparksqlclidriver-*.jar dependencies from Gitlab instead of Archiva

amastilovic merged https://gitlab.wikimedia.org/repos/data-engineering/airflow-dags/-/merge_requests/2548

Pull older wmf-sparksqlclidriver-*.jar dependencies from Gitlab instead of Archiva

All current Spark versions now have respective maintenance branches. Documented at https://gitlab.wikimedia.org/repos/data-engineering/patches/wmf-sparksqlclidriver.

I think we are good here.