Page MenuHomePhabricator
Create Task
Maniphest T414430

Migrate rdf streaming updater deployment pipeline
Open, In Progress, Needs TriagePublic
Actions

Description

RDF streaming updater images are built with Gitlab CI and deployed to wikikube via our production deployment pipeline.

As part of WDQS onboarding we need to migrate wdqs streaming updater's
deployment pipeline.

AC

  • flink-rdf-streaming-updater has been migrated to Wikidata Platform's Gitlab namespace.
  • Docker images are published from the Wikidata Platform owned Gitlab CI pipeline.
  • helmfiles have been updated to use images from the new origin.

Details

Related Changes in Gerrit:
SubjectRepoBranchLines +/-
Scala downgrade to 2.12.14 to fix incompatibility with flink 1.20.2wikidata/query/rdfmaster+6 -2
Zuul, jjb: [wikidata/query/rdf] Migrate Maven jobs from java8 to java17integration/configmaster+6 -6
Support for jdk17.wikidata/query/rdfmaster+49 -17
rdf-streaming-updater: fixed typo in docker img versionoperations/deployment-chartsmaster+1 -1
rdf-streaming-updater: fixed ns on new docker imgoperations/deployment-chartsmaster+1 -0
rdf-streaming-updater: fixed docker img tagoperations/deployment-chartsmaster+1 -1
rdf-streaming-updater: testing deployment with flink 1.20.2operations/deployment-chartsmaster+2 -0
streaming-updater-producer: Upgrade to Flink 1.20.2wikidata/query/rdfmaster+37 -270
Customize query in gerrit

Related Objects
Search...

Event Timeline

gmodena created this task.Jan 13 2026, 11:19 AM
gmodena mentioned this in T404686: Transition ownership of WDQS from Search Platform to Wikidata Platform team.
gmodena edited projects, added Wikidata-Query-Service (Current Sprint); removed Wikidata-Query-Service.Tue, Jan 20, 4:50 PM
gmodena updated the task description. (Show Details)Wed, Jan 21, 1:29 PM
trueg changed the task status from Open to In Progress.Wed, Jan 21, 1:31 PM
trueg claimed this task.
trueg added a project: Essential-Work.
trueg moved this task from Backlog to In Engineering on the Wikidata-Query-Service (Current Sprint) board.
CodeReviewBot added a project: Patch-For-Review.Wed, Jan 21, 1:33 PM

trueg opened https://gitlab.wikimedia.org/repos/releng/gitlab-trusted-runner/-/merge_requests/140

flink-rdf-streaming-updater: new Gitlab namespace

trueg added a comment.Wed, Jan 21, 1:33 PM

gitlab-trusted-runner MR: https://gitlab.wikimedia.org/repos/releng/gitlab-trusted-runner/-/merge_requests/140

CodeReviewBot added a comment.Wed, Jan 21, 3:42 PM

dancy merged https://gitlab.wikimedia.org/repos/releng/gitlab-trusted-runner/-/merge_requests/140

flink-rdf-streaming-updater: new Gitlab namespace

Maintenance_bot removed a project: Patch-For-Review.Wed, Jan 21, 4:32 PM
gerritbot added a comment.Wed, Jan 28, 5:12 PM

Change #1234461 had a related patch set uploaded (by Trueg; author: Trueg):

[wikidata/query/rdf@master] streaming-updater-producer: Upgrade to Flink 1.20.2

https://gerrit.wikimedia.org/r/1234461

gerritbot added a project: Patch-For-Review.Wed, Jan 28, 5:12 PM
trueg added a project: Wikidata Platform Team (Sprint 01 (2026/01/13)).Thu, Jan 29, 10:46 AM
trueg moved this task from Backlog to In Engineering on the Wikidata Platform Team (Sprint 01 (2026/01/13)) board.
DSantamaria removed a project: Wikidata-Query-Service (Current Sprint).Wed, Feb 4, 12:50 PM
gerritbot added a comment.Fri, Feb 6, 10:52 AM

Change #1234461 merged by jenkins-bot:

[wikidata/query/rdf@master] streaming-updater-producer: Upgrade to Flink 1.20.2

https://gerrit.wikimedia.org/r/1234461

gerritbot added a comment.Fri, Feb 6, 11:18 AM

Change #1237468 had a related patch set uploaded (by Trueg; author: Trueg):

[operations/deployment-charts@master] rdf-streaming-updater: testing deployment with flink 1.20.2

https://gerrit.wikimedia.org/r/1237468

CodeReviewBot added a comment.Fri, Feb 6, 11:56 AM

lerickson merged https://gitlab.wikimedia.org/repos/wikidata-platform/flink-rdf-streaming-updater/-/merge_requests/27

Updated base docker image

gerritbot added a comment.Fri, Feb 6, 12:31 PM

Change #1237468 merged by jenkins-bot:

[operations/deployment-charts@master] rdf-streaming-updater: testing deployment with flink 1.20.2

https://gerrit.wikimedia.org/r/1237468

gerritbot added a comment.Fri, Feb 6, 12:40 PM

Change #1237474 had a related patch set uploaded (by Trueg; author: Trueg):

[operations/deployment-charts@master] rdf-streaming-updater: fixed docker img tag

https://gerrit.wikimedia.org/r/1237474

gerritbot added a comment.Fri, Feb 6, 12:42 PM

Change #1237474 merged by jenkins-bot:

[operations/deployment-charts@master] rdf-streaming-updater: fixed docker img tag

https://gerrit.wikimedia.org/r/1237474

gerritbot added a comment.Fri, Feb 6, 12:54 PM

Change #1237481 had a related patch set uploaded (by Trueg; author: Trueg):

[operations/deployment-charts@master] rdf-streaming-updater: fixed ns on new docker img

https://gerrit.wikimedia.org/r/1237481

gerritbot added a comment.Fri, Feb 6, 12:57 PM

Change #1237481 merged by jenkins-bot:

[operations/deployment-charts@master] rdf-streaming-updater: fixed ns on new docker img

https://gerrit.wikimedia.org/r/1237481

gerritbot added a comment.Fri, Feb 6, 1:11 PM

Change #1237484 had a related patch set uploaded (by Trueg; author: Trueg):

[operations/deployment-charts@master] rdf-streaming-updater: fixed typo in docker img version

https://gerrit.wikimedia.org/r/1237484

gerritbot added a comment.Fri, Feb 6, 1:17 PM

Change #1237484 merged by jenkins-bot:

[operations/deployment-charts@master] rdf-streaming-updater: fixed typo in docker img version

https://gerrit.wikimedia.org/r/1237484

CodeReviewBot added a comment.Mon, Feb 9, 1:40 PM

trueg opened https://gitlab.wikimedia.org/repos/wikidata-platform/flink-rdf-streaming-updater/-/merge_requests/28

Downgrade to docker image flink:1.20.1-wmf1-20250911

CodeReviewBot added a comment.Mon, Feb 9, 3:43 PM

trueg merged https://gitlab.wikimedia.org/repos/wikidata-platform/flink-rdf-streaming-updater/-/merge_requests/28

Downgrade to docker image flink:1.20.1-wmf1-20250911

CodeReviewBot added a comment.Mon, Feb 9, 6:08 PM

trueg opened https://gitlab.wikimedia.org/repos/wikidata-platform/flink-rdf-streaming-updater/-/merge_requests/29

Downgrade to docker image flink:1.20.1-wmf1-20250715

gerritbot added a comment.Tue, Feb 10, 12:15 PM

Change #1238324 had a related patch set uploaded (by Trueg; author: Trueg):

[wikidata/query/rdf@master] Support for jdk17.

https://gerrit.wikimedia.org/r/1238324

gerritbot added a comment.Thu, Feb 12, 8:21 AM

Change #1239001 had a related patch set uploaded (by Trueg; author: Trueg):

[integration/config@master] wikidata: Build rdf query service via jdk17

https://gerrit.wikimedia.org/r/1239001

gerritbot added a comment.Thu, Feb 12, 8:22 AM

Change #1238324 merged by jenkins-bot:

[wikidata/query/rdf@master] Support for jdk17.

https://gerrit.wikimedia.org/r/1238324

gerritbot added a comment.Thu, Feb 12, 8:26 AM

Change #1239001 abandoned by Trueg:

[integration/config@master] wikidata: Build rdf query service via jdk17

https://gerrit.wikimedia.org/r/1239001

CodeReviewBot added a comment.Fri, Feb 13, 8:17 AM

trueg opened https://gitlab.wikimedia.org/repos/wikidata-platform/flink-rdf-streaming-updater/-/merge_requests/30

Reverted back to flink 1.20.2 and updated to 0.3.161

CodeReviewBot added a comment.Fri, Feb 13, 10:05 AM

trueg merged https://gitlab.wikimedia.org/repos/wikidata-platform/flink-rdf-streaming-updater/-/merge_requests/30

Reverted back to flink 1.20.2 and updated to 0.3.161

gerritbot added a comment.Fri, Feb 13, 10:24 AM

Change #1239001 restored by Trueg:

[integration/config@master] wikidata: Build rdf query service via jdk17

https://gerrit.wikimedia.org/r/1239001

gerritbot added a comment.Fri, Feb 13, 5:33 PM

Change #1239381 had a related patch set uploaded (by Trueg; author: Trueg):

[wikidata/query/rdf@master] Scala downgrade to 2.12.7 to fix incompatibility with flink 1.20.2

https://gerrit.wikimedia.org/r/1239381

Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL · Credits