Page MenuHomePhabricator

Migrate changeprop to kubernetes
Open, MediumPublic

Description

Subtask of the TEC3:O3:O3.1:Q3 Goal to migrate changeprop to use the deployment pipeline

Details

Related Gerrit Patches:
mediawiki/services/change-propagation : masterChanges for Changeprop and cpjobqueue to K8s migration
mediawiki/services/change-propagation : masterChanges for Changeprop and cpjobqueue to K8s migration
mediawiki/services/change-propagation : masterChanges for Changeprop and cpjobqueue to K8s migration
mediawiki/services/change-propagation : masterChanges for Changeprop and cpjobqueue to K8s migration
integration/config : masterSwitch change-propagation to the pipeline

Event Timeline

Restricted Application added a subscriber: Aklapper. · View Herald TranscriptJan 8 2019, 5:32 PM
greg triaged this task as Medium priority.Jan 9 2019, 6:14 PM
thcipriani updated the task description. (Show Details)Jan 9 2019, 6:15 PM
Pchelolo moved this task from Backlog to watching on the Services board.Jan 9 2019, 8:03 PM
Pchelolo edited projects, added Services (watching); removed Services.
jijiki added a subscriber: jijiki.Jan 24 2019, 4:25 PM

Change 496387 had a related patch set uploaded (by Alexandros Kosiaris; owner: Alexandros Kosiaris):
[integration/config@master] Switch change-propagation to the pipeline

https://gerrit.wikimedia.org/r/496387

BTW, I'm currently having a node-rdkafka + k8s related issue in EventGate: T218268: eventgate-analytics k8s pods occasionally can't produce to kafka. It is possible that there is some EventGate specific code causing this problem, but at the moment it only happens in k8s. I'd expect change-prop to exhibit this problem as well.

Change 496387 merged by jenkins-bot:
[integration/config@master] Switch change-propagation to the pipeline

https://gerrit.wikimedia.org/r/496387

Dzahn added a subscriber: Dzahn.Apr 17 2019, 10:23 PM

Does this need cleanup or can it be marked as Resolved?

changeprop has not been moved to k8s, so no, it can not be marked as resolved.

Oh, sorry, mis-read the above message.

fsero moved this task from Backlog to Goal tasks on the serviceops board.Jun 20 2019, 2:14 PM
akosiaris moved this task from Goal tasks to Backlog on the serviceops board.Jun 21 2019, 8:26 AM

Change 565130 had a related patch set uploaded (by Ppchelko; owner: Holger Knust):
[mediawiki/services/change-propagation@master] Changes for Changeprop and cpjobqueue to K8s migration

https://gerrit.wikimedia.org/r/565130

Change 565130 abandoned by Ppchelko:
Changes for Changeprop and cpjobqueue to K8s migration

Reason:
Let's try again...

https://gerrit.wikimedia.org/r/565130

Change 565135 had a related patch set uploaded (by Ppchelko; owner: Holger Knust):
[mediawiki/services/change-propagation@master] Changes for Changeprop and cpjobqueue to K8s migration

https://gerrit.wikimedia.org/r/565135

Change 565135 abandoned by Ppchelko:
Changes for Changeprop and cpjobqueue to K8s migration

Reason:
Need to cherry-pick, not pull..

https://gerrit.wikimedia.org/r/565135

Change 565137 had a related patch set uploaded (by Ppchelko; owner: Holger Knust):
[mediawiki/services/change-propagation@master] Changes for Changeprop and cpjobqueue to K8s migration

https://gerrit.wikimedia.org/r/565137

Change 565137 abandoned by Ppchelko:
Changes for Changeprop and cpjobqueue to K8s migration

Reason:
Transferring commits from GH doesn't seem to work

https://gerrit.wikimedia.org/r/565137

Change 565130 merged by Ppchelko:
[mediawiki/services/change-propagation@master] Changes for Changeprop and cpjobqueue to K8s migration

https://gerrit.wikimedia.org/r/565130

Change 565144 had a related patch set uploaded (by Ppchelko; owner: Holger Knust):
[mediawiki/services/change-propagation@master] Changes for Changeprop and cpjobqueue to K8s migration

https://gerrit.wikimedia.org/r/565144

Change 565144 merged by jenkins-bot:
[mediawiki/services/change-propagation@master] Changes for Changeprop and cpjobqueue to K8s migration

https://gerrit.wikimedia.org/r/565144

After a bunch of fighting with corrupted change-prop repo on gerrit and with help from RelEng, we now have a working image built via the pipeline.

See https://gerrit.wikimedia.org/r/c/mediawiki/services/change-propagation/+/565150