Page MenuHomePhabricator
Create Task
Maniphest T385867

Migrate CampaignEvents jobs to mw-cron
Closed, ResolvedPublic
Actions

Description

Migrate CampaignEvents periodic mediawiki jobs from mwmaint to mw-cron on kubernetes.

  • campaignevents-updateutcts-metawiki
  • campaignevents-aggregateparticipantanswers-metawiki
  • campaignevents-updateutcts-testwiki
  • campaignevents-aggregateparticipantanswers-testwiki
  • campaignevents-updateutcts-officewiki
  • campaignevents-aggregateparticipantanswers-officewiki
  • campaignevents-updateutcts-test2wiki
  • campaignevents-aggregateparticipantanswers-test2wiki

Doc on the new platform

ServiceOps new will handle migrating the jobs, but would appreciate input from Connection-Team on:

  • jobs that should be watched more closely
  • jobs that are low criticality and could be migrated first
  • outdated jobs that can be removed
  • any potential gotchas in the way these jobs use MediaWiki

Details

Related Changes in Gerrit:
SubjectRepoBranchLines +/-
CampaignEvents: Migrate updateutcts-test2wikioperations/puppetproduction+11 -2
mw-cron/CampaignEvents: Migrate aggregateanswers-{meta,office}wikioperations/puppetproduction+22 -8
CampaignEvents: Migrate aggregateparticipantanswers-testwikioperations/puppetproduction+11 -4
mw::maintenance::campaignevents: migrate remaining updateutcts jobs to k8soperations/puppetproduction+24 -6
CampaignEvents: Migrate aggregateparticipantanswers-test2wikioperations/puppetproduction+11 -4
CampaignEvents: Shorten aggregateparticipantanswers nameoperations/puppetproduction+12 -0
CampaignEvents: Migrate aggregateparticipantanswers-test2wikioperations/puppetproduction+9 -3
alertmanager: Add routing for task alertsoperations/puppetproduction+36 -0
alertmanager: Add team/project receivers for Phaboperations/puppetproduction+37 -0
Customize query in gerrit

Related Objects
Search...

Event Timeline

Clement_Goubert created this task.Feb 7 2025, 10:38 AM
Daimona subscribed.Feb 7 2025, 2:20 PM

Thanks for taking care of this! As for the input requested:

jobs that should be watched more closely

Of the two job types, aggregateparticipantanswers is more important because it ensures compliance with data retention policies. And within each job type, the -metawiki one is for all production non-test environments, hence more important than the others.

jobs that are low criticality and could be migrated first

Based on the above, you could do updateutcts before aggregateparticipantanswers, and for each job type, start with test(2)wiki, then officewiki, then metawiki (if you need more granularity).

outdated jobs that can be removed

None.

any potential gotchas in the way these jobs use MediaWiki

Nothing special comes to mind, but I'd be happy to provide more information if there are any specific things we should be looking at.

Daimona moved this task from Backlog to Following on the Connection-Team board.Feb 19 2025, 7:25 PM
jijiki moved this task from Incoming 🐫 to this.quarter 🍕 on the serviceops-deprecated board.Apr 2 2025, 12:09 PM
gerritbot added a comment.Apr 8 2025, 3:02 PM

Change #1135051 had a related patch set uploaded (by Clément Goubert; author: Clément Goubert):

[operations/puppet@production] CampaignEvents: Migrate updateutcts-test2wiki

https://gerrit.wikimedia.org/r/1135051

gerritbot added a project: Patch-For-Review.Apr 8 2025, 3:02 PM
gerritbot added a comment.Apr 10 2025, 3:07 PM

Change #1135753 had a related patch set uploaded (by Clément Goubert; author: Clément Goubert):

[operations/puppet@production] alertmanager: Add team/project receivers for Phab

https://gerrit.wikimedia.org/r/1135753

gerritbot added a comment.Apr 10 2025, 3:08 PM

Change #1135754 had a related patch set uploaded (by Clément Goubert; author: Clément Goubert):

[operations/puppet@production] alertmanager: Add routing for task alerts

https://gerrit.wikimedia.org/r/1135754

gerritbot added a comment.Apr 10 2025, 4:20 PM

Change #1135753 merged by Clément Goubert:

[operations/puppet@production] alertmanager: Add team/project receivers for Phab

https://gerrit.wikimedia.org/r/1135753

gerritbot added a comment.Apr 10 2025, 4:20 PM

Change #1135754 merged by Clément Goubert:

[operations/puppet@production] alertmanager: Add routing for task alerts

https://gerrit.wikimedia.org/r/1135754

Clement_Goubert changed the task status from Open to In Progress.Apr 11 2025, 11:17 AM
gerritbot added a comment.Apr 15 2025, 2:24 PM

Change #1136734 had a related patch set uploaded (by Kamila Součková; author: Kamila Součková):

[operations/puppet@production] CampaignEvents: Migrate aggregateparticipantanswers-test2wiki

https://gerrit.wikimedia.org/r/1136734

gerritbot added a comment.Apr 16 2025, 12:11 PM

Change #1135051 merged by Clément Goubert:

[operations/puppet@production] CampaignEvents: Migrate updateutcts-test2wiki

https://gerrit.wikimedia.org/r/1135051

Clement_Goubert triaged this task as Medium priority.Apr 16 2025, 12:19 PM
Clement_Goubert updated the task description. (Show Details)Apr 16 2025, 12:25 PM
gerritbot added a comment.Apr 16 2025, 2:26 PM

Change #1136734 merged by Kamila Součková:

[operations/puppet@production] CampaignEvents: Migrate aggregateparticipantanswers-test2wiki

https://gerrit.wikimedia.org/r/1136734

Maintenance_bot removed a project: Patch-For-Review.Apr 16 2025, 2:30 PM
gerritbot added a comment.Apr 24 2025, 5:01 PM

Change #1138855 had a related patch set uploaded (by Kamila Součková; author: Kamila Součková):

[operations/puppet@production] CampaignEvents: Shorten aggregateparticipantanswers name

https://gerrit.wikimedia.org/r/1138855

gerritbot added a project: Patch-For-Review.Apr 24 2025, 5:01 PM
gerritbot added a comment.Apr 25 2025, 11:25 AM

Change #1138855 abandoned by Kamila Součková:

[operations/puppet@production] CampaignEvents: Shorten aggregateparticipantanswers name

Reason:

not needed after I3e4ed0f4296a333050a20070e35ffaf10055f846

https://gerrit.wikimedia.org/r/1138855

Maintenance_bot removed a project: Patch-For-Review.Apr 25 2025, 11:30 AM
gerritbot added a comment.Apr 25 2025, 2:23 PM

Change #1139056 had a related patch set uploaded (by Kamila Součková; author: Kamila Součková):

[operations/puppet@production] CampaignEvents: Migrate aggregateparticipantanswers-test2wiki

https://gerrit.wikimedia.org/r/1139056

gerritbot added a project: Patch-For-Review.Apr 25 2025, 2:23 PM
gerritbot added a comment.Apr 28 2025, 10:23 AM

Change #1139428 had a related patch set uploaded (by Hnowlan; author: Hnowlan):

[operations/puppet@production] mw::maintenance::campaignevents: migrate remaining updateutcts jobs to k8s

https://gerrit.wikimedia.org/r/1139428

gerritbot added a comment.Apr 28 2025, 1:26 PM

Change #1139056 merged by Kamila Součková:

[operations/puppet@production] CampaignEvents: Migrate aggregateparticipantanswers-test2wiki

https://gerrit.wikimedia.org/r/1139056

gerritbot added a comment.Apr 28 2025, 1:59 PM

Change #1139428 merged by Hnowlan:

[operations/puppet@production] mw::maintenance::campaignevents: migrate remaining updateutcts jobs to k8s

https://gerrit.wikimedia.org/r/1139428

hnowlan updated the task description. (Show Details)Apr 28 2025, 2:03 PM
Maintenance_bot removed a project: Patch-For-Review.Apr 28 2025, 2:31 PM
gerritbot added a comment.Apr 29 2025, 10:47 AM

Change #1139811 had a related patch set uploaded (by Kamila Součková; author: Kamila Součková):

[operations/puppet@production] CampaignEvents: Migrate aggregateparticipantanswers-testwiki

https://gerrit.wikimedia.org/r/1139811

gerritbot added a project: Patch-For-Review.Apr 29 2025, 10:47 AM
Raine updated the task description. (Show Details)May 2 2025, 12:03 PM
gerritbot added a comment.May 6 2025, 11:35 AM

Change #1139811 merged by Kamila Součková:

[operations/puppet@production] CampaignEvents: Migrate aggregateparticipantanswers-testwiki

https://gerrit.wikimedia.org/r/1139811

Maintenance_bot removed a project: Patch-For-Review.May 6 2025, 12:30 PM
gerritbot added a comment.May 7 2025, 11:17 AM

Change #1143058 had a related patch set uploaded (by Kamila Součková; author: Kamila Součková):

[operations/puppet@production] mw-cron/CampaignEvents: Migrate aggregateanswers-{meta,office}wiki

https://gerrit.wikimedia.org/r/1143058

gerritbot added a project: Patch-For-Review.May 7 2025, 11:17 AM
gerritbot added a comment.May 7 2025, 3:59 PM

Change #1143058 merged by Kamila Součková:

[operations/puppet@production] mw-cron/CampaignEvents: Migrate aggregateanswers-{meta,office}wiki

https://gerrit.wikimedia.org/r/1143058

Maintenance_bot removed a project: Patch-For-Review.May 7 2025, 4:31 PM
Raine closed this task as Resolved.May 8 2025, 1:54 PM
Raine updated the task description. (Show Details)
Raine subscribed.

All jobs are migrated and running successfully.

Daimona added a comment.May 26 2025, 3:24 PM

Thank you!

Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL · Credits