Page MenuHomePhabricator
Create Task
Maniphest T385800

Migrate ParserCachePurging jobs to mw-cron
Closed, ResolvedPublic
Actions

Description

Migrate ParserCachePurging periodic mediawiki jobs from mwmaint to mw-cron on kubernetes.

  • purge_parsercache_pc1
  • purge_parsercache_pc2
  • purge_parsercache_pc3
  • purge_parsercache_pc4
  • purge_parsercache_pc5
  • purge_parsercache_pc6
  • purge_parsercache_pc7
  • db_lag_stats_reporter

Doc on the new platform

ServiceOps new will handle migrating the jobs, but would appreciate input from Data-Persistence on:

  • jobs that should be watched more
  • jobs that are low criticality and could be migrated first
  • any potential gotchas in the way these jobs use MediaWiki

Details

Related Changes in Gerrit:
SubjectRepoBranchLines +/-
mw::maintenance: migrate db_lag_stats_reporter to k8soperations/puppetproduction+11 -2
mw::maintenance: migrate all parsercache jobs to k8soperations/puppetproduction+48 -12
mw::maintenance: migrate purge_parsercache_pc1 to k8soperations/puppetproduction+10 -2
alertmanager: Route 4 teams' task-severity alerts to Phaboperations/puppetproduction+21 -0
alertmanager: add route for task-severity data-persistence alertsoperations/puppetproduction+3 -0
Customize query in gerrit

Related Objects
Search...

Event Timeline

Clement_Goubert created this task.Feb 6 2025, 1:05 PM
Ladsgroup subscribed.Feb 7 2025, 1:08 PM

Migrating PC cache jobs should be easy. Probably migrate one first and see if everything works fine. The rest are exactly the same job but on different cluster.

jijiki moved this task from Incoming 🐫 to this.quarter 🍕 on the serviceops-deprecated board.Apr 2 2025, 12:09 PM
gerritbot added a comment.Apr 9 2025, 12:00 PM

Change #1135413 had a related patch set uploaded (by Kamila Součková; author: Kamila Součková):

[operations/puppet@production] alertmanager: add route for task-severity data-persistence alerts

https://gerrit.wikimedia.org/r/1135413

gerritbot added a project: Patch-For-Review.Apr 9 2025, 12:00 PM
gerritbot added a comment.Apr 10 2025, 2:33 PM

Change #1135418 had a related patch set uploaded (by Clément Goubert; author: Kamila Součková):

[operations/puppet@production] alertmanager: Route 4 teams' task-severity alerts to Phab

https://gerrit.wikimedia.org/r/1135418

gerritbot added a comment.Apr 10 2025, 2:34 PM

Change #1135413 abandoned by Clément Goubert:

[operations/puppet@production] alertmanager: add route for task-severity data-persistence alerts

Reason:

Added in Ibbdbb4d46b4684649c4800a81b8835bae0bdcc79

https://gerrit.wikimedia.org/r/1135413

gerritbot added a comment.Apr 10 2025, 2:41 PM

Change #1135418 merged by Clément Goubert:

[operations/puppet@production] alertmanager: Route 4 teams' task-severity alerts to Phab

https://gerrit.wikimedia.org/r/1135418

Maintenance_bot removed a project: Patch-For-Review.Apr 10 2025, 3:31 PM
gerritbot added a comment.Apr 28 2025, 9:56 AM

Change #1139422 had a related patch set uploaded (by Hnowlan; author: Hnowlan):

[operations/puppet@production] mw::maintenance: migrate purge_parsercache_pc1 to k8s

https://gerrit.wikimedia.org/r/1139422

gerritbot added a project: Patch-For-Review.Apr 28 2025, 9:56 AM
gerritbot added a comment.May 6 2025, 2:25 PM

Change #1139422 merged by Hnowlan:

[operations/puppet@production] mw::maintenance: migrate purge_parsercache_pc1 to k8s

https://gerrit.wikimedia.org/r/1139422

Maintenance_bot removed a project: Patch-For-Review.May 6 2025, 2:30 PM
gerritbot added a comment.May 7 2025, 2:23 PM

Change #1143110 had a related patch set uploaded (by Hnowlan; author: Hnowlan):

[operations/puppet@production] mw::maintenance: migrate all parsercache jobs to k8s

https://gerrit.wikimedia.org/r/1143110

gerritbot added a project: Patch-For-Review.May 7 2025, 2:23 PM
gerritbot added a comment.May 7 2025, 4:04 PM

Change #1143110 merged by Hnowlan:

[operations/puppet@production] mw::maintenance: migrate all parsercache jobs to k8s

https://gerrit.wikimedia.org/r/1143110

Maintenance_bot removed a project: Patch-For-Review.May 7 2025, 4:31 PM
hnowlan updated the task description. (Show Details)May 8 2025, 11:22 AM
gerritbot added a comment.May 8 2025, 11:25 AM

Change #1143533 had a related patch set uploaded (by Hnowlan; author: Hnowlan):

[operations/puppet@production] mw::maintenance: migrate db_lag_stats_reporter to k8s

https://gerrit.wikimedia.org/r/1143533

gerritbot added a project: Patch-For-Review.May 8 2025, 11:25 AM
Clement_Goubert changed the task status from Open to In Progress.May 20 2025, 3:29 PM
Clement_Goubert triaged this task as High priority.
Clement_Goubert updated the task description. (Show Details)
gerritbot added a comment.May 22 2025, 11:28 AM

Change #1143533 merged by Hnowlan:

[operations/puppet@production] mw::maintenance: migrate db_lag_stats_reporter to k8s

https://gerrit.wikimedia.org/r/1143533

Maintenance_bot removed a project: Patch-For-Review.May 22 2025, 11:30 AM
hnowlan subscribed.May 22 2025, 11:41 AM

db_stats_lag migrated and looks like execution times shouldn't be a problem. See a few successful runs, and run times look like:

Start Time:   Thu, 22 May 2025 11:39:00 +0000
Containers:
      Started:      Thu, 22 May 2025 11:39:01 +0000
      Finished:     Thu, 22 May 2025 11:39:02 +0000
hnowlan closed this task as Resolved.May 22 2025, 11:42 AM
hnowlan claimed this task.
hnowlan updated the task description. (Show Details)
Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL · Credits