Migrate MediaWiki.jobqueue to statslib
Closed, ResolvedPublic3 Estimated Story Points
Actions

Description

Follow the migration process as outlined below.

Secure/Conduct code review(s).
Deploy the changes to production via the train (https://wikitech.wikimedia.org/wiki/Deployments/Train).
Verify that the changes have been successfully implemented.
Update the relevant dashboard(s) by replacing the old Graphite metric(s) with the new Prometheus metric(s).
Please follow the guidelines and standards outlined in the provided documentation:

https://www.mediawiki.org/wiki/Manual:Stats for detailed guidance on the conversion process.
https://drive.google.com/file/d/12yQEuOapkML1vb9MgCaX1QzbLBdXE6X2/view for a video tutorial on the conversion process.
https://docs.google.com/presentation/d/1SZWf_D3mWNX-XHN8PHYI84LDZr6GUQC2AMhZ9mQXCI0/edit#slide=id.g2795460c956_0_23 for slides on the best practices for converting metrics to statslib.

MediaWiki.jobqueue.inserts.Cognate*.sum
MediaWiki.jobqueue.job_pop.EchoNotificationDeleteJob.count
MediaWiki.jobqueue.job_pop.EchoNotificationJob.count
MediaWiki.jobqueue.pickup_delay.all.mean
MediaWiki.jobqueue.pickup_delay.EchoNotificationDeleteJob.mean
MediaWiki.jobqueue.pickup_delay.EchoNotificationJob.mean
MediaWiki.jobqueue.run.cirrus*.count
MediaWiki.jobqueue.run.cirrus*.mean
MediaWiki.jobqueue.run.Cognate*.sum

Details

Related Changes in Gerrit:

	Subject	Repo	Branch	Lines +/-
	Migrate MediaWiki.jobqueue to statslib	mediawiki/core	master	+58 -42

Customize query in gerrit

Related Objects
Search...

Status	Assigned	Task
Open	None	T343020 Converting MediaWiki Metrics to StatsLib
Resolved	herron	T350591 Audit legacy mediawiki stats used in production dashboards
Open	None	T350592 EPIC: migrate in use metrics and dashboards to statslib
Resolved	Atieno	T359472 Migrate MediaWiki.jobqueue to statslib

Event Timeline

• lmata created this task.Mar 6 2024, 8:57 PM

Restricted Application added a subscriber: Aklapper. · View Herald TranscriptMar 6 2024, 8:57 PM

• lmata mentioned this in T350592: EPIC: migrate in use metrics and dashboards to statslib.Mar 6 2024, 9:08 PM

MSantos added a project: MediaWiki-Engineering.Aug 15 2024, 5:02 PM

MSantos added projects: WMF-JobQueue, MW-Interfaces-Team.Aug 21 2024, 1:39 PM

MSantos moved this task from Inbox, needs triage to MediaWiki Interfaces team on the MediaWiki-Engineering board.

@MSantos , this task was authored around the same time as T359278: Migrate MediaWiki.RevisionOutputCache.* to statslib and is a similar area. I see CTT put T359278: Migrate MediaWiki.RevisionOutputCache.* to statslib in their backlog. Should this task go along with T359278: Migrate MediaWiki.RevisionOutputCache.* to statslib, or should MWI take this on?

BPirkle mentioned this in T359473: Migrate MediaWiki.jobexecutor.*.exec to statslib.Aug 22 2024, 3:25 PM

In T359472#10085347, @BPirkle wrote:

@MSantos , this task was authored around the same time as T359278: Migrate MediaWiki.RevisionOutputCache.* to statslib and is a similar area. I see CTT put T359278: Migrate MediaWiki.RevisionOutputCache.* to statslib in their backlog. Should this task go along with T359278: Migrate MediaWiki.RevisionOutputCache.* to statslib, or should MWI take this on?

@BPirkle the time of creation is similar due to the script that create them. AFAIK, jobqueue and RevisionOutputCache are not similar for the sake of this task. This one has been triaged to MWI team, but the RevisionOutputCache I'm not sure. For RevisionOutputCache I'm fine either way it's triaged, and trust your judgement, since I don't know in which team domain it belongs.

BPirkle triaged this task as Low priority.Aug 29 2024, 3:44 PM

BPirkle moved this task from Incoming (Needs Triage) to Backlog on the MW-Interfaces-Team board.

• lmata moved this task from Inbox to Prioritized on the Observability-Metrics board.Oct 30 2024, 6:58 PM

Note: This work is expected to be done by April. Should be minor change; see other linked patches for examples.

HCoplin-WMF added a project: Essential-Work.Dec 18 2024, 2:53 PM

HCoplin-WMF moved this task from Backlog to To Refine on the MW-Interfaces-Team board.Dec 18 2024, 6:37 PM

In T359472#10412624, @HCoplin-WMF wrote:

Note: This work is expected to be done by April. Should be minor change; see other linked patches for examples.

This is a friendly reminder that graphite is planned to be set to read-only by the end of Q3 (March 2025). Therefore, there is a risk that metrics will not be ingested past that date. Dashboards will continue to serve historical but no new data. More info in: https://wikitech.wikimedia.org/wiki/Graphite/Deprecation_Roadmap

HCoplin-WMF set the point value for this task to 3.Jan 23 2025, 4:11 PM

HCoplin-WMF moved this task from To Refine to MWI-Sprint-3 (2025-02-11 to 2025-02-25) on the MW-Interfaces-Team board.Feb 11 2025, 4:06 PM

HCoplin-WMF edited projects, added MW-Interfaces-Team (MWI-Sprint-3 (2025-02-11 to 2025-02-25)); removed MW-Interfaces-Team.

HCoplin-WMF assigned this task to Atieno.Feb 13 2025, 4:14 PM

HCoplin-WMF moved this task from Committed to In Progress on the MW-Interfaces-Team (MWI-Sprint-3 (2025-02-11 to 2025-02-25)) board.

Atieno updated the task description. (Show Details)Feb 18 2025, 2:44 PM

Change #1120578 had a related patch set uploaded (by Atieno; author: Atieno):

[mediawiki/core@master] Migrate MediaWiki.jobqueue to statslib

https://gerrit.wikimedia.org/r/1120578

gerritbot added a project: Patch-For-Review.Feb 18 2025, 3:32 PM

Atieno moved this task from In Progress to Code Review on the MW-Interfaces-Team (MWI-Sprint-3 (2025-02-11 to 2025-02-25)) board.Feb 25 2025, 1:37 PM

BPirkle moved this task from MWI-Sprint-3 (2025-02-11 to 2025-02-25) to MWI-Sprint-4 (2025-02-25 to 2025-03-11) on the MW-Interfaces-Team board.Feb 25 2025, 3:51 PM