Roll out randomly-sampled traces on all mw-* clusters
Closed, ResolvedPublic
Actions

Assigned To

Authored By

	CDanis
	Jun 18 2024, 7:26 PM

Description

Rollout plan:

mws not listed below (mw-jobrunner, mw-parsoid, mw-misc, mw-wikifunctions)

mw-api-int
mw-api-ext
mw-web

Target: between 0.1-1% random sample.

Details

Related Changes in Gerrit:

Subject	Repo	Branch	Lines +/-
Sampled tracing (0.1%) for mw-web	operations/deployment-charts	master	+3 -0
Sampled tracing (0.1%) for mw-api-ext	operations/deployment-charts	master	+3 -0
Sampled tracing (0.1%) for mw-api-int	operations/deployment-charts	master	+3 -0
Sampled tracing for mw jobrunner, misc, parsoid, wikifunctions	operations/deployment-charts	master	+13 -1

Customize query in gerrit

Related Objects
Search...

Status	Assigned	Task
Open	None	T340551 distributed tracing epic
Open	None	T320549 distributed tracing v0 [minimum viable]
Resolved	CDanis	T367915 Roll out randomly-sampled traces on all mw-* clusters

Event Timeline

CDanis created this task.Jun 18 2024, 7:26 PM

Restricted Application added a subscriber: Aklapper. · View Herald TranscriptJun 18 2024, 7:26 PM

CDanis updated the task description. (Show Details)Jun 18 2024, 7:26 PM

• Playgiirlkaybrazy added a parent task: T181024: AbuseFilter should not cast arrays into strings.Jun 18 2024, 7:39 PM

• MusikAnimal removed a parent task: T181024: AbuseFilter should not cast arrays into strings.Jun 18 2024, 7:40 PM

Clement_Goubert updated the task description. (Show Details)Jun 19 2024, 8:36 AM

Change #1047992 had a related patch set uploaded (by CDanis; author: CDanis):

[operations/deployment-charts@master] Sampled tracing for mw jobrunner, misc, and parsoid

https://gerrit.wikimedia.org/r/1047992

gerritbot added a project: Patch-For-Review.Jun 20 2024, 1:17 PM

Change #1047992 merged by jenkins-bot:

[operations/deployment-charts@master] Sampled tracing for mw jobrunner, misc, parsoid, wikifunctions

https://gerrit.wikimedia.org/r/1047992

CDanis updated the task description. (Show Details)Jun 20 2024, 1:47 PM

CDanis updated the task description. (Show Details)Jun 20 2024, 2:00 PM

Change #1048011 had a related patch set uploaded (by CDanis; author: CDanis):

[operations/deployment-charts@master] Sampled tracing (0.1%) for mw-api-int

https://gerrit.wikimedia.org/r/1048011

Change #1048011 merged by jenkins-bot:

[operations/deployment-charts@master] Sampled tracing (0.1%) for mw-api-int

https://gerrit.wikimedia.org/r/1048011

Maintenance_bot removed a project: Patch-For-Review.Jun 20 2024, 2:30 PM

10:14:32	<@cdanis>	_joe_ akosiaris claime: my plan is to smoke-test {jobrunner,wikifunctions,parsoid,misc} for a few more minutes, then roll out mw-api-int sampled tracing https://gerrit.wikimedia.org/r/1048011 , and then let that bake over the weekend before doing mw-api-ext and then mw-web
10:14:52	<@akosiaris>	👍
10:15:29	<@claime>	ack
10:16:21	<@cdanis>	I also gave o11y a heads up about the increased writes to elasticsearch
10:16:24	<@_joe_>	seems sensible