Maniphest T366750

Basic data quality work for traces
Open, Needs TriagePublic
Actions

Assigned To

Authored By

	CDanis
	Jun 5 2024, 8:03 PM

Tags

Referenced Files

None

Subscribers

Description

Filter out some very noisy spans (e.g. healthchecks, Special:Blankpage etc)
Remove known PII (sessionstore URL)
Do looking around for more PII
- or other undesirable data?

Details

Related Changes in Gerrit:

	Subject	Repo	Branch	Lines +/-
	otelcol: scrub echostore userids	operations/deployment-charts	master	+6 -0
	otelcol: drop service-runner healthchecks	operations/deployment-charts	master	+1 -0
	bump quota for otelcol	operations/deployment-charts	master	+9 -1
	otelcol: filter common healthcheck spans	operations/deployment-charts	master	+8 -0
	otelcol: filter out sessionstore user IDs	operations/deployment-charts	master	+13 -0

Customize query in gerrit

Related Objects
Search...

		Status	Subtype	Assigned	Task
		Open		None	T340551 distributed tracing epic
		Open		None	T320549 distributed tracing v0 [minimum viable]
		Open		CDanis	T366750 Basic data quality work for traces
		Resolved		CDanis	T364907 upgrade to latest stable version of otelcol-contrib
		Resolved		fgiunchedi	T372411 Automation to find / summarize "orphaned" traces

Event Timeline

CDanis created this task.Jun 5 2024, 8:03 PM

Restricted Application added a subscriber: Aklapper. · View Herald TranscriptJun 5 2024, 8:03 PM

Change #1039292 had a related patch set uploaded (by CDanis; author: CDanis):

[operations/deployment-charts@master] otelcol: filter out sessionstore user IDs

https://gerrit.wikimedia.org/r/1039292

gerritbot added a project: Patch-For-Review.Jun 5 2024, 8:04 PM

Change #1039297 had a related patch set uploaded (by CDanis; author: CDanis):

[operations/deployment-charts@master] otelcol: filter common healthcheck spans

https://gerrit.wikimedia.org/r/1039297

Patches as written depend upon otelcol v0.102.0, so upgrading again.

CDanis added a subtask: T364907: upgrade to latest stable version of otelcol-contrib.Jun 12 2024, 4:08 PM

Change #1039292 merged by jenkins-bot:

[operations/deployment-charts@master] otelcol: filter out sessionstore user IDs

https://gerrit.wikimedia.org/r/1039292

Change #1039297 merged by jenkins-bot:

[operations/deployment-charts@master] otelcol: filter common healthcheck spans

https://gerrit.wikimedia.org/r/1039297

Change #1042318 had a related patch set uploaded (by CDanis; author: CDanis):

[operations/deployment-charts@master] bump quota for otelcol

https://gerrit.wikimedia.org/r/1042318

Change #1042318 merged by CDanis:

[operations/deployment-charts@master] bump quota for otelcol

https://gerrit.wikimedia.org/r/1042318

Remove known PII (sessionstore URL)
Filter out some very noisy spans (e.g. healthchecks, Special:Blankpage etc)

Both of these verified working in production :)

CDanis updated the task description. (Show Details)Jun 12 2024, 5:25 PM

Maintenance_bot removed a project: Patch-For-Review.Jun 12 2024, 5:30 PM

fgiunchedi closed subtask T372411: Automation to find / summarize "orphaned" traces as Resolved.Sep 12 2024, 9:03 AM

Change #1108086 had a related patch set uploaded (by CDanis; author: CDanis):

[operations/deployment-charts@master] otelcol: drop service-runner healthchecks

https://gerrit.wikimedia.org/r/1108086

gerritbot added a project: Patch-For-Review.Jan 3 2025, 2:44 PM

Change #1108106 had a related patch set uploaded (by CDanis; author: CDanis):

[operations/deployment-charts@master] draft: scrub echostore userids

https://gerrit.wikimedia.org/r/1108106

Change #1108086 merged by CDanis:

[operations/deployment-charts@master] otelcol: drop service-runner healthchecks

https://gerrit.wikimedia.org/r/1108086

Change #1108106 merged by CDanis:

[operations/deployment-charts@master] otelcol: scrub echostore userids

https://gerrit.wikimedia.org/r/1108106

Maintenance_bot removed a project: Patch-For-Review.Jun 3 2025, 5:31 PM