Tech debt: sunsetting of Graphite (part 1)
Open, MediumPublic
Actions

Assigned To

None

Authored By

	fgiunchedi
	Jul 18 2019, 8:36 AM

Description

Deprecate statsd: fully migrate >= 30% of producers off statsd
[stretch] Deploy Thanos (long-term storage) stateless components: sidecar and query

Related Objects
Search...

Status	Assigned	Task
Open	None	T228380 Tech debt: sunsetting of Graphite (part 1)
Open	colewhite	T205870 Fully migrate producers off statsd
Open	None	T233089 Export zuul metrics to Prometheus
Resolved	• ACraze	T233448 Review prometheus ORES rules for completeness
Declined	colewhite	T239833 StatsD Exporter drops relayed metrics
Resolved	colewhite	T240685 MediaWiki Prometheus support
Resolved	colewhite	T249164 RFC: Better interface for generating metrics in MediaWiki
Resolved	Krinkle	T292311 Create project tag for MediaWiki-libs-Metrics
Resolved	Krinkle	T292269 Decouple Profiler class from WebRequest and RequestContext
Resolved	Krinkle	T344748 MediaWiki Core - Review and merge StatsLib patch
Resolved	herron	T344751 Decide on default histogram buckets for MediaWiki timers
Open	None	T240995 AQS is not OpenAPI 3 compliant
Resolved	• Pchelolo	T241176 Review and release service-runner 2.8.0
Resolved	colewhite	T247820 Decide on `service-runner` aggregated prometheus metrics and use of `service` label
Resolved	Jgiannelos	T277857 Proton metrics broken
Open	None	T175087 Create a navtiming processor for Prometheus
Declined	None	T190936 navtiming.py: When processing metrics, include effectiveConnectionType as a factor
Resolved	Peter	T323124 Replace navtiming Platform tag ("site") with mw_skin
Resolved	Krinkle	T323129 Simulate client dispatch in a single scrape
Open	Peter	T321398 Move performance metrics from Graphite to Prometheus
Open	Peter	T325282 Update Grafana alerts to use metrics from Prometheus
Resolved	Peter	T325283 Update navtiming dashboards to use Prometheus metrics
Open	None	T325284 Update documentation to use Prometheus instead of Graphite
Open	None	T336764 Simplify navtiming multi-dc logic
Open	None	T293761 statsd and gunicorn metrics for superset
Resolved	fgiunchedi	T233956 Deploy Thanos (long-term storage) stateless components: sidecar and query

Event Timeline

fgiunchedi created this task.Jul 18 2019, 8:36 AM

Restricted Application added a subscriber: Aklapper. · View Herald TranscriptJul 18 2019, 8:36 AM

fgiunchedi moved this task from Backlog to Doing on the User-fgiunchedi board.Jul 18 2019, 10:45 AM

fgiunchedi moved this task from Inbox to In progress on the observability board.Jul 22 2019, 3:14 PM

MoritzMuehlenhoff subscribed.Jul 22 2019, 4:18 PM

fgiunchedi mentioned this in T89857: scale statsd reporting/aggregation (plan).Aug 13 2019, 1:07 PM

fgiunchedi mentioned this in T85451: scale graphite deployment (tracking).

fgiunchedi mentioned this in T99125: Add role for StatsD and Graphite.

fgiunchedi added a subtask: T205870: Fully migrate producers off statsd.Aug 13 2019, 1:12 PM

Other Graphite producers found while auditing metrics changed in the last 7d

cassandra (from maps)
analytics.mw_api.varnish_requests (from analytics refinery job)
coal
librenms
daily from https://github.com/wikimedia/analytics-wmde-scripts and possibly others
"reportupdater-queries" https://github.com/wikimedia/analytics-reportupdater-queries

fgiunchedi moved this task from Doing to Up next on the User-fgiunchedi board.Oct 18 2019, 1:40 PM

colewhite mentioned this in T240685: MediaWiki Prometheus support.Dec 13 2019, 3:40 PM

lmata subscribed.Jun 18 2020, 3:11 PM

fgiunchedi closed subtask T233956: Deploy Thanos (long-term storage) stateless components: sidecar and query as Resolved.Jul 8 2020, 8:44 AM

fgiunchedi moved this task from In progress to Backlog on the observability board.Jan 20 2021, 3:44 PM

lmata edited projects, added SRE Observability; removed observability.Jul 12 2021, 2:21 AM

lmata moved this task from Inbox to Backlog on the SRE Observability board.Jul 15 2021, 4:09 AM

lmata renamed this task from Tech debt: sunsetting of Graphite (part 1) (Q1 goal FY19-20) to Tech debt: sunsetting of Graphite (part 1) .Aug 9 2021, 1:14 AM

lmata edited projects, added SRE Observability (FY2021/2022-Q1); removed SRE Observability, Goal.

fgiunchedi moved this task from Up next to Backlog on the User-fgiunchedi board.Sep 13 2021, 12:19 PM

colewhite edited projects, added SRE Observability (FY2021/2022-Q2); removed SRE Observability (FY2021/2022-Q1).Oct 1 2021, 12:20 AM

lmata triaged this task as Medium priority.Nov 16 2021, 4:44 PM

lmata moved this task from FY2021/2022-Q2 to FY2021/2022-Q3 on the SRE Observability board.Jan 13 2022, 2:02 PM

lmata edited projects, added SRE Observability (FY2021/2022-Q3); removed SRE Observability (FY2021/2022-Q2).

lmata edited projects, added SRE Observability (FY2021/2022-Q4); removed SRE Observability (FY2021/2022-Q3).Apr 11 2022, 1:15 PM

fgiunchedi edited projects, added SRE Observability (FY2022/2023-Q1); removed SRE Observability (FY2021/2022-Q4).Jul 1 2022, 8:17 AM

lmata edited projects, added Observability-Metrics; removed SRE Observability (FY2022/2023-Q1).Sep 13 2022, 1:29 AM

lmata moved this task from Inbox to Prioritized on the Observability-Metrics board.

fgiunchedi removed a project: User-fgiunchedi.Nov 25 2022, 8:46 AM