Page MenuHomePhabricator

Tech debt: sunsetting of Graphite
Open, MediumPublic

Description

This task tracks the Graphite deprecation.

Sunsetting Graphite ensures we stay ahead with a supported, scalable metrics platform for more effective long-term, multidimensional metrics analysis and storage.

Wikitech: Graphite deprecation roadmap

Context: The SRE Observability team has been using Prometheus as its preferred metrics storage in production for several years. Prometheus offers key benefits over Graphite and a more modern ecosystem. The Prometheus stack provides more robust data labeling, storage, and query capabilities. This effort facilitates the improvement of our production metrics infrastructure and the deprecation of older systems.

The thought process behind the deprecation is outlined in T249164: RFC: Better interface for generating metrics in MediaWiki.

In this context we distinguish graphite as used by statsd (i.e. metrics are emitted via statsd over udp and the turned to graphite writes) which is tracked by T205870 and using graphite protocol directly (i.e. the application natively talks the graphite protocol, as opposed to statsd).

Migrate MediaWiki off Graphite
Migrate other graphite protocol users
Graphite Technical Deprecation

Related Objects

StatusSubtypeAssignedTask
OpenNone
OpenNone
Resolvedcolewhite
Resolved ACraze
Declinedcolewhite
Resolvedcolewhite
Resolvedcolewhite
ResolvedKrinkle
ResolvedKrinkle
ResolvedKrinkle
Resolvedherron
OpenNone
Resolved Pchelolo
Resolvedcolewhite
ResolvedJgiannelos
OpenNone
DeclinedNone
ResolvedPeter
ResolvedKrinkle
OpenNone
OpenNone
OpenPeter
OpenNone
OpenNone
OpenNone
Resolvedfgiunchedi
OpenNone
OpenNone
OpenNone
OpenNone
OpenNone

Event Timeline

Other Graphite producers found while auditing metrics changed in the last 7d

lmata renamed this task from Tech debt: sunsetting of Graphite (part 1) (Q1 goal FY19-20) to Tech debt: sunsetting of Graphite (part 1) .Aug 9 2021, 1:14 AM
lmata triaged this task as Medium priority.Nov 16 2021, 4:44 PM
fgiunchedi renamed this task from Tech debt: sunsetting of Graphite (part 1) to Tech debt: sunsetting of Graphite.May 20 2024, 1:31 PM
fgiunchedi updated the task description. (Show Details)
lmata updated the task description. (Show Details)

Hi @lmata and @fgiunchedi I wanted to check where we are with the sunsetting of Graphite, is the plan early 2025 or late 2025? I'm thinking about the performance data that we still have in Graphite. I wanted to check how much blocker that part is and how it can be fixed so you can do the move?

Before the performance team was closed down we moved many metrics to Prometheus but it's not as battle tested and iterated as the metrics in Graphite and I guess we don't have a team that is responsible for it.

Hi @Peter I'll reach out, we're in the final stages of getting the notices ready and posted, so I'll provide a preview so you dont have to wait.