Define SLIs and SLOs for function-* services
Closed, ResolvedPublic
Actions

Description

Per the Wikimedia Services Policy, the function-{orchestrator,evaluator} services need to have SLIs and SLOs defined. These should be documented on Wikitech.

Once they are defined, we need to make sure the services expose the right set of metrics for measuring these SLIs; see T307700.

The Google SRE book has a useful chapter on this topic.

Related Objects

Mentioned In: T307700: Observability for function-* services
Mentioned Here: T307700: Observability for function-* services

Event Timeline

ori created this task.May 5 2022, 4:17 PM

ori updated the task description. (Show Details)May 5 2022, 4:20 PM

ori added projects: function-orchestrator, function-evaluator.

maryyang mentioned this in T307700: Observability for function-* services.May 5 2022, 8:01 PM

The bar for reliability and efficiency should be set by the primary use-case for Wikifunctions, which is (AIUI) to have functions that generate content fragments in Wikipedia articles.

To get a sense of what the expectations are, we can look to the design of the MediaWiki job queue and the support for Lua template modules.

ori added a project: 2022 Wikimedia Google.org Fellowship.May 6 2022, 12:41 AM

ori added a project: serviceops-radar.May 9 2022, 2:47 PM

Jdforrester-WMF moved this task from To triage to Phase θ – Throttling on the Abstract Wikipedia team board.May 17 2022, 6:37 PM

Jdforrester-WMF edited projects, added Abstract Wikipedia team (Phase θ – Throttling); removed Abstract Wikipedia team.

Jdforrester-WMF moved this task from Incoming to Ready: G2. Correct & efficient on the Abstract Wikipedia team (Phase θ – Throttling) board.