Page MenuHomePhabricator
Create Task
Maniphest T390548

Establish an SLO for the Wikifunctions integration into Wikimedia projects' wikitext pages, to assure reader experience quality is maintained during roll-out
Closed, ResolvedPublic
Actions

Description

Description

Establish an SLO for the Wikifunctions integration into Wikimedia projects' wikitext pages, to assure reader experience quality is maintained during roll-out

Acceptance criteria

  • Create an SLO with our working group
  • Execute on a prioritized plan for reaching the SLO

Goals and Success metrics

  • We are meeting our SLO as defined by the performance working group

Related Objects
Search...

StatusSubtypeAssignedTask
 ResolvedJdforrester-WMFT390543 If we establish and meet performance standards, we can have confidence that rolling out Wikifunctions access to more wikis will not disrupt those wikis' experiences or colleagues' work
 ResolvedecargT394057 Create new SLO dashboard via Pyrra for Wikifunctions
 ResolvedDSantamariaT390548 Establish an SLO for the Wikifunctions integration into Wikimedia projects' wikitext pages, to assure reader experience quality is maintained during roll-out
 ResolvedecargT391355 Add OpenTelemetry spans to our different methods inside the orchestrator so we can trace better where the timings get stuck
 ResolvedecargT390753 Work out why function-orchestrator's and function-evaluator's OTel telemetry isn't showing up
 ResolvedecargT393035 return 4/5xx HTTP status codes when valid
 ResolvedSpikeecargT393522 audit where we are or need to return 4-5xx's
 ResolvedecargT390632 adjust log levels for better filtering and organization
 ResolvedecargT393631 refactor remainder of logs to use appropriate sev levels
 ResolvedcscottT392118 Add metrics to track async content (Wikifunctions) SLO
 ResolvedJdforrester-WMFT394320 Add tracking for Wikifunctions SLO: Integration latency SLI, percentiles
 ResolvedJdforrester-WMFT394322 Add tracking for Wikifunctions SLO: Integration latency SLI, acceptable limit
 ResolvedJdforrester-WMFT394323 Add tracking for Wikifunctions SLO: Back-end API latency SLI, percentiles
 ResolvedJdforrester-WMFT394324 Add tracking for Wikifunctions SLO: Back-end API latency SLI, acceptable limit
 ResolvedJdforrester-WMFT394325 Add tracking for Wikifunctions SLO: Back-end API availability SLI
 ResolvedJdforrester-WMFT394326 Add tracking for Wikifunctions SLO: Back-end API combined latency-availability SLI
 ResolvedecargT394360 add new spans to our entrypoints
 ResolvedSpikeecargT392040 figure out what all to measure using OTel
 ResolvedecargT396167 use MW tracer instance to propagate headers for local testing

Event Timeline

Jdforrester-WMF created this task.Mar 31 2025, 1:45 PM
DSantamaria added a project: Workstreams.Apr 7 2025, 12:52 PM
DSantamaria claimed this task.Apr 8 2025, 5:54 PM
DSantamaria updated the task description. (Show Details)
DSantamaria moved this task from Incoming to Ready on the Abstract Wikipedia team (25Q4 (Apr–Jun)) board.
DSantamaria triaged this task as High priority.Apr 9 2025, 5:01 PM
DSantamaria added a subtask: T389675: gather performance numbers for the current state of our API.Apr 16 2025, 3:48 PM
DSantamaria added a subtask: T390753: Work out why function-orchestrator's and function-evaluator's OTel telemetry isn't showing up.Apr 16 2025, 4:23 PM
DSantamaria added a subtask: T391355: Add OpenTelemetry spans to our different methods inside the orchestrator so we can trace better where the timings get stuck.Apr 16 2025, 4:36 PM
ecarg added a subtask: T393035: return 4/5xx HTTP status codes when valid.Apr 30 2025, 5:26 PM
ecarg changed the status of subtask T393035: return 4/5xx HTTP status codes when valid from Open to In Progress.Apr 30 2025, 10:43 PM
ecarg added a subtask: T393522: audit where we are or need to return 4-5xx's.May 6 2025, 10:51 PM
Jdforrester-WMF changed the task status from Open to In Progress.May 7 2025, 3:52 PM
Jdforrester-WMF moved this task from Ready to In Engineering on the Abstract Wikipedia team (25Q4 (Apr–Jun)) board.
ecarg added a subtask: T390632: adjust log levels for better filtering and organization.May 7 2025, 5:57 PM
ecarg closed subtask T390632: adjust log levels for better filtering and organization as Resolved.
DSantamaria added a subtask: T392118: Add metrics to track async content (Wikifunctions) SLO.May 9 2025, 2:07 PM
ecarg added a subtask: T394360: add new spans to our entrypoints.May 14 2025, 10:41 PM
DSantamaria changed the status of subtask T389675: gather performance numbers for the current state of our API from Stalled to Open.May 15 2025, 5:48 PM
cscott closed subtask T392118: Add metrics to track async content (Wikifunctions) SLO as Resolved.May 21 2025, 5:31 PM
Jdforrester-WMF added a subtask: T394057: Create new SLO dashboard via Pyrra for Wikifunctions.May 27 2025, 6:39 PM
Jdforrester-WMF reopened subtask T392118: Add metrics to track async content (Wikifunctions) SLO as Open.May 27 2025, 6:46 PM
DSantamaria changed the status of subtask T392118: Add metrics to track async content (Wikifunctions) SLO from Open to In Progress.May 29 2025, 5:16 AM
ecarg closed subtask T393035: return 4/5xx HTTP status codes when valid as Resolved.May 31 2025, 9:30 PM
Jdforrester-WMF added a project: SRE-SLO.Jun 3 2025, 2:45 PM
Jdforrester-WMF changed the status of subtask T390753: Work out why function-orchestrator's and function-evaluator's OTel telemetry isn't showing up from Open to In Progress.Jun 5 2025, 12:31 PM
ecarg changed the status of subtask T394057: Create new SLO dashboard via Pyrra for Wikifunctions from Stalled to Open.Jun 5 2025, 3:31 PM
ecarg changed the status of subtask T393522: audit where we are or need to return 4-5xx's from Open to In Progress.Jun 5 2025, 11:53 PM
DSantamaria changed the status of subtask T393522: audit where we are or need to return 4-5xx's from In Progress to Open.Jun 6 2025, 9:31 AM
Jdforrester-WMF closed subtask T392118: Add metrics to track async content (Wikifunctions) SLO as Resolved.Jun 10 2025, 11:32 AM
ecarg closed subtask T390753: Work out why function-orchestrator's and function-evaluator's OTel telemetry isn't showing up as Resolved.Jun 10 2025, 8:46 PM
Jdforrester-WMF changed the status of subtask T394323: Add tracking for Wikifunctions SLO: Back-end API latency SLI, percentiles from Open to In Progress.Jun 11 2025, 11:41 AM
Jdforrester-WMF changed the status of subtask T394324: Add tracking for Wikifunctions SLO: Back-end API latency SLI, acceptable limit from Open to In Progress.
Jdforrester-WMF changed the status of subtask T394325: Add tracking for Wikifunctions SLO: Back-end API availability SLI from Open to In Progress.
Jdforrester-WMF changed the status of subtask T394326: Add tracking for Wikifunctions SLO: Back-end API combined latency-availability SLI from Open to In Progress.
Jdforrester-WMF changed the status of subtask T394320: Add tracking for Wikifunctions SLO: Integration latency SLI, percentiles from Open to In Progress.Jun 11 2025, 11:54 AM
Jdforrester-WMF changed the status of subtask T394322: Add tracking for Wikifunctions SLO: Integration latency SLI, acceptable limit from Open to In Progress.
CDanis reopened subtask T390753: Work out why function-orchestrator's and function-evaluator's OTel telemetry isn't showing up as Open.Jun 11 2025, 2:56 PM
DSantamaria changed the status of subtask T390753: Work out why function-orchestrator's and function-evaluator's OTel telemetry isn't showing up from Open to In Progress.Jun 11 2025, 3:33 PM
DSantamaria removed a subtask: T394057: Create new SLO dashboard via Pyrra for Wikifunctions.Jun 11 2025, 4:34 PM
DSantamaria removed a subtask: T389675: gather performance numbers for the current state of our API.Jun 11 2025, 4:36 PM
DSantamaria changed the status of subtask T393522: audit where we are or need to return 4-5xx's from Open to In Progress.Jun 11 2025, 4:39 PM
Jdforrester-WMF added a parent task: T394057: Create new SLO dashboard via Pyrra for Wikifunctions.Jun 11 2025, 4:58 PM
DSantamaria closed subtask T390753: Work out why function-orchestrator's and function-evaluator's OTel telemetry isn't showing up as Resolved.Jun 17 2025, 3:37 PM
ecarg closed subtask T394360: add new spans to our entrypoints as Resolved.Jun 20 2025, 2:23 AM
DSantamaria added a subtask: T396167: use MW tracer instance to propagate headers for local testing.Jun 20 2025, 6:01 AM
ecarg closed subtask T396167: use MW tracer instance to propagate headers for local testing as Resolved.Jun 20 2025, 9:10 AM
gengh closed subtask T391355: Add OpenTelemetry spans to our different methods inside the orchestrator so we can trace better where the timings get stuck as Resolved.Jun 25 2025, 2:32 PM
ecarg closed subtask T393522: audit where we are or need to return 4-5xx's as Resolved.Jul 8 2025, 6:29 PM
DSantamaria moved this task from In Engineering to Needs Sign-off on the Abstract Wikipedia team (25Q4 (Apr–Jun)) board.Jul 9 2025, 1:29 PM
Jdforrester-WMF closed this task as Resolved.Jul 22 2025, 1:17 PM
Jdforrester-WMF closed subtask T394323: Add tracking for Wikifunctions SLO: Back-end API latency SLI, percentiles as Resolved.
Jdforrester-WMF closed subtask T394324: Add tracking for Wikifunctions SLO: Back-end API latency SLI, acceptable limit as Resolved.
Jdforrester-WMF closed subtask T394326: Add tracking for Wikifunctions SLO: Back-end API combined latency-availability SLI as Resolved.
Jdforrester-WMF closed subtask T394325: Add tracking for Wikifunctions SLO: Back-end API availability SLI as Resolved.
Jdforrester-WMF closed subtask T394320: Add tracking for Wikifunctions SLO: Integration latency SLI, percentiles as Resolved.
Jdforrester-WMF closed subtask T394322: Add tracking for Wikifunctions SLO: Integration latency SLI, acceptable limit as Resolved.

We had an SLO meeting yesterday, and all of the work for last Quarter is now complete. Remaining issues to be tracked against the SLO work under PES.

Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL · Credits