Make the orchestrator react appropriately when the evaluator fails to acquire WASI runners
Closed, ResolvedPublic
Actions

Assigned To

Authored By

	cmassaro
	Oct 30 2025, 4:22 PM

Description

Desired behavior/Acceptance criteria (returned value, expected error, performance expectations, etc.)

there is a test exercising this case
the orchestrator returns agreed-upon Z500 and/or HTTP status code in this case

Completion checklist

Before closing this task, review one by one the checklist available here: https://www.mediawiki.org/wiki/Abstract_Wikipedia_team/Definition_of_Done#Back-end_Task/Bug_completion_checklist

Related Objects
Search...

Status	Subtype	Assigned	Task
Open	BUG REPORT	None	T406848 wide-scale Python failure
Resolved		cmassaro	T408823 Fail Early if Evaluator Can't Acquire a WASI Runner
Resolved		cmassaro	T409071 When evaluator fails due to WASI unavailability, consider queuing the runner back to the executor pool
Resolved		cmassaro	T408826 Make the evaluator fail early and respond with the appropriate Z500 and HTTP status code when WASI runners are unavailable
Resolved		cmassaro	T408825 Make the orchestrator react appropriately when the evaluator fails to acquire WASI runners

Event Timeline

cmassaro created this task.Oct 30 2025, 4:22 PM

cmassaro added a subtask: T408824: Allocate new Z500 and HTTP error codes for failure to acquire a WASI runner.

cmassaro added a parent task: T408826: Make the evaluator fail early and respond with the appropriate Z500 and HTTP status code when WASI runners are unavailable.Oct 30 2025, 4:25 PM

cmassaro claimed this task.Oct 30 2025, 8:39 PM

cmassaro edited projects, added Abstract Wikipedia team (26Q2 (Oct–Dec)); removed Abstract Wikipedia team.Nov 1 2025, 1:46 AM

cmassaro moved this task from Incoming to Ready to deploy on the Abstract Wikipedia team (26Q2 (Oct–Dec)) board.

cmassaro removed a subtask: T408824: Allocate new Z500 and HTTP error codes for failure to acquire a WASI runner.

Please confirm if this is now fixed.

Jdforrester-WMF renamed this task from Orchestrator reacts appropriately when the evaluator fails to acquire WASI runners to Make the orchestrator react appropriately when the evaluator fails to acquire WASI runners.Nov 5 2025, 6:45 PM

Jdforrester-WMF added a project: Essential-Work.Nov 6 2025, 5:14 PM

cmassaro moved this task from Needs Sign-off to Ready to deploy on the Abstract Wikipedia team (26Q2 (Oct–Dec)) board.Sat, Nov 8, 10:10 PM

DSantamaria changed the task status from Open to In Progress.Wed, Nov 12, 6:59 AM

Jdforrester-WMF moved this task from Ready to deploy to Needs Sign-off on the Abstract Wikipedia team (26Q2 (Oct–Dec)) board.Thu, Nov 20, 5:32 PM

Jdforrester-WMF closed this task as Resolved.Thu, Nov 20, 8:56 PM