Maniphest T421848

[Hypothesis] WE2.3.15 Complete implementation and deployment of Evaluator-Orchestrator callbacks
Open, In Progress, HighPublic
Actions

Assigned To

Authored By

	DSantamaria
	Mar 31 2026, 9:10 AM

Project Tags

Referenced Files

None

Subscribers

Description

If we complete the implementation and deployment of Evaluator-Orchestrator callbacks, it will be possible to increase reliance on evaluated implementations, thereby leveraging the most performant part of the backend.

This is the continuation of the work begun in T412952.

Related Objects
Search...

		Status	Subtype	Assigned	Task
		Open		None	T359566 Support Evaluator-Orchestrator callbacks
		In Progress		DMartin-WMF	T421848 [Hypothesis] WE2.3.15 Complete implementation and deployment of Evaluator-Orchestrator callbacks
		Resolved		DMartin-WMF	T415480 Implement Orchestrator functionality for Evaluator-Orchestrator Callbacks
		Resolved		DMartin-WMF	T413847 Implement Evaluator functionality for Evaluator-Orchestrator Callbacks
		Open		DMartin-WMF	T415616 Callbacks: Provide documentation, demonstrations, and publicity
		Resolved		DMartin-WMF	T427863 Service mesh configuration and network policies for evaluator-orchestrator callbacks
		Resolved	Security	RLazarus	T427864 Evaluator outgoing network access to DNS
		Duplicate		cmassaro	T428011 Implement Rust evaluator functionality for evaluator-orchestrator callbacks
		In Progress		DMartin-WMF	T416144 Add support in the Rust evaluator for callbacks
		Resolved		DMartin-WMF	T430894 routes: De-duplicate code in callback.js and evaluate-transpiled.js
					Restricted Task

Event Timeline

DSantamaria created this task.Mar 31 2026, 9:10 AM

Restricted Application added a subscriber: Aklapper. · View Herald TranscriptMar 31 2026, 9:10 AM

DSantamaria triaged this task as High priority.Mar 31 2026, 9:10 AM

DSantamaria assigned this task to DMartin-WMF.Mar 31 2026, 3:09 PM

DSantamaria moved this task from 26Q4 (Apr–Jun) to Next on the Abstract Wikipedia team board.Mar 31 2026, 4:59 PM

DSantamaria edited projects, added: Abstract Wikipedia team; removed: Abstract Wikipedia team (26Q4 (Apr–Jun)).

DMartin-WMF mentioned this in T321866: Support Evaluator-Orchestrator Callbacks in Wikifunctions Backend Components.Apr 10 2026, 5:29 AM

DMartin-WMF mentioned this in T412952: Increase capabilities and usage of evaluated implementations to improve performance.Apr 10 2026, 5:40 AM

DMartin-WMF added a subtask: T415480: Implement Orchestrator functionality for Evaluator-Orchestrator Callbacks.Apr 10 2026, 5:44 AM

DMartin-WMF added a subtask: T413847: Implement Evaluator functionality for Evaluator-Orchestrator Callbacks.

DMartin-WMF added a parent task: T359566: Support Evaluator-Orchestrator callbacks.Apr 10 2026, 5:46 AM

DMartin-WMF updated the task description. (Show Details)Apr 10 2026, 5:49 AM

DSantamaria changed the status of subtask T413847: Implement Evaluator functionality for Evaluator-Orchestrator Callbacks from In Progress to Open.Apr 13 2026, 3:48 PM

DSantamaria changed the status of subtask T415480: Implement Orchestrator functionality for Evaluator-Orchestrator Callbacks from In Progress to Open.

DMartin-WMF added a subtask: T415616: Callbacks: Provide documentation, demonstrations, and publicity.Apr 15 2026, 1:47 AM

Jdforrester-WMF changed the status of subtask T413847: Implement Evaluator functionality for Evaluator-Orchestrator Callbacks from Open to In Progress.Apr 16 2026, 2:35 PM

Jdforrester-WMF changed the status of subtask T415480: Implement Orchestrator functionality for Evaluator-Orchestrator Callbacks from Open to In Progress.

Jdforrester-WMF moved this task from Next to 26Q4 (Apr–Jun) on the Abstract Wikipedia team board.May 20 2026, 5:15 PM

Jdforrester-WMF edited projects, added: Abstract Wikipedia team (26Q4 (Apr–Jun)); removed: Abstract Wikipedia team.

RLazarus created subtask T427863: Service mesh configuration and network policies for evaluator-orchestrator callbacks.Jun 1 2026, 11:25 PM

RLazarus changed the status of subtask T427863: Service mesh configuration and network policies for evaluator-orchestrator callbacks from Open to In Progress.

RLazarus mentioned this in T427864: Evaluator outgoing network access to DNS.Jun 1 2026, 11:29 PM

cmassaro added a subtask: T428011: Implement Rust evaluator functionality for evaluator-orchestrator callbacks.Jun 2 2026, 10:46 PM

Jdforrester-WMF added a subtask: T416144: Add support in the Rust evaluator for callbacks.Jun 3 2026, 7:57 PM

DMartin-WMF changed the status of subtask T416144: Add support in the Rust evaluator for callbacks from Open to In Progress.Jun 4 2026, 12:18 AM

Jdforrester-WMF edited projects, added: Abstract Wikipedia team (27Q1 (Jul–Sep)); removed: Abstract Wikipedia team (26Q4 (Apr–Jun)), Epic.Jul 1 2026, 5:12 PM

Jdforrester-WMF moved this task from Incoming to In Engineering on the Abstract Wikipedia team (27Q1 (Jul–Sep)) board.

DSantamaria changed the task status from Open to In Progress.Jul 15 2026, 6:22 AM

Jdforrester-WMF added a subtask: T430894: routes: De-duplicate code in callback.js and evaluate-transpiled.js.Jul 15 2026, 9:41 AM

Jdforrester-WMF changed the status of subtask T430894: routes: De-duplicate code in callback.js and evaluate-transpiled.js from In Progress to Open.Jul 16 2026, 7:48 AM

DSantamaria added a project: Epic.Jul 16 2026, 3:44 PM

DSantamaria moved this task from In Engineering to Epics for this Quarter on the Abstract Wikipedia team (27Q1 (Jul–Sep)) board.

DMartin-WMF changed the status of subtask T430894: routes: De-duplicate code in callback.js and evaluate-transpiled.js from Open to In Progress.Tue, Aug 4, 6:40 AM

Jdforrester-WMF closed subtask T430894: routes: De-duplicate code in callback.js and evaluate-transpiled.js as Resolved.Wed, Aug 5, 2:25 PM

Jdforrester-WMF closed subtask T427863: Service mesh configuration and network policies for evaluator-orchestrator callbacks as Resolved.Wed, Aug 5, 2:45 PM

Jdforrester-WMF closed subtask T415480: Implement Orchestrator functionality for Evaluator-Orchestrator Callbacks as Resolved.Wed, Aug 5, 3:47 PM

Jdforrester-WMF closed subtask T413847: Implement Evaluator functionality for Evaluator-Orchestrator Callbacks as Resolved.

DMartin-WMF added a subtask: Restricted Task.Thu, Aug 6, 4:41 PM