Page MenuHomePhabricator

Implement Python executor functionality for Evaluator-Orchestrator Callbacks
Open, In Progress, MediumPublic

Description

Description

Update the Python-specific executor code (in the Evaluator) to

  • Recognize callbacks in Python code blocks
  • Specify the callback function and arguments in a JSON object
  • Send the JSON object to the Evaluator
  • Receive the function-call result back from the Evaluator
  • Integrate that result into the rest of the Python code block evaluation
  • Handle serialization and deserialization as needed, when sending the request and receiving the result

Desired behavior/Acceptance criteria (returned value, expected error, performance expectations, etc.)

  • ...

Completion checklist

Event Timeline

DMartin-WMF renamed this task from Support Evaluator-Orchestrator Callbacks in Javascript implementations to Implement Python executor functionality for Evaluator-Orchestrator Callbacks.Jan 26 2026, 5:20 AM
DMartin-WMF claimed this task.
DMartin-WMF triaged this task as Medium priority.
DMartin-WMF changed the task status from Open to In Progress.Jan 26 2026, 5:45 AM