Maniphest T399344

Rust-based evaluator is at feature parity with the current Node-based one
Closed, ResolvedPublic
Actions

Assigned To

Authored By

	cmassaro
	Jul 11 2025, 10:29 PM

Tags

Referenced Files

None

Subscribers

Jdforrester-WMF

Description

Description

Desired behavior/Acceptance criteria (returned value, expected error, performance expectations, etc.)

in local testing with docker-compose, everything that works in the Node evaluator works in the Rust evaluator
(optional) instead of an omnibus Rust evaluator, there are two separate ones, as we have for Node

Completion checklist

Before closing this task, review one by one the checklist available here: https://www.mediawiki.org/wiki/Abstract_Wikipedia_team/Definition_of_Done#Back-end_Task/Bug_completion_checklist

Related Objects
Search...

		Status	Subtype	Assigned	Task
		Open		Jdforrester-WMF	T402957 [26Q2] Rust evaluator in production
		Open		None	T382433 Get the Rust prototype of the function-evaluator's executors into a state where it could be deployed
		In Progress		cmassaro	T343720 If we create a working evaluator service in Rust, we can measure its performance and stability characteristics and plan to productionize it in a subsequent quarter
		Resolved		cmassaro	T399344 Rust-based evaluator is at feature parity with the current Node-based one
		Resolved		cmassaro	T399322 Rust-based evaluator service should maintain a pool of ready executors
		Resolved		cmassaro	T399323 Rust-based evaluator can add all currently-supported metadata
		Resolved		ecarg	T399345 Rust-based evaluator implements a timeout
		Resolved		ecarg	T407590 Check that timeout is working properly
		Resolved		ecarg	T399346 Rust-based evaluator implements rate limiting
		Resolved		cmassaro	T399321 Rust-based evaluator service can run a function call in the appropriate executor and return a result
		Resolved		cmassaro	T400820 Use dedicated abstract-wikipeda-rust image in test-rust (and, eventually, other Rust images)
		Open		None	T407588 Create a fail-fast for rate-limiting

Event Timeline

cmassaro created this task.Jul 11 2025, 10:29 PM

cmassaro added subtasks: T399321: Rust-based evaluator service can run a function call in the appropriate executor and return a result, T399322: Rust-based evaluator service should maintain a pool of ready executors, T399323: Rust-based evaluator can add all currently-supported metadata.

cmassaro added subtasks: T399345: Rust-based evaluator implements a timeout, T399346: Rust-based evaluator implements rate limiting.Jul 11 2025, 10:35 PM

cmassaro added a parent task: T343720: If we create a working evaluator service in Rust, we can measure its performance and stability characteristics and plan to productionize it in a subsequent quarter.

DSantamaria triaged this task as Medium priority.Jul 16 2025, 2:15 PM

DSantamaria edited projects, added Abstract Wikipedia team (26Q1 (Jul–Sep)); removed Abstract Wikipedia team.

DSantamaria added a project: Essential-Work.

DSantamaria moved this task from Incoming to Ready on the Abstract Wikipedia team (26Q1 (Jul–Sep)) board.

DSantamaria changed the status of subtask T399322: Rust-based evaluator service should maintain a pool of ready executors from Open to In Progress.Aug 22 2025, 2:15 PM

cmassaro changed the status of subtask T399321: Rust-based evaluator service can run a function call in the appropriate executor and return a result from Open to In Progress.Aug 26 2025, 10:11 PM

cmassaro closed subtask T399321: Rust-based evaluator service can run a function call in the appropriate executor and return a result as Resolved.Aug 27 2025, 3:48 PM

cmassaro updated the task description. (Show Details)Aug 29 2025, 11:12 PM

Jdforrester-WMF closed subtask T399345: Rust-based evaluator implements a timeout as Resolved.Sep 2 2025, 3:29 PM

Jdforrester-WMF reopened subtask T399345: Rust-based evaluator implements a timeout as In Progress.

cmassaro added a subtask: T403669: Rust evaluator messaging protocol should handle arbitrary buffer sizes.Sep 3 2025, 8:56 PM

Jdforrester-WMF changed the status of subtask T403669: Rust evaluator messaging protocol should handle arbitrary buffer sizes from Open to In Progress.Sep 10 2025, 3:33 PM

ecarg changed the status of subtask T399346: Rust-based evaluator implements rate limiting from Open to In Progress.Sep 12 2025, 4:41 PM

cmassaro changed the status of subtask T399323: Rust-based evaluator can add all currently-supported metadata from Open to In Progress.Sep 13 2025, 8:26 PM

cmassaro closed subtask T399322: Rust-based evaluator service should maintain a pool of ready executors as Resolved.Sep 16 2025, 1:45 PM

Jdforrester-WMF removed a subtask: T403669: Rust evaluator messaging protocol should handle arbitrary buffer sizes.Sep 23 2025, 4:00 PM

Jdforrester-WMF closed subtask T399323: Rust-based evaluator can add all currently-supported metadata as Resolved.Sep 25 2025, 4:53 PM

All sub-tasks Resolved or in Needs Sign-off.

Jdforrester-WMF changed the task status from Open to In Progress.Oct 1 2025, 8:52 PM

Jdforrester-WMF assigned this task to cmassaro.

Jdforrester-WMF closed this task as Resolved.Oct 2 2025, 4:27 PM

Jdforrester-WMF closed subtask T399346: Rust-based evaluator implements rate limiting as Resolved.

Jdforrester-WMF closed subtask T399345: Rust-based evaluator implements a timeout as Resolved.