Maniphest T399344

Rust-based evaluator is at feature parity with the current Node-based one
Closed, ResolvedPublic
Actions

Assigned To

Authored By

	cmassaro
	Jul 11 2025, 10:29 PM

Project Tags

Referenced Files

None

Subscribers

Jdforrester-WMF

Description

Description

Desired behavior/Acceptance criteria (returned value, expected error, performance expectations, etc.)

in local testing with docker-compose, everything that works in the Node evaluator works in the Rust evaluator
(optional) instead of an omnibus Rust evaluator, there are two separate ones, as we have for Node

Completion checklist

Before closing this task, review one by one the checklist available here: https://www.mediawiki.org/wiki/Abstract_Wikipedia_team/Definition_of_Done#Back-end_Task/Bug_completion_checklist

Details

Related Changes in Gerrit:

	Subject	Author	Repo	Branch	Lines +/-
	wikifunctions: Upgrade evaluators from 2026-03-10-214300 to 2026-03-16-124858	Jforrester	operations/deployment-charts	master	+2 -2

Customize query in gerrit

Related Changes in GitLab:

	Title	Reference	Author	Source Branch	Dest Branch
	Create better executor abstractions so Rust evaluator can be separated into multiple programming language variants.	repos/abstract-wiki/wikifunctions/function-evaluator!483	apine	apine-separate-images	main

Customize query in GitLab

Related Objects
Search...

		Status	Subtype	Assigned	Task
		Resolved		DSantamaria	T421849 [Hypothesis] WE2.3.16 Productionize Rust Evaluator and Deprecate Node Evaluator
		Resolved		Jdforrester-WMF	T382433 Get the Rust prototype of the function-evaluator's executors into a state where it could be deployed
		Resolved		Jdforrester-WMF	T343720 If we create a working evaluator service in Rust, we can measure its performance and stability characteristics and plan to productionize it in a subsequent quarter
		Resolved		cmassaro	T399344 Rust-based evaluator is at feature parity with the current Node-based one
		Resolved		cmassaro	T399322 Rust-based evaluator service should maintain a pool of ready executors
		Resolved		cmassaro	T399323 Rust-based evaluator can add all currently-supported metadata
		Resolved		ecarg	T399345 Rust-based evaluator implements a timeout
		Resolved		ecarg	T407590 Check that timeout is working properly
		Resolved		ecarg	T399346 Rust-based evaluator implements rate limiting
		Resolved		cmassaro	T399321 Rust-based evaluator service can run a function call in the appropriate executor and return a result
		Resolved		cmassaro	T400820 Use dedicated abstract-wikipeda-rust image in test-rust (and, eventually, other Rust images)
		Resolved		Jdforrester-WMF	T407588 Create a fail-fast for rate-limiting

Event Timeline

cmassaro created this task.Jul 11 2025, 10:29 PM

cmassaro added subtasks: T399321: Rust-based evaluator service can run a function call in the appropriate executor and return a result, T399322: Rust-based evaluator service should maintain a pool of ready executors, T399323: Rust-based evaluator can add all currently-supported metadata.

cmassaro added subtasks: T399345: Rust-based evaluator implements a timeout, T399346: Rust-based evaluator implements rate limiting.Jul 11 2025, 10:35 PM

cmassaro added a parent task: T343720: If we create a working evaluator service in Rust, we can measure its performance and stability characteristics and plan to productionize it in a subsequent quarter.

DSantamaria triaged this task as Medium priority.Jul 16 2025, 2:15 PM

DSantamaria edited projects, added: Abstract Wikipedia team (26Q1 (Jul–Sep)); removed: Abstract Wikipedia team.

DSantamaria added a project: Essential-Work.

DSantamaria moved this task from Incoming to Ready on the Abstract Wikipedia team (26Q1 (Jul–Sep)) board.

DSantamaria changed the status of subtask T399322: Rust-based evaluator service should maintain a pool of ready executors from Open to In Progress.Aug 22 2025, 2:15 PM

cmassaro changed the status of subtask T399321: Rust-based evaluator service can run a function call in the appropriate executor and return a result from Open to In Progress.Aug 26 2025, 10:11 PM

cmassaro closed subtask T399321: Rust-based evaluator service can run a function call in the appropriate executor and return a result as Resolved.Aug 27 2025, 3:48 PM

cmassaro updated the task description. (Show Details)Aug 29 2025, 11:12 PM

Jdforrester-WMF closed subtask T399345: Rust-based evaluator implements a timeout as Resolved.Sep 2 2025, 3:29 PM

Jdforrester-WMF reopened subtask T399345: Rust-based evaluator implements a timeout as In Progress.

cmassaro added a subtask: T403669: Rust evaluator messaging protocol should handle arbitrary buffer sizes.Sep 3 2025, 8:56 PM

Jdforrester-WMF changed the status of subtask T403669: Rust evaluator messaging protocol should handle arbitrary buffer sizes from Open to In Progress.Sep 10 2025, 3:33 PM

ecarg changed the status of subtask T399346: Rust-based evaluator implements rate limiting from Open to In Progress.Sep 12 2025, 4:41 PM

cmassaro changed the status of subtask T399323: Rust-based evaluator can add all currently-supported metadata from Open to In Progress.Sep 13 2025, 8:26 PM

cmassaro closed subtask T399322: Rust-based evaluator service should maintain a pool of ready executors as Resolved.Sep 16 2025, 1:45 PM

Jdforrester-WMF removed a subtask: T403669: Rust evaluator messaging protocol should handle arbitrary buffer sizes.Sep 23 2025, 4:00 PM

Jdforrester-WMF closed subtask T399323: Rust-based evaluator can add all currently-supported metadata as Resolved.Sep 25 2025, 4:53 PM

All sub-tasks Resolved or in Needs Sign-off.

Jdforrester-WMF changed the task status from Open to In Progress.Oct 1 2025, 8:52 PM

Jdforrester-WMF assigned this task to cmassaro.

Jdforrester-WMF closed this task as Resolved.Oct 2 2025, 4:27 PM

Jdforrester-WMF closed subtask T399346: Rust-based evaluator implements rate limiting as Resolved.

Jdforrester-WMF closed subtask T399345: Rust-based evaluator implements a timeout as Resolved.

apine opened https://gitlab.wikimedia.org/repos/abstract-wiki/wikifunctions/function-evaluator/-/merge_requests/483

Draft: Create better executor abstractions so Rust evaluator can be separated into multiple programming language variants.

Maintenance_bot edited projects, added: Abstract Wikipedia team; removed: Abstract Wikipedia team (26Q1 (Jul–Sep)).Mar 13 2026, 3:30 PM

jforrester merged https://gitlab.wikimedia.org/repos/abstract-wiki/wikifunctions/function-evaluator/-/merge_requests/483

Create better executor abstractions so Rust evaluator can be separated into multiple programming language variants.

Jdforrester-WMF mentioned this in rMSFEa4d2fcda85c6: Create better executor abstractions so Rust evaluator can be separated into….Mar 16 2026, 12:51 PM

Maintenance_bot removed a project: Patch-For-Review.Mar 16 2026, 1:33 PM

ecarg opened https://gitlab.wikimedia.org/repos/abstract-wiki/wikifunctions/function-evaluator/-/merge_requests/488

Draft: Resolve T420039 "Grace//add payload to failed requests"

Change #1254928 had a related patch set uploaded (by Jforrester; author: Jforrester):

[operations/deployment-charts@master] wikifunctions: Upgrade evaluators from 2026-03-10-214300 to 2026-03-16-124858

https://gerrit.wikimedia.org/r/1254928

Change #1254928 merged by jenkins-bot:

[operations/deployment-charts@master] wikifunctions: Upgrade evaluators from 2026-03-10-214300 to 2026-03-16-124858

https://gerrit.wikimedia.org/r/1254928

Jdforrester-WMF mentioned this in rMSFE963997cf11c9: docs: Track, update, or drop the inline TODOs that had no live task.Aug 7 2026, 3:42 PM

Jdforrester-WMF mentioned this in rMSFE0c830584f726: docs: Track, update, or drop the inline TODOs that had no live task.Aug 7 2026, 4:32 PM

cmassaro mentioned this in rMSFE75500f787ea0: docs: Track, update, or drop the inline TODOs that had no live task.Aug 7 2026, 7:48 PM