Maniphest T399322

Rust-based evaluator service should maintain a pool of ready executors
Closed, ResolvedPublic
Actions

Assigned To

Authored By

	cmassaro
	Jul 11 2025, 4:01 PM

Tags

Referenced Files

None

Subscribers

Description

Description

Desired behavior/Acceptance criteria (returned value, expected error, performance expectations, etc.)

multiple function execution requests can be run concurrently
- in separate threads
function execution requests do not incur WASI startup time
- there is a test enshrining this
function execution time should be less than in the current evaluator
- there is a test enshrining this

Completion checklist

Before closing this task, review one by one the checklist available here: https://www.mediawiki.org/wiki/Abstract_Wikipedia_team/Definition_of_Done#Back-end_Task/Bug_completion_checklist

Details

Related Changes in Gerrit:

	Subject	Repo	Branch	Lines +/-
	wikifunctions: Upgrade evaluators from 2025-08-26-213211 to 2025-09-03-123051	operations/deployment-charts	master	+2 -2

Customize query in gerrit

Related Changes in GitLab:

	Title	Reference	Author	Source Branch	Dest Branch
	Run executors in a pool via shared Axum state; run evaluation as async task.	repos/abstract-wiki/wikifunctions/function-evaluator!390	apine	apine-threads	main
	Remove axum-test and rely on tower for testing.	repos/abstract-wiki/wikifunctions/function-evaluator!388	apine	apine-tower	main
	Replace ExecutorWasiBuilder trait with functions.	repos/abstract-wiki/wikifunctions/function-evaluator!387	apine	apine-no-generics	main

Customize query in GitLab

Related Objects
Search...

		Status	Subtype	Assigned	Task
		Open		Jdforrester-WMF	T402957 [26Q2] Rust evaluator in production
		Open		None	T382433 Get the Rust prototype of the function-evaluator's executors into a state where it could be deployed
		In Progress		cmassaro	T343720 If we create a working evaluator service in Rust, we can measure its performance and stability characteristics and plan to productionize it in a subsequent quarter
		Resolved		cmassaro	T399344 Rust-based evaluator is at feature parity with the current Node-based one
		Resolved		cmassaro	T399322 Rust-based evaluator service should maintain a pool of ready executors
		Resolved		cmassaro	T399321 Rust-based evaluator service can run a function call in the appropriate executor and return a result
		Resolved		cmassaro	T400820 Use dedicated abstract-wikipeda-rust image in test-rust (and, eventually, other Rust images)

Event Timeline

cmassaro created this task.Jul 11 2025, 4:01 PM

cmassaro added a subtask: T399320: Rust-based service should accept all current versions of the evaluator request format.

cmassaro added a parent task: T399344: Rust-based evaluator is at feature parity with the current Node-based one.Jul 11 2025, 10:30 PM

cmassaro removed a subtask: T399320: Rust-based service should accept all current versions of the evaluator request format.

cmassaro added a subtask: T399321: Rust-based evaluator service can run a function call in the appropriate executor and return a result.Jul 11 2025, 10:37 PM

DSantamaria triaged this task as Medium priority.Jul 16 2025, 2:15 PM

DSantamaria edited projects, added Abstract Wikipedia team (26Q1 (Jul–Sep)), Essential-Work; removed Abstract Wikipedia team.

DSantamaria moved this task from Incoming to Ready on the Abstract Wikipedia team (26Q1 (Jul–Sep)) board.

cmassaro claimed this task.Aug 21 2025, 5:04 PM

cmassaro moved this task from Ready to In Engineering on the Abstract Wikipedia team (26Q1 (Jul–Sep)) board.

DSantamaria changed the task status from Open to In Progress.Aug 22 2025, 2:15 PM

cmassaro changed the status of subtask T399321: Rust-based evaluator service can run a function call in the appropriate executor and return a result from Open to In Progress.Aug 26 2025, 10:11 PM

cmassaro closed subtask T399321: Rust-based evaluator service can run a function call in the appropriate executor and return a result as Resolved.Aug 27 2025, 3:48 PM

apine opened https://gitlab.wikimedia.org/repos/abstract-wiki/wikifunctions/function-evaluator/-/merge_requests/387

Replace ExecutorWasiBuilder trait with functions.

apine opened https://gitlab.wikimedia.org/repos/abstract-wiki/wikifunctions/function-evaluator/-/merge_requests/388

Remove axum-test and rely on tower for testing.

apine closed https://gitlab.wikimedia.org/repos/abstract-wiki/wikifunctions/function-evaluator/-/merge_requests/388

Remove axum-test and rely on tower for testing.

cmassaro updated the task description. (Show Details)Aug 29 2025, 10:55 PM

apine opened https://gitlab.wikimedia.org/repos/abstract-wiki/wikifunctions/function-evaluator/-/merge_requests/390

Run executors in a pool via shared Axum state; run evaluation as async task.

ecarg merged https://gitlab.wikimedia.org/repos/abstract-wiki/wikifunctions/function-evaluator/-/merge_requests/387

Replace ExecutorWasiBuilder trait with functions.

cmassaro moved this task from In Engineering to In Code review on the Abstract Wikipedia team (26Q1 (Jul–Sep)) board.Sep 2 2025, 10:06 PM

jforrester merged https://gitlab.wikimedia.org/repos/abstract-wiki/wikifunctions/function-evaluator/-/merge_requests/390

Run executors in a pool via shared Axum state; run evaluation as async task.

Maintenance_bot removed a project: Patch-For-Review.Sep 3 2025, 12:31 PM

Change #1184517 had a related patch set uploaded (by Jforrester; author: Jforrester):

[operations/deployment-charts@master] wikifunctions: Upgrade evaluators from 2025-08-26-213211 to 2025-09-03-123051

https://gerrit.wikimedia.org/r/1184517

gerritbot added a project: Patch-For-Review.Sep 3 2025, 1:01 PM

Change #1184517 merged by jenkins-bot:

[operations/deployment-charts@master] wikifunctions: Upgrade evaluators from 2025-08-26-213211 to 2025-09-03-123051

https://gerrit.wikimedia.org/r/1184517

Maintenance_bot removed a project: Patch-For-Review.Sep 3 2025, 2:31 PM

cmassaro moved this task from In Code review to Ready to deploy on the Abstract Wikipedia team (26Q1 (Jul–Sep)) board.Sep 3 2025, 8:40 PM

Jdforrester-WMF moved this task from Ready to deploy to Needs Sign-off on the Abstract Wikipedia team (26Q1 (Jul–Sep)) board.Sep 5 2025, 2:50 PM

cmassaro closed this task as Resolved.Sep 16 2025, 1:45 PM

ecarg mentioned this in rMSFEeb99782dff56: Replace ExecutorWasiBuilder trait with functions..Oct 3 2025, 9:45 AM

Jdforrester-WMF mentioned this in rMSFEf16ad9b9c5c5: Run executors in a pool via shared Axum state; run evaluation as async task..Oct 3 2025, 9:45 AM