Page MenuHomePhabricator
Create Task
Maniphest T421849

[Hypothesis] WE2.3.16 Productionize Rust Evaluator and Deprecate Node Evaluator
Open, HighPublic
Actions

Description

If the Rust evaluator is brought to feature parity with the Node evaluator and the Node evaluator phased out, we will eliminate a huge maintenance burden and free up engineering resources.

Related Objects
Search...

StatusSubtypeAssignedTask
 OpenNoneT421849 [Hypothesis] WE2.3.16 Productionize Rust Evaluator and Deprecate Node Evaluator
 ResolvedJdforrester-WMFT404014 [Q3 Rust Integration] Ensure that Rust evaluator meets resource and performance requirements
 ResolvedcmassaroT404905 [Rust Q3] Avoid reading .wasm binaries in async tasks
 ResolvedcmassaroT403669 Rust evaluator messaging protocol should handle arbitrary buffer sizes
 ResolvedcmassaroT405130 Abandon Avro serialization; use the raw JSON request format and, optionally, compression
 ResolvedecargT416143 Measure performance and resource consumption of Rust evaluator
 ResolvedJdforrester-WMFT382433 Get the Rust prototype of the function-evaluator's executors into a state where it could be deployed
 ResolvedJdforrester-WMFT343720 If we create a working evaluator service in Rust, we can measure its performance and stability characteristics and plan to productionize it in a subsequent quarter
 ResolvedcmassaroT399344 Rust-based evaluator is at feature parity with the current Node-based one
 ResolvedcmassaroT399322 Rust-based evaluator service should maintain a pool of ready executors
 ResolvedcmassaroT399323 Rust-based evaluator can add all currently-supported metadata
 ResolvedecargT399345 Rust-based evaluator implements a timeout
 ResolvedecargT399346 Rust-based evaluator implements rate limiting
 ResolvedcmassaroT399321 Rust-based evaluator service can run a function call in the appropriate executor and return a result
 ResolvedcmassaroT400820 Use dedicated abstract-wikipeda-rust image in test-rust (and, eventually, other Rust images)
 DeclinedNoneT402478 Rectify double/long issue with remainingTime in different Avro schemata
 ResolvedcmassaroT402477 Support Avro schema semver 2.0.0 and move each Avro schema to a separate Rust module
 ResolvedcmassaroT402473 Improve testing of Rust Avro deserialization
 ResolvedcmassaroT399320 Rust-based service should accept all current versions of the evaluator request format
 ResolvedcmassaroT406625 Create and use a shared set of fully-expanded Z7s for testing the evaluators, so we can assert stable performance and equivalence between Rust and non-Rust evaluators
 ResolvedJdforrester-WMFT417164 Respect WASM-related env variables in Rust evaluator
 ResolvedecargT417712 Migrate relevant service-utils code to Rust.
 ResolvedecargT420499 add metrics to Rust evaluator
 ResolvedecargT420276 dependency-inject logging instance and test request-id
 ResolvedecargT420275 add logging to rust evaluator
 OpenNoneT420426 separate out observability for rust services
 In ProgressJdforrester-WMFT417870 Specify Rust and Node versions of the evaluators in prod and staging configs
 ResolvedJdforrester-WMFT402957 [26Q3] Rust evaluator in production
 ResolvedJdforrester-WMFT405315 Add wasmedge-related metadata to Rust evaluator
 InvalidecargT382045 [RUST STUFF]: Make executor_classes a non-public module
 ResolvedJdforrester-WMFT402956 Build the JS executor when compiling the Rust image rather than relying on the checked-in blob
 ResolvedcmassaroT406181 Create tests to better demonstrate timeout behaviour in the Rust-based evaluator
 ResolvedJdforrester-WMFT407588 Create a fail-fast for rate-limiting
 ResolvedecargT407590 Check that timeout is working properly
 ResolvedcmassaroT409592 Re-enable Rust tests
 ResolvedcmassaroT388981 In our Rust POC of the function-evaluator, switch from wasi-common to wasmtime-wasi and upgrade wasmtime to 21.0.2+ (or replace)
 ResolvedcmassaroT417761 Publish JS and Python flavors of the Rust evaluator
 ResolvedcmassaroT421006 Rate limiting fires unconditionally
 ResolvedcmassaroT421008 Rust executors work in isolation but not within the evaluator service
 In ProgressecargT423627 create new k8s service for (testing) Rust Evaluator
 ResolvedJdforrester-WMFT415630 Improve timeout guarantees in Rust evaluator
 OpenNoneT423369 [Rust] Add OpenTelemetry trace export to /observability
 ResolvedecargT423375 [Rust] Add Prometheus metrics server on dedicated port (9090)

Event Timeline

DSantamaria created this task.Mar 31 2026, 9:12 AM
Restricted Application added a subscriber: Aklapper. · View Herald TranscriptMar 31 2026, 9:12 AM
DSantamaria triaged this task as High priority.Mar 31 2026, 9:12 AM
DSantamaria renamed this task from [Hypothesis] WE2.3.16 Deprecate Node Evaluator to [Hypothesis] WE2.3.16 Productionize Rust Evaluator and Deprecate Node Evaluator.Mar 31 2026, 7:14 PM
DSantamaria added a subtask: T404014: [Q3 Rust Integration] Ensure that Rust evaluator meets resource and performance requirements.Apr 1 2026, 8:35 AM
DSantamaria added a subtask: T382433: Get the Rust prototype of the function-evaluator's executors into a state where it could be deployed.Apr 1 2026, 8:39 AM
DSantamaria added a subtask: T417164: Respect WASM-related env variables in Rust evaluator.Apr 1 2026, 8:41 AM
DSantamaria added a subtask: T417712: Migrate relevant service-utils code to Rust..Apr 7 2026, 1:18 PM
Jdforrester-WMF merged a task: T419534: [26Q4] Deprecate Node Evaluator.Apr 8 2026, 5:20 PM
Jdforrester-WMF added a subscriber: cmassaro.
ecarg closed subtask T417712: Migrate relevant service-utils code to Rust. as Resolved.Apr 9 2026, 9:06 PM
Jdforrester-WMF added a subtask: T420426: separate out observability for rust services.Apr 9 2026, 9:18 PM
Jdforrester-WMF closed subtask T382433: Get the Rust prototype of the function-evaluator's executors into a state where it could be deployed as Resolved.Apr 9 2026, 9:24 PM
Jdforrester-WMF changed the status of subtask T417164: Respect WASM-related env variables in Rust evaluator from Open to In Progress.Apr 9 2026, 10:35 PM
Jdforrester-WMF added a subtask: T417870: Specify Rust and Node versions of the evaluators in prod and staging configs.Apr 9 2026, 10:42 PM
Jdforrester-WMF closed subtask T417164: Respect WASM-related env variables in Rust evaluator as Resolved.Fri, Apr 10, 10:26 PM
DSantamaria added a subtask: T415630: Improve timeout guarantees in Rust evaluator.Tue, Apr 14, 2:54 PM
ecarg created subtask T423369: [Rust] Add OpenTelemetry trace export to /observability.Wed, Apr 15, 6:02 AM
ecarg created subtask T423375: [Rust] Add Prometheus metrics server on dedicated port (9090).Wed, Apr 15, 7:12 AM
Jdforrester-WMF changed the status of subtask T423375: [Rust] Add Prometheus metrics server on dedicated port (9090) from Open to In Progress.Wed, Apr 15, 2:10 PM
Jdforrester-WMF closed subtask T404014: [Q3 Rust Integration] Ensure that Rust evaluator meets resource and performance requirements as Resolved.Wed, Apr 15, 11:18 PM
ecarg created subtask T423627: create new k8s service for (testing) Rust Evaluator.Thu, Apr 16, 4:23 PM
Jdforrester-WMF removed a subtask: T423627: create new k8s service for (testing) Rust Evaluator.Thu, Apr 16, 5:48 PM
ecarg closed subtask T423375: [Rust] Add Prometheus metrics server on dedicated port (9090) as Resolved.Fri, Apr 17, 4:27 PM
Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL · Credits