Page MenuHomePhabricator
Create Task
Maniphest T399320

Rust-based service should accept all current versions of the evaluator request format
Closed, ResolvedPublic
Actions

Description

Description

Only deserialization from the Avro binary format is needed at this time.

Desired behavior/Acceptance criteria (returned value, expected error, performance expectations, etc.)

  • extant versions of the evaluator request format can be deserialized from Avro binary format to JSON in Rust

Completion checklist

Details

Related Changes in Gerrit:
SubjectRepoBranchLines +/-
wikifunctions: Upgrade orchestrator from 2025-09-04-003606 to 2025-09-08-191243operations/deployment-chartsmaster+1 -1
wikifunctions: Upgrade evaluators from 2025-09-03-123051 to 2025-09-09-171717operations/deployment-chartsmaster+2 -2
Update function-schemata sub-module to HEAD (8893942)mediawiki/extensions/WikiLambdamaster+1 -1
wikifunctions: Upgrade orchestrator from 2025-08-20-210742 to 2025-08-25-145906operations/deployment-chartsmaster+1 -1
wikifunctions: Upgrade evaluators from 2025-08-20-203801 to 2025-08-26-213211operations/deployment-chartsmaster+2 -2
Update function-schemata sub-module to HEAD (4df73e6)mediawiki/extensions/WikiLambdamaster+1 -1
Customize query in gerrit
Related Changes in GitLab:
TitleReferenceAuthorSource BranchDest Branch
Update function-schemata sub-module to HEAD (8893942)repos/abstract-wiki/wikifunctions/wikilambda-cli!86jforrestersync-function-schematamain
Update function-schemata sub-module to HEAD (8893942)repos/abstract-wiki/wikifunctions/function-orchestrator!441jforrestersync-function-schematamain
Update function-schemata sub-module to HEAD (6612643)repos/abstract-wiki/wikifunctions/function-evaluator!395apinesync-function-schematamain
Support Avro schema version 2.0.0 in the Rust evaluator.repos/abstract-wiki/wikifunctions/function-evaluator!394apineapine-avro-versionsmain
[Breaking change] Support Avro schema v2.0.0 in Rust and organize repo accordingly.repos/abstract-wiki/wikifunctions/function-schemata!264apineapine-rust-avro-200main
Update function-schemata sub-module to HEAD (4df73e6)repos/abstract-wiki/wikifunctions/wikilambda-cli!84jforrestersync-function-schematamain
Update function-schemata sub-module to HEAD (bc27c13)repos/abstract-wiki/wikifunctions/function-evaluator!380apinesync-function-schematamain
Make it possible to deserialize V1.0.0 Avro schema-serialized objects in Rust.repos/abstract-wiki/wikifunctions/function-schemata!261apineapine-goodrustmain
Update function-schemata sub-module to HEAD (4df73e6)repos/abstract-wiki/wikifunctions/function-orchestrator!431jforrestersync-function-schematamain
Customize query in GitLab

Related Objects
Search...

Event Timeline

cmassaro created this task.Jul 11 2025, 3:58 PM
cmassaro added a parent task: T399321: Rust-based evaluator service can run a function call in the appropriate executor and return a result.Jul 11 2025, 4:02 PM
cmassaro added a parent task: T399322: Rust-based evaluator service should maintain a pool of ready executors.
cmassaro removed a parent task: T399322: Rust-based evaluator service should maintain a pool of ready executors.Jul 11 2025, 10:32 PM
DSantamaria added a project: Essential-Work.Jul 16 2025, 2:00 PM
DSantamaria triaged this task as Medium priority.Jul 16 2025, 2:06 PM
DSantamaria edited projects, added Abstract Wikipedia team (26Q1 (Jul–Sep)); removed Abstract Wikipedia team.
DSantamaria moved this task from Incoming to Ready on the Abstract Wikipedia team (26Q1 (Jul–Sep)) board.
CodeReviewBot added a comment.Aug 21 2025, 3:39 PM

jforrester updated https://gitlab.wikimedia.org/repos/abstract-wiki/wikifunctions/function-schemata/-/merge_requests/261

Make it possible to deserialize V1.0.0 Avro schema-serialized objects in Rust.

Jdforrester-WMF changed the task status from Open to In Progress.Aug 21 2025, 3:40 PM
Jdforrester-WMF assigned this task to cmassaro.
Jdforrester-WMF moved this task from Ready to In Engineering on the Abstract Wikipedia team (26Q1 (Jul–Sep)) board.
CodeReviewBot added a comment.Aug 21 2025, 8:25 PM

ecarg merged https://gitlab.wikimedia.org/repos/abstract-wiki/wikifunctions/function-schemata/-/merge_requests/261

Make it possible to deserialize V1.0.0 Avro schema-serialized objects in Rust.

CodeReviewBot added a project: Patch-For-Review.Aug 22 2025, 12:01 AM

apine opened https://gitlab.wikimedia.org/repos/abstract-wiki/wikifunctions/function-evaluator/-/merge_requests/380

Update function-schemata sub-module to HEAD (bc27c13)

CodeReviewBot added a comment.Aug 22 2025, 12:49 AM

dmartin merged https://gitlab.wikimedia.org/repos/abstract-wiki/wikifunctions/function-evaluator/-/merge_requests/380

Update function-schemata sub-module to HEAD (bc27c13)

CodeReviewBot added a comment.Aug 25 2025, 2:06 PM

jforrester opened https://gitlab.wikimedia.org/repos/abstract-wiki/wikifunctions/wikilambda-cli/-/merge_requests/84

Update function-schemata sub-module to HEAD (4df73e6)

CodeReviewBot added a comment.Aug 25 2025, 2:15 PM

jforrester updated https://gitlab.wikimedia.org/repos/abstract-wiki/wikifunctions/function-orchestrator/-/merge_requests/431

Update function-schemata sub-module to HEAD (4df73e6)

gerritbot added a comment.Aug 25 2025, 2:51 PM

Change #1181726 had a related patch set uploaded (by Jforrester; author: Jforrester):

[mediawiki/extensions/WikiLambda@master] Update function-schemata sub-module to HEAD (4df73e6)

https://gerrit.wikimedia.org/r/1181726

CodeReviewBot added a comment.Aug 25 2025, 2:59 PM

apine merged https://gitlab.wikimedia.org/repos/abstract-wiki/wikifunctions/function-orchestrator/-/merge_requests/431

Update function-schemata sub-module to HEAD (4df73e6)

CodeReviewBot added a comment.Aug 25 2025, 2:59 PM

apine merged https://gitlab.wikimedia.org/repos/abstract-wiki/wikifunctions/wikilambda-cli/-/merge_requests/84

Update function-schemata sub-module to HEAD (4df73e6)

gerritbot added a comment.Aug 25 2025, 6:21 PM

Change #1181726 merged by jenkins-bot:

[mediawiki/extensions/WikiLambda@master] Update function-schemata sub-module to HEAD (4df73e6)

https://gerrit.wikimedia.org/r/1181726

cmassaro edited parent tasks, added: T343720: If we create a working evaluator service in Rust, we can measure its performance and stability characteristics and plan to productionize it in a subsequent quarter; removed: T399321: Rust-based evaluator service can run a function call in the appropriate executor and return a result.Aug 26 2025, 1:56 PM
Jdforrester-WMF subscribed.Aug 26 2025, 4:28 PM

After https://gitlab.wikimedia.org/repos/abstract-wiki/wikifunctions/function-evaluator/-/merge_requests/381 lands, this is now done AIUI for v1.0.0; did we want to keep this open for v2.0.0?

gerritbot added a comment.Aug 27 2025, 12:46 PM

Change #1182534 had a related patch set uploaded (by Jforrester; author: Jforrester):

[operations/deployment-charts@master] wikifunctions: Upgrade evaluators from 2025-08-20-203801 to 2025-08-26-213211

https://gerrit.wikimedia.org/r/1182534

gerritbot added a comment.Aug 27 2025, 12:46 PM

Change #1182535 had a related patch set uploaded (by Jforrester; author: Jforrester):

[operations/deployment-charts@master] wikifunctions: Upgrade orchestrator from 2025-08-20-210742 to 2025-08-25-145906

https://gerrit.wikimedia.org/r/1182535

gerritbot added a comment.Aug 27 2025, 2:29 PM

Change #1182534 merged by jenkins-bot:

[operations/deployment-charts@master] wikifunctions: Upgrade evaluators from 2025-08-20-203801 to 2025-08-26-213211

https://gerrit.wikimedia.org/r/1182534

gerritbot added a comment.Aug 27 2025, 2:36 PM

Change #1182535 merged by jenkins-bot:

[operations/deployment-charts@master] wikifunctions: Upgrade orchestrator from 2025-08-20-210742 to 2025-08-25-145906

https://gerrit.wikimedia.org/r/1182535

cmassaro moved this task from In Engineering to In Code review on the Abstract Wikipedia team (26Q1 (Jul–Sep)) board.Sep 3 2025, 8:39 PM
CodeReviewBot added a comment.Sep 3 2025, 8:40 PM

apine opened https://gitlab.wikimedia.org/repos/abstract-wiki/wikifunctions/function-schemata/-/merge_requests/264

[Breaking change] Support Avro schema v2.0.0 in Rust and organize repo accordingly.

cmassaro moved this task from In Code review to In Engineering on the Abstract Wikipedia team (26Q1 (Jul–Sep)) board.Sep 3 2025, 8:40 PM
CodeReviewBot added a comment.Sep 5 2025, 2:14 AM

apine opened https://gitlab.wikimedia.org/repos/abstract-wiki/wikifunctions/function-evaluator/-/merge_requests/394

Draft: Support Avro schema version 2.0.0 in the Rust evaluator.

cmassaro moved this task from In Engineering to In Code review on the Abstract Wikipedia team (26Q1 (Jul–Sep)) board.Sep 5 2025, 2:18 AM
CodeReviewBot added a comment.Sep 5 2025, 8:00 PM

ecarg merged https://gitlab.wikimedia.org/repos/abstract-wiki/wikifunctions/function-schemata/-/merge_requests/264

[Breaking change] Support Avro schema v2.0.0 in Rust and organize repo accordingly.

CodeReviewBot added a comment.Sep 5 2025, 8:19 PM

apine opened https://gitlab.wikimedia.org/repos/abstract-wiki/wikifunctions/function-evaluator/-/merge_requests/395

[Breaking Change] Update function-schemata sub-module to HEAD (6612643)

CodeReviewBot added a comment.Sep 5 2025, 8:20 PM

apine closed https://gitlab.wikimedia.org/repos/abstract-wiki/wikifunctions/function-evaluator/-/merge_requests/394

Support Avro schema version 2.0.0 in the Rust evaluator.

CodeReviewBot added a comment.Sep 8 2025, 2:56 PM

jforrester merged https://gitlab.wikimedia.org/repos/abstract-wiki/wikifunctions/function-evaluator/-/merge_requests/395

Update function-schemata sub-module to HEAD (6612643)

Jdforrester-WMF moved this task from In Code review to Needs Sign-off on the Abstract Wikipedia team (26Q1 (Jul–Sep)) board.Sep 8 2025, 2:57 PM

Rust service isn't deployed, so this doesn't need to wait for deployment before sign-off.

gerritbot added a comment.Sep 8 2025, 3:03 PM

Change #1185966 had a related patch set uploaded (by Jforrester; author: Jforrester):

[mediawiki/extensions/WikiLambda@master] Update function-schemata sub-module to HEAD (8893942)

https://gerrit.wikimedia.org/r/1185966

CodeReviewBot added a comment.Sep 8 2025, 3:04 PM

jforrester opened https://gitlab.wikimedia.org/repos/abstract-wiki/wikifunctions/function-orchestrator/-/merge_requests/441

Update function-schemata sub-module to HEAD (8893942)

CodeReviewBot added a comment.Sep 8 2025, 3:04 PM

jforrester opened https://gitlab.wikimedia.org/repos/abstract-wiki/wikifunctions/wikilambda-cli/-/merge_requests/86

Update function-schemata sub-module to HEAD (8893942)

CodeReviewBot added a comment.Sep 8 2025, 7:05 PM

apine merged https://gitlab.wikimedia.org/repos/abstract-wiki/wikifunctions/function-orchestrator/-/merge_requests/441

Update function-schemata sub-module to HEAD (8893942)

CodeReviewBot added a comment.Sep 8 2025, 7:05 PM

apine merged https://gitlab.wikimedia.org/repos/abstract-wiki/wikifunctions/wikilambda-cli/-/merge_requests/86

Update function-schemata sub-module to HEAD (8893942)

gerritbot added a comment.Sep 9 2025, 9:29 AM

Change #1185966 merged by jenkins-bot:

[mediawiki/extensions/WikiLambda@master] Update function-schemata sub-module to HEAD (8893942)

https://gerrit.wikimedia.org/r/1185966

gerritbot added a comment.Sep 10 2025, 12:50 PM

Change #1186978 had a related patch set uploaded (by Jforrester; author: Jforrester):

[operations/deployment-charts@master] wikifunctions: Upgrade evaluators from 2025-09-03-123051 to 2025-09-09-171717

https://gerrit.wikimedia.org/r/1186978

gerritbot added a comment.Sep 10 2025, 12:50 PM

Change #1186979 had a related patch set uploaded (by Jforrester; author: Jforrester):

[operations/deployment-charts@master] wikifunctions: Upgrade orchestrator from 2025-09-04-003606 to 2025-09-08-191243

https://gerrit.wikimedia.org/r/1186979

gerritbot added a comment.Sep 10 2025, 2:02 PM

Change #1186978 merged by jenkins-bot:

[operations/deployment-charts@master] wikifunctions: Upgrade evaluators from 2025-09-03-123051 to 2025-09-09-171717

https://gerrit.wikimedia.org/r/1186978

gerritbot added a comment.Sep 10 2025, 2:08 PM

Change #1186979 merged by jenkins-bot:

[operations/deployment-charts@master] wikifunctions: Upgrade orchestrator from 2025-09-04-003606 to 2025-09-08-191243

https://gerrit.wikimedia.org/r/1186979

cmassaro closed this task as Resolved.Sep 16 2025, 1:46 PM
DMartin-WMF mentioned this in rMSFE014941d6e19c: Update function-schemata sub-module to HEAD (bc27c13).Oct 3 2025, 9:45 AM
Jdforrester-WMF mentioned this in rMSFE3092b71d713a: Update function-schemata sub-module to HEAD (6612643).Oct 3 2025, 9:45 AM
Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL · Credits