Page MenuHomePhabricator
Create Task
Maniphest T428918

Flatten Lists in Evaluator Request Format
Closed, ResolvedPublic
Actions

Description

Description

It is possible to hit the JS recursion limit when preparing to send a long ZList as part of an evaluator request. We should flatten lists into JS arrays to obviate this.

TODO

  • add support for both 2.1.1 and 3.0.0 to evaluator
  • deploy evaluator
  • switch orchestrator schema version to 3.0.0
  • deploy orchestrator
  • remove 2.1.1 code and all concomitant shims

Desired behavior/Acceptance criteria (returned value, expected error, performance expectations, etc.)

  • new evaluator request format with flattened lists
  • good things

Completion checklist

Details

Related Changes in Gerrit:
SubjectAuthorRepoBranchLines +/-
Update function-schemata sub-module to HEAD (5f8f6dc)Jforrestermediawiki/extensions/WikiLambdamaster+1 -1
wikifunctions: Upgrade orchestrator from 2026-06-23-115555 to 2026-07-01-115510Jforresteroperations/deployment-chartsmaster+1 -1
wikifunctions: Upgrade evaluators from 2026-06-25-145651 to 2026-06-30-213833Jforresteroperations/deployment-chartsmaster+2 -2
Update function-schemata sub-module to HEAD (1ee532d)Jforrestermediawiki/extensions/WikiLambdamaster+1 -1
Update function-schemata sub-module to HEAD (4583bb7)Jforrestermediawiki/extensions/WikiLambdamaster+1 -1
wikifunctions: Upgrade orchestrator from 2026-06-11-171152 to 2026-06-16-183209Jforresteroperations/deployment-chartsmaster+1 -1
wikifunctions: Upgrade evaluators from 2026-06-09-174730 to 2026-06-17-184727Jforresteroperations/deployment-chartsmaster+4 -4
wikifunctions: Upgrade evaluators from 2026-06-09-174730 to 2026-06-16-205705Jforresteroperations/deployment-chartsmaster+4 -4
Customize query in gerrit
Related Changes in GitLab:
TitleReferenceAuthorSource BranchDest Branch
Update function-schemata sub-module to HEAD (5f8f6dc)repos/abstract-wiki/wikifunctions/wikilambda-cli!123jforrestersync-function-schematamain
Update function-schemata sub-module to HEAD (5f8f6dc)repos/abstract-wiki/wikifunctions/function-evaluator!591jforrestersync-function-schematamain
Update function-schemata sub-module to HEAD (5f8f6dc)repos/abstract-wiki/wikifunctions/function-orchestrator!733jforrestersync-function-schematamain
exchangeFormat: Also drop test_data/exchange_format_2_1_1_expectedrepos/abstract-wiki/wikifunctions/function-schemata!379jforresterunused-cleanupmain
Update function-schemata sub-module to HEAD (1ee532d)repos/abstract-wiki/wikifunctions/wikilambda-cli!122jforrestersync-function-schematamain
Update function-schemata sub-module to HEAD (1ee532d)repos/abstract-wiki/wikifunctions/function-evaluator!589jforrestersync-function-schematamain
Update function-schemata sub-module to HEAD (1ee532d)repos/abstract-wiki/wikifunctions/function-orchestrator!732jforrestersync-function-schematamain
No more v2.1.1.repos/abstract-wiki/wikifunctions/function-schemata!377apineapine-no-more-2.1.1main
Remove support for exchange format v2.1.1.repos/abstract-wiki/wikifunctions/function-evaluator!583apineapine-decommission-2.1.1-extremelymain
Update function-schemata sub-module to HEAD (054c288)repos/abstract-wiki/wikifunctions/function-orchestrator!722jforrestersync-function-schematamain
Update function-schemata sub-module to HEAD (054c288)repos/abstract-wiki/wikifunctions/function-evaluator!569jforrestersync-function-schematamain
Update function-schemata sub-module to HEAD (054c288)repos/abstract-wiki/wikifunctions/wikilambda-cli!119jforrestersync-function-schematamain
Switch to exchange format v3.0.0.repos/abstract-wiki/wikifunctions/function-orchestrator!721apineapine-switch-exchange-format-3-0-0main
Transitionally support both schema version 2.1.1 and 3.0.0.repos/abstract-wiki/wikifunctions/function-evaluator!568apineapine-transition-exchange-format-3-0-0main
Flatten representation of ZLists in exchange format.repos/abstract-wiki/wikifunctions/function-schemata!368apineapine-exchange-format-3main
Show related patches Customize query in GitLab

Related Objects

Event Timeline

cmassaro created this task.Jun 11 2026, 3:05 PM
cmassaro claimed this task.
cmassaro edited projects, added: Abstract Wikipedia team (26Q4 (Apr–Jun)); removed: Abstract Wikipedia Fix-It tasks, Abstract Wikipedia team.
cmassaro moved this task from Incoming to In Engineering on the Abstract Wikipedia team (26Q4 (Apr–Jun)) board.
cmassaro mentioned this in T428835: widespread issues with Javascript processing Wikidata content.Jun 11 2026, 3:08 PM
CodeReviewBot added a project: Patch-For-Review.Jun 13 2026, 2:23 AM

apine opened https://gitlab.wikimedia.org/repos/abstract-wiki/wikifunctions/function-schemata/-/merge_requests/368

Draft: Flatten representation of ZLists in exchange format.

DSantamaria changed the task status from Open to In Progress.Jun 15 2026, 1:25 PM
DSantamaria added a project: Essential-Work.
cmassaro updated the task description. (Show Details)Jun 15 2026, 9:32 PM
CodeReviewBot added a comment.Jun 15 2026, 11:05 PM

apine opened https://gitlab.wikimedia.org/repos/abstract-wiki/wikifunctions/function-evaluator/-/merge_requests/568

Draft: Transitionally support both schema version 2.1.1 and 3.0.0.

CodeReviewBot added a comment.Jun 15 2026, 11:07 PM

apine opened https://gitlab.wikimedia.org/repos/abstract-wiki/wikifunctions/function-orchestrator/-/merge_requests/721

Draft: Switch to exchange format v3.0.0.

CodeReviewBot added a comment.Jun 16 2026, 1:52 PM

apine merged https://gitlab.wikimedia.org/repos/abstract-wiki/wikifunctions/function-schemata/-/merge_requests/368

Flatten representation of ZLists in exchange format.

gerritbot added a comment.Jun 16 2026, 1:54 PM

Change #1302868 had a related patch set uploaded (by Jforrester; author: Jforrester):

[mediawiki/extensions/WikiLambda@master] Update function-schemata sub-module to HEAD (054c288)

https://gerrit.wikimedia.org/r/1302868

CodeReviewBot added a comment.Jun 16 2026, 1:54 PM

jforrester opened https://gitlab.wikimedia.org/repos/abstract-wiki/wikifunctions/wikilambda-cli/-/merge_requests/119

Update function-schemata sub-module to HEAD (054c288)

CodeReviewBot added a comment.Jun 16 2026, 1:55 PM

jforrester opened https://gitlab.wikimedia.org/repos/abstract-wiki/wikifunctions/function-orchestrator/-/merge_requests/722

Update function-schemata sub-module to HEAD (054c288)

CodeReviewBot added a comment.Jun 16 2026, 1:55 PM

jforrester opened https://gitlab.wikimedia.org/repos/abstract-wiki/wikifunctions/function-evaluator/-/merge_requests/569

Update function-schemata sub-module to HEAD (054c288)

Jdforrester-WMF mentioned this in rMSFEfd77e2456a05: Update function-schemata sub-module to HEAD (054c288).Jun 16 2026, 1:56 PM
CodeReviewBot added a comment.Jun 16 2026, 1:58 PM

apine merged https://gitlab.wikimedia.org/repos/abstract-wiki/wikifunctions/wikilambda-cli/-/merge_requests/119

Update function-schemata sub-module to HEAD (054c288)

CodeReviewBot added a comment.Jun 16 2026, 2:24 PM

apine merged https://gitlab.wikimedia.org/repos/abstract-wiki/wikifunctions/function-orchestrator/-/merge_requests/722

Update function-schemata sub-module to HEAD (054c288)

CodeReviewBot added a comment.Jun 16 2026, 3:14 PM

apine merged https://gitlab.wikimedia.org/repos/abstract-wiki/wikifunctions/function-evaluator/-/merge_requests/569

Update function-schemata sub-module to HEAD (054c288)

cmassaro mentioned this in rMSFE071c18079a82: Update function-schemata sub-module to HEAD (054c288).Jun 16 2026, 3:15 PM
Jdforrester-WMF moved this task from In Engineering to In Code review on the Abstract Wikipedia team (26Q4 (Apr–Jun)) board.Jun 16 2026, 5:43 PM
Jdforrester-WMF triaged this task as High priority.Jun 16 2026, 5:47 PM
CodeReviewBot added a comment.Jun 16 2026, 6:31 PM

jforrester merged https://gitlab.wikimedia.org/repos/abstract-wiki/wikifunctions/function-orchestrator/-/merge_requests/721

Switch to exchange format v3.0.0.

CodeReviewBot added a comment.Jun 16 2026, 8:56 PM

ecarg merged https://gitlab.wikimedia.org/repos/abstract-wiki/wikifunctions/function-evaluator/-/merge_requests/568

Transitionally support both schema version 2.1.1 and 3.0.0.

ecarg mentioned this in rMSFEb075b96e05fe: Transitionally support both schema version 2.1.1 and 3.0.0..Jun 16 2026, 8:56 PM
Jdforrester-WMF updated the task description. (Show Details)Jun 16 2026, 9:34 PM
cmassaro moved this task from In Code review to Ready to deploy on the Abstract Wikipedia team (26Q4 (Apr–Jun)) board.Jun 16 2026, 9:52 PM
gerritbot added a comment.Jun 17 2026, 1:48 PM

Change #1303433 had a related patch set uploaded (by Jforrester; author: Jforrester):

[operations/deployment-charts@master] wikifunctions: Upgrade evaluators from 2026-06-09-174730 to 2026-06-16-205705

https://gerrit.wikimedia.org/r/1303433

gerritbot added a comment.Jun 17 2026, 1:49 PM

Change #1303434 had a related patch set uploaded (by Jforrester; author: Jforrester):

[operations/deployment-charts@master] wikifunctions: Upgrade orchestrator from 2026-06-11-171152 to 2026-06-16-183209

https://gerrit.wikimedia.org/r/1303434

gerritbot added a comment.Jun 17 2026, 2:04 PM

Change #1303433 merged by jenkins-bot:

[operations/deployment-charts@master] wikifunctions: Upgrade evaluators from 2026-06-09-174730 to 2026-06-16-205705

https://gerrit.wikimedia.org/r/1303433

gerritbot added a comment.Wed, Jun 17, 4:08 PM

Change #1303482 had a related patch set uploaded (by Jforrester; author: Jforrester):

[operations/deployment-charts@master] wikifunctions: Upgrade evaluators from 2026-06-09-174730 to 2026-06-17-154210

https://gerrit.wikimedia.org/r/1303482

gerritbot added a comment.Wed, Jun 17, 9:04 PM

Change #1303482 merged by jenkins-bot:

[operations/deployment-charts@master] wikifunctions: Upgrade evaluators from 2026-06-09-174730 to 2026-06-17-184727

https://gerrit.wikimedia.org/r/1303482

Jdforrester-WMF updated the task description. (Show Details)Wed, Jun 17, 9:16 PM
gerritbot added a comment.Wed, Jun 17, 9:19 PM

Change #1303434 merged by jenkins-bot:

[operations/deployment-charts@master] wikifunctions: Upgrade orchestrator from 2026-06-11-171152 to 2026-06-16-183209

https://gerrit.wikimedia.org/r/1303434

Jdforrester-WMF updated the task description. (Show Details)Wed, Jun 17, 9:23 PM
Jdforrester-WMF moved this task from Ready to deploy to In Engineering on the Abstract Wikipedia team (26Q4 (Apr–Jun)) board.Wed, Jun 17, 10:09 PM
Jdforrester-WMF subscribed.

Back to In Engineering for 2.1.1 removal.

gerritbot added a comment.Thu, Jun 18, 1:14 PM

Change #1302868 merged by jenkins-bot:

[mediawiki/extensions/WikiLambda@master] Update function-schemata sub-module to HEAD (4583bb7)

https://gerrit.wikimedia.org/r/1302868

Maintenance_bot removed a project: Patch-For-Review.Thu, Jun 18, 1:31 PM
ReleaseTaggerBot added a project: MW-1.47-notes (1.47.0-wmf.8; 2026-06-23).Thu, Jun 18, 2:00 PM
CodeReviewBot added a project: Patch-For-Review.Thu, Jun 25, 2:19 AM

apine opened https://gitlab.wikimedia.org/repos/abstract-wiki/wikifunctions/function-schemata/-/merge_requests/377

Draft: No more v2.1.1.

CodeReviewBot added a comment.Thu, Jun 25, 2:19 AM

apine updated https://gitlab.wikimedia.org/repos/abstract-wiki/wikifunctions/function-evaluator/-/merge_requests/583

Draft: Remove support for exchange format v2.1.1.

CodeReviewBot added a comment.Sat, Jun 27, 4:48 PM

jforrester merged https://gitlab.wikimedia.org/repos/abstract-wiki/wikifunctions/function-schemata/-/merge_requests/377

No more v2.1.1.

Jdforrester-WMF mentioned this in rMSFE2320854de445: Remove support for exchange format v2.1.1..Sat, Jun 27, 4:49 PM
CodeReviewBot added a comment.Sat, Jun 27, 4:49 PM

jforrester merged https://gitlab.wikimedia.org/repos/abstract-wiki/wikifunctions/function-evaluator/-/merge_requests/583

Remove support for exchange format v2.1.1.

Jdforrester-WMF mentioned this in rMSFEeaa99a994e3b: Update function-schemata sub-module to HEAD (1ee532d).Sat, Jun 27, 4:52 PM
CodeReviewBot added a comment.Sat, Jun 27, 4:52 PM

jforrester opened https://gitlab.wikimedia.org/repos/abstract-wiki/wikifunctions/function-orchestrator/-/merge_requests/732

Update function-schemata sub-module to HEAD (1ee532d)

CodeReviewBot added a comment.Sat, Jun 27, 4:52 PM

jforrester opened https://gitlab.wikimedia.org/repos/abstract-wiki/wikifunctions/function-evaluator/-/merge_requests/589

Update function-schemata sub-module to HEAD (1ee532d)

CodeReviewBot added a comment.Sat, Jun 27, 4:53 PM

jforrester opened https://gitlab.wikimedia.org/repos/abstract-wiki/wikifunctions/wikilambda-cli/-/merge_requests/122

Update function-schemata sub-module to HEAD (1ee532d)

gerritbot added a comment.Sat, Jun 27, 4:53 PM

Change #1306055 had a related patch set uploaded (by Jforrester; author: Jforrester):

[mediawiki/extensions/WikiLambda@master] Update function-schemata sub-module to HEAD (1ee532d)

https://gerrit.wikimedia.org/r/1306055

Jdforrester-WMF updated the task description. (Show Details)Sat, Jun 27, 4:53 PM
Jdforrester-WMF moved this task from In Engineering to Ready to deploy on the Abstract Wikipedia team (26Q4 (Apr–Jun)) board.
CodeReviewBot added a comment.Mon, Jun 29, 5:16 PM

apine merged https://gitlab.wikimedia.org/repos/abstract-wiki/wikifunctions/wikilambda-cli/-/merge_requests/122

Update function-schemata sub-module to HEAD (1ee532d)

CodeReviewBot added a comment.Mon, Jun 29, 5:16 PM

apine merged https://gitlab.wikimedia.org/repos/abstract-wiki/wikifunctions/function-orchestrator/-/merge_requests/732

Update function-schemata sub-module to HEAD (1ee532d)

CodeReviewBot added a comment.Mon, Jun 29, 5:16 PM

apine merged https://gitlab.wikimedia.org/repos/abstract-wiki/wikifunctions/function-evaluator/-/merge_requests/589

Update function-schemata sub-module to HEAD (1ee532d)

cmassaro mentioned this in rMSFE9ac5b099b96b: Update function-schemata sub-module to HEAD (1ee532d).Mon, Jun 29, 5:17 PM
DMartin-WMF mentioned this in T430014: Rust: Python Executor fails on some large returns from Orchestrator callbacks.Mon, Jun 29, 6:43 PM
gerritbot added a comment.Mon, Jun 29, 7:39 PM

Change #1306055 merged by jenkins-bot:

[mediawiki/extensions/WikiLambda@master] Update function-schemata sub-module to HEAD (1ee532d)

https://gerrit.wikimedia.org/r/1306055

ReleaseTaggerBot edited projects, added: MW-1.47-notes (1.47.0-wmf.9; 2026-06-30); removed: MW-1.47-notes (1.47.0-wmf.8; 2026-06-23).Mon, Jun 29, 8:00 PM
CodeReviewBot added a comment.Tue, Jun 30, 6:39 PM

jforrester opened https://gitlab.wikimedia.org/repos/abstract-wiki/wikifunctions/function-schemata/-/merge_requests/379

exchangeFormat: Also drop test_data/exchange_format_2_1_1_expected

CodeReviewBot added a comment.Tue, Jun 30, 6:57 PM

jforrester merged https://gitlab.wikimedia.org/repos/abstract-wiki/wikifunctions/function-schemata/-/merge_requests/379

exchangeFormat: Also drop test_data/exchange_format_2_1_1_expected

gerritbot added a comment.Tue, Jun 30, 7:05 PM

Change #1306750 had a related patch set uploaded (by Jforrester; author: Jforrester):

[mediawiki/extensions/WikiLambda@master] Update function-schemata sub-module to HEAD (5f8f6dc)

https://gerrit.wikimedia.org/r/1306750

CodeReviewBot added a comment.Tue, Jun 30, 7:06 PM

jforrester opened https://gitlab.wikimedia.org/repos/abstract-wiki/wikifunctions/function-orchestrator/-/merge_requests/733

Update function-schemata sub-module to HEAD (5f8f6dc)

Jdforrester-WMF mentioned this in rMSFE6f7a781d8c53: Update function-schemata sub-module to HEAD (5f8f6dc).Tue, Jun 30, 7:06 PM
CodeReviewBot added a comment.Tue, Jun 30, 7:06 PM

jforrester opened https://gitlab.wikimedia.org/repos/abstract-wiki/wikifunctions/function-evaluator/-/merge_requests/591

Update function-schemata sub-module to HEAD (5f8f6dc)

CodeReviewBot added a comment.Tue, Jun 30, 7:08 PM

jforrester opened https://gitlab.wikimedia.org/repos/abstract-wiki/wikifunctions/wikilambda-cli/-/merge_requests/123

Update function-schemata sub-module to HEAD (5f8f6dc)

cmassaro mentioned this in rMSFE0d581558a8a6: Update function-schemata sub-module to HEAD (5f8f6dc).Tue, Jun 30, 8:30 PM
cmassaro mentioned this in rMSFEb5f70243494d: Update function-schemata sub-module to HEAD (5f8f6dc).Tue, Jun 30, 8:33 PM
CodeReviewBot added a comment.Tue, Jun 30, 8:55 PM

apine merged https://gitlab.wikimedia.org/repos/abstract-wiki/wikifunctions/wikilambda-cli/-/merge_requests/123

Update function-schemata sub-module to HEAD (5f8f6dc)

CodeReviewBot added a comment.Tue, Jun 30, 9:19 PM

apine merged https://gitlab.wikimedia.org/repos/abstract-wiki/wikifunctions/function-evaluator/-/merge_requests/591

Update function-schemata sub-module to HEAD (5f8f6dc)

cmassaro mentioned this in rMSFEece98b5b9cfb: Update function-schemata sub-module to HEAD (5f8f6dc).Tue, Jun 30, 9:19 PM
CodeReviewBot added a comment.Tue, Jun 30, 9:23 PM

jforrester merged https://gitlab.wikimedia.org/repos/abstract-wiki/wikifunctions/function-orchestrator/-/merge_requests/733

Update function-schemata sub-module to HEAD (5f8f6dc)

gerritbot added a comment.Wed, Jul 1, 1:57 PM

Change #1306932 had a related patch set uploaded (by Jforrester; author: Jforrester):

[operations/deployment-charts@master] wikifunctions: Upgrade evaluators from 2026-06-25-145651 to 2026-06-30-213833

https://gerrit.wikimedia.org/r/1306932

gerritbot added a comment.Wed, Jul 1, 1:58 PM

Change #1306933 had a related patch set uploaded (by Jforrester; author: Jforrester):

[operations/deployment-charts@master] wikifunctions: Upgrade orchestrator from 2026-06-23-115555 to 2026-07-01-115510

https://gerrit.wikimedia.org/r/1306933

gerritbot added a comment.Wed, Jul 1, 2:02 PM

Change #1306932 merged by jenkins-bot:

[operations/deployment-charts@master] wikifunctions: Upgrade evaluators from 2026-06-25-145651 to 2026-06-30-213833

https://gerrit.wikimedia.org/r/1306932

gerritbot added a comment.Wed, Jul 1, 2:09 PM

Change #1306933 merged by jenkins-bot:

[operations/deployment-charts@master] wikifunctions: Upgrade orchestrator from 2026-06-23-115555 to 2026-07-01-115510

https://gerrit.wikimedia.org/r/1306933

Jdforrester-WMF closed this task as Resolved.Wed, Jul 1, 2:22 PM
Jdforrester-WMF moved this task from Ready to deploy to Needs Sign-off on the Abstract Wikipedia team (26Q4 (Apr–Jun)) board.
gerritbot added a comment.Wed, Jul 1, 2:28 PM

Change #1306750 merged by jenkins-bot:

[mediawiki/extensions/WikiLambda@master] Update function-schemata sub-module to HEAD (5f8f6dc)

https://gerrit.wikimedia.org/r/1306750

ReleaseTaggerBot edited projects, added: MW-1.47-notes (1.47.0-wmf.10; 2026-07-07); removed: MW-1.47-notes (1.47.0-wmf.9; 2026-06-30).Wed, Jul 1, 3:00 PM
Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL · Credits