Page MenuHomePhabricator
Create Task
Maniphest T271762

Create initial Function Evaluator service
Closed, ResolvedPublic
Actions

Description

https://gerrit.wikimedia.org/r/plugins/gitiles/mediawiki/services/function-evaluator/

Sub-tasks to come.

This service should be able to evaluate ZObject expressions somewhat resembling that exemplified here:

https://meta.wikimedia.org/wiki/Abstract_Wikipedia/Function_evaluator_call

Related Objects
Search...

StatusSubtypeAssignedTask
 OpenNoneT278321 Provide a special page listing invalid ZObjects
 ResolvedNoneT290119 Phase η root task
 ResolvedNoneT290118 User-defined types work with validation
 ResolvedNoneT291028 Instances of a user-defined type which should not validate indeed do not validate
 OpenNoneT278318 Let users validate an unstored ZObject / edit on a ZObject
 StalledNoneT269177 ZObject DAO should have a isWellFormed method
 ResolvedcmassaroT260861 Use the orchestrator/evaluator to validate instances of each Z4/Type using on-wiki defined Z8/Functions instead of hard-coded
OpenNoneT278316 Provide a validation API endpoint for arbitrary ZObjects from both MediaWiki and the orchestrator
 OpenNoneT292240 Save Un- (or Under-) Validated ZObjects, Validate Asynchronously via Orchestrator, Then Annotate ZObjects As Valid or Not
 OpenNoneT278325 Store that a page contains an invalid ZObject in a tracking table
 OpenNoneT278320 Allow to store an invalid ZObject explicitly, so we can have failure examples for Validator functions' Testers
 OpenNoneT294045 Create a "Validate" Endpoint in Orchestrator
 DuplicateNoneT273125 Migrate hard-coded validators to validation defined on-wiki
 OpenNoneT278319 Provide functionality for users to trigger a re-validation of a stored object
 ResolvedNoneT273124 Use evaluation for validation
 ResolvedcmassaroT282843 Hook up orchestrator to the evaluator and pass through appropriately-dereferenced Z7 calls
 ResolvedcmassaroT271762 Create initial Function Evaluator service
 ResolvedcmassaroT269697 Turn Function Evaluator into a service
 ResolvedcmassaroT269698 Make Function Evaluator work async
 ResolvedcmassaroT272630 Define interface for the function-evaluator
 ResolvedJdforrester-WMFT276478 Provide "semantically peel-able" list of programming languages that we allow
 ResolvedcmassaroT273515 Create Execution Environments for Supported Languages
 ResolvedcmassaroT273517 Create Execution Environment for Python
 ResolvedcmassaroT275944 Create Execution Environment for JavaScript
 ResolvedNoneT261470 Sandboxing and monitoring of evaluations

Event Timeline

Jdforrester-WMF created this task.Jan 11 2021, 11:18 PM
Jdforrester-WMF added a subtask: T269697: Turn Function Evaluator into a service.
Jdforrester-WMF added a subtask: T269698: Make Function Evaluator work async.Jan 13 2021, 5:15 PM
DVrandecic moved this task from To triage to Phase γ on the Abstract Wikipedia team board.Jan 13 2021, 5:16 PM
DVrandecic edited projects, added Abstract Wikipedia team (Phase γ); removed Abstract Wikipedia team.
DVrandecic moved this task from Phase γ to Phase δ on the Abstract Wikipedia team board.
DVrandecic edited projects, added Abstract Wikipedia team (Phase δ); removed Abstract Wikipedia team (Phase γ).
cmassaro updated the task description. (Show Details)Feb 1 2021, 6:27 PM
cmassaro claimed this task.Feb 1 2021, 6:34 PM
DVrandecic added a subtask: T272630: Define interface for the function-evaluator.Feb 1 2021, 11:09 PM
Sabas88 moved this task from Phase δ to Phase ε on the Abstract Wikipedia team board.Feb 23 2021, 8:26 PM
Sabas88 edited projects, added Abstract Wikipedia team (Phase ε); removed Abstract Wikipedia team (Phase δ).
DVrandecic moved this task from Phase ε to Phase δ on the Abstract Wikipedia team board.Mar 10 2021, 1:26 AM
DVrandecic edited projects, added Abstract Wikipedia team (Phase δ); removed Abstract Wikipedia team (Phase ε).
Jdforrester-WMF added a project: function-evaluator.Mar 24 2021, 10:16 PM
Jdforrester-WMF edited projects, added Abstract Wikipedia team (Phase ε); removed Abstract Wikipedia team (Phase δ).Apr 1 2021, 11:28 PM
DVrandecic closed subtask T269698: Make Function Evaluator work async as Resolved.Apr 6 2021, 5:02 PM
DVrandecic closed subtask T269697: Turn Function Evaluator into a service as Resolved.
DVrandecic triaged this task as High priority.Apr 7 2021, 5:06 AM
Jdforrester-WMF added a subtask: T273515: Create Execution Environments for Supported Languages.May 5 2021, 5:14 PM
Jdforrester-WMF added a subtask: T261470: Sandboxing and monitoring of evaluations.May 5 2021, 5:17 PM
Jdforrester-WMF added a parent task: T273124: Use evaluation for validation.May 5 2021, 5:21 PM
Jdforrester-WMF added a project: Epic.May 13 2021, 4:10 PM
Jdforrester-WMF closed subtask T273515: Create Execution Environments for Supported Languages as Resolved.May 14 2021, 12:14 AM

We'll want to do some parts of T278651: Add rate limits and rights for each part of the system here too.

Jdforrester-WMF closed subtask T272630: Define interface for the function-evaluator as Resolved.May 25 2021, 5:58 PM
Jdforrester-WMF closed this task as Resolved.May 25 2021, 6:04 PM
Jdforrester-WMF edited parent tasks, added: T282843: Hook up orchestrator to the evaluator and pass through appropriately-dereferenced Z7 calls; removed: T273124: Use evaluation for validation.
DVrandecic closed subtask T261470: Sandboxing and monitoring of evaluations as Resolved.May 26 2021, 4:33 PM
Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL