Page MenuHomePhabricator
Create Task
Maniphest T290118

User-defined types work with validation
Closed, ResolvedPublic
Actions

Description

The following actions all work with user-defined types:

  • user-defined types can be created
  • a validator for a user-defined type can be defined
  • a validator for a user-defined type can be implemented
  • validators can call the default validator for some of the validation, and then add more validation on top of it (e.g. use the default validator to make sure all keys are there and have the right type, and then use a bespoke checker to make sure that a specific key's value follows additional rules)
  • an instance of a user-defined type can be created
  • a user-defined type has a working UX to be entered, displayed, and changed
  • validators run on instances
  • instances which should fail, fail at validation and do not get saved
  • instances which should fail cause an exception when being created programmatically
  • users can define bespoke error types for validation
  • users can raise bespoke error types when validation fails
  • functions with user-defined types as input or output types can be defined and implemented
  • user-defined types are displayed with a default component
  • user-defined types can be entered using a default input component
  • support de/serialization for user defined types

Details

SubjectRepoBranchLines +/-
Update function-schemata sub-module to HEAD (cad97f3)mediawiki/extensions/WikiLambdamaster+1 -1
Update function-schemata sub-module to HEAD (cad97f3)mediawiki/services/function-orchestratormaster+1 -1
Update function-schemata sub-module to HEAD (cad97f3)mediawiki/services/function-evaluatormaster+1 -1
Add support for normal-form user-defined types.mediawiki/services/function-schematamaster+212 -7
Customize query in gerrit

Related Objects
Search...

StatusSubtypeAssignedTask
 OpenNoneT278321 Provide a special page listing invalid ZObjects
 OpenNoneT278318 Let users validate an unstored ZObject / edit on a ZObject
 StalledNoneT269177 ZObject DAO should have a isWellFormed method
 ResolvedcmassaroT260861 Use the orchestrator/evaluator to validate instances of each Z4/Type using on-wiki defined Z8/Functions instead of hard-coded
OpenNoneT278316 Provide a validation API endpoint for arbitrary ZObjects from both MediaWiki and the orchestrator
 OpenNoneT292240 Save Un- (or Under-) Validated ZObjects, Validate Asynchronously via Orchestrator, Then Annotate ZObjects As Valid or Not
 OpenNoneT278325 Store that a page contains an invalid ZObject in a tracking table
 OpenNoneT278320 Allow to store an invalid ZObject explicitly, so we can have failure examples for Validator functions' Testers
 OpenNoneT294045 Create a "Validate" Endpoint in Orchestrator
 DuplicateNoneT273125 Migrate hard-coded validators to validation defined on-wiki
 OpenNoneT278319 Provide functionality for users to trigger a re-validation of a stored object
 ResolvedNoneT290119 Phase η root task
 ResolvedNoneT290118 User-defined types work with validation
 ResolvedcmassaroT288555 Support serialisation/deserialisation of user-defined types
 ResolvedBUG REPORTcmassaroT290122 "Could not deserialize input ZObject type: Z86"
 ResolvedcmassaroT287263 Deserialize Objects in Evaluator Based on Z7K1.Z8K2
 ResolvedNoneT275941 Extend the system to support generated instances of Z4/ZTypes by parameterised functions ("Generic types")
 ResolvedgenghT277000 Validate a Z7/Function call in the wiki
 ResolvedgenghT281386 Use the formal ZObject validation definitions from the function-schemata repo in the ZObjectFactory validation code
 DeclinedLindsaykwardellT282745 Add function-schemata to frontend in order to remedy hybrid forms
 ResolvedLindsaykwardellT282816 Use canonicalizer to display JSON
 ResolvedcmassaroT284474 Add tests for normalize/canonicalize code in frontend.
 ResolvedcmassaroT284764 Fix Canonicalization Code in Frontend to Handle Z6s That Masquerade as Z9s
 ResolvedNoneT291033 A function call used as an argument should validate its return type against the expected type of the argument
 ResolvedNoneT291034 Every argument of a function call with a literal or reference should be of a type compatible for that argument
 ResolvedgenghT287700 Make error generation code produce an understandable result when called with non-existent arguments
 ResolvedcmassaroT291032 Arguments taking a function should validate functions as values
 ResolvedNoneT291040 Generic functions
 InvalidNoneT291037 Function model: update functions to the new generic types
 InvalidgenghT291038 Function model: updates to the data model to implement generic types
 ResolvedDVrandecicT287196 Update Pre-Generic Function Model
 ResolvedDVrandecicT287195 Function model: Z21 should be updated to be the null value of Unit
 ResolvedDVrandecicT287194 Function model: Z8K5 is a Z8/Function not a Z6/String, regardless of what our code says
 ResolvedSimoneThisDotT303302 Validate that the UX works with typed list for core types (e.g. Z4 has a typed list of Z3s)
 ResolvedSimoneThisDotT304101 Change the Type UX so that it works (viewing/creating/editing) with a typed list of Z3s for Z4K2
Resolved• JKiesermanT303303 Change the pre-defined core types to use typed lists and not general lists
 ResolvedNoneT291039 Functions using generic types as input types or output type can be defined and implemented
 ResolvedNoneT291045 Function created by a generic function call can be evaluated
 ResolvedJdforrester-WMFT291046 Generic functions can be evaluated
 ResolvedNoneT291047 Generic functions can be implemented
 ResolvedNoneT291048 Generic functions can be defined
 DeclinedNoneT291036 Function model: Z8 should change from a type to a function taking a type and a list of types and returning a type
 ResolvedSimoneThisDotT291041 Instances of a generic type are displayed correctly
 ResolvedSimoneThisDotT291042 Instances of generic types can be edited
 ResolvedcmassaroT291044 Instances of generic types are being validated
 ResolvedcmassaroT285260 Orchestrator Top-Level Validation Should Check Z1K1
 ResolvedSimoneThisDotT297244 Let front-end users create and edit instances of any generic type
 ResolvedSimoneThisDotT291043 Instances of generic typed lists can be created
 ResolvedcmassaroT266241 Normalizer and canonicalizer should deal with local and global keys
 ResolvedcmassaroT289681 Composition creating a type doesn't evaluate
 ResolvedBUG REPORTJdforrester-WMFT292890 Trying to create a Z14 throws "Cannot read properties of undefined (reading 'filter')" in Vue code
 ResolvedSimoneThisDotT295470 Change the type search API to allow users to search for functions returning a type in addition to instances of that type
 ResolvedgenghT262089 Store type identity output in wikilambda_zobject_labels table
ResolvedgenghT297925 Change object search API to optionally include functions' return types as the 'type' filter
 ResolvedcmassaroT286975 Make it possible to define the Typed List function fully
 ResolvedcmassaroT287102 Resolve Z18s Wherever They Occur
 ResolvedJdforrester-WMFT291049 Function that takes a type and returns a type can be evaluated
 ResolvedDVrandecicT291050 Functions that take a type and return a type can be implemented
 ResolvedDVrandecicT291051 Functions that take a type and return a type can be defined
 ResolvedJdforrester-WMFT293663 Fix instancePath vs. dataPath in function-schemata, Add Tests
 ResolvedcmassaroT292808 Use type inference logic to serialize the return type of functions which return a generic ZObject (Z8K2 === Z1)
 ResolvedSimoneThisDotT291023 Instances of user-defined types can be entered using the default component
 ResolvedJdforrester-WMFT291029 Instances of a user-defined type can be edited
 ResolvedDVrandecicT291025 Make it possible to define and implement functions using user-defined types as output or an input type
 ResolvedNoneT291028 Instances of a user-defined type which should not validate indeed do not validate
 ResolvedNoneT273124 Use evaluation for validation
 ResolvedcmassaroT260321 Allow users to trigger function calls for built-in functions (orchestrator-only)
 ResolvedDVrandecicT261964 Agree on architecture for first evaluation engine
 ResolvedLindsaykwardellT280558 Normalize Inputs to Orchestrator
 ResolvedarthurlorenziT275095 Move normalization and canonicalization code to function-schemata
 ResolvedNoneT262770 Normalize ZObjects
 InvalidNoneT280559 Retrieve Function Signature from Orchestrator
 ResolvedcmassaroT282843 Hook up orchestrator to the evaluator and pass through appropriately-dereferenced Z7 calls
 ResolvedcmassaroT271762 Create initial Function Evaluator service
 ResolvedcmassaroT269697 Turn Function Evaluator into a service
 ResolvedcmassaroT269698 Make Function Evaluator work async
 ResolvedcmassaroT272630 Define interface for the function-evaluator
 ResolvedJdforrester-WMFT276478 Provide "semantically peel-able" list of programming languages that we allow
 ResolvedcmassaroT273515 Create Execution Environments for Supported Languages
 ResolvedcmassaroT273517 Create Execution Environment for Python
 ResolvedcmassaroT275944 Create Execution Environment for JavaScript
 ResolvedNoneT261470 Sandboxing and monitoring of evaluations
 ResolvedSimoneThisDotT291022 Validators for user-defined types can be defined and linked
 ResolvedSimoneThisDotT291021 Make the UX for creating a user-defined type straightforward
 ResolvedSimoneThisDotT292891 Provide a custom UX for Z4/Type
 ResolvedJdforrester-WMFT291031 Validator implementations can call Z101/object validator, and then add to it
 ResolvedcmassaroT262997 Validate the values on the keys on a user-defined type
 ResolvedgenghT287734 Replace wikilambda extension php validation code with call to schemata validation
 ResolvedcmassaroT276369 Create PHP bindings for function-schemata
 ResolvedJdforrester-WMFT293831 WikiLambda documentation should explain how to get composer dependencies installed, lest users have missing ISchemaLoader fatals
 ResolvedcmassaroT291030 Validator of a user-defined type can be implemented
 ResolvedcmassaroT291026 Let user implementations throw a user-defined error during a user-defined validation
 ResolvedNoneT291027 Users can create error types
 ResolvedDVrandecicT293423 Create a function that turns an error type into a type
 ResolvedcmassaroT289687 Allow users to create instances of errors in composition
 ResolvedarthurlorenziT290346 Function model: Change the signature of validators from Type -> List to Type -> Type (pass-through)
 Resolved• AdesojiThisDotT293742 Navigate to "provide tests" after user define function, instead than to the newly defined object

Event Timeline

DVrandecic created this task.Sep 1 2021, 2:50 AM
Restricted Application added a subscriber: Aklapper. · View Herald TranscriptSep 1 2021, 2:50 AM
DVrandecic added a parent task: T290119: Phase η root task.Sep 1 2021, 3:47 AM
DVrandecic updated the task description. (Show Details)
DVrandecic updated the task description. (Show Details)Sep 1 2021, 3:57 AM
Jdforrester-WMF added a subtask: T288555: Support serialisation/deserialisation of user-defined types.Sep 1 2021, 4:05 PM
DVrandecic updated the task description. (Show Details)Sep 1 2021, 4:06 PM
DVrandecic updated the task description. (Show Details)Sep 8 2021, 4:05 AM
cmassaro subscribed.Sep 9 2021, 4:06 PM

Is there a reserved range for user-defined types? I am working on the function-schemata part of this.

gerritbot added a comment.Sep 9 2021, 9:32 PM

Change 720111 had a related patch set uploaded (by Cory Massaro; author: Cory Massaro):

[mediawiki/services/function-schemata@master] Add support for user-defined types.

https://gerrit.wikimedia.org/r/720111

gerritbot added a project: Patch-For-Review.Sep 9 2021, 9:32 PM
DVrandecic removed a subtask: T291024: Alter the view for instances of user-defined types (fallback UX).Sep 15 2021, 12:46 AM
DVrandecic removed a subtask: T291026: Let user implementations throw a user-defined error during a user-defined validation.Sep 15 2021, 12:51 AM
DVrandecic added a subtask: T291022: Validators for user-defined types can be defined and linked.Sep 15 2021, 12:54 AM
Jdforrester-WMF removed a project: Epic.Sep 15 2021, 7:58 PM
Jdforrester-WMF added a subtask: T262997: Validate the values on the keys on a user-defined type.Sep 15 2021, 9:50 PM
Jdforrester-WMF added a parent task: T262089: Store type identity output in wikilambda_zobject_labels table .
Jdforrester-WMF added a project: Epic.Sep 16 2021, 4:33 PM
gerritbot added a comment.Sep 17 2021, 6:59 PM

Change 720111 merged by jenkins-bot:

[mediawiki/services/function-schemata@master] Add support for normal-form user-defined types.

https://gerrit.wikimedia.org/r/720111

cmassaro mentioned this in rMSFSfdcf8975017c: Add support for normal-form user-defined types..Sep 17 2021, 6:59 PM
Maintenance_bot removed a project: Patch-For-Review.Sep 17 2021, 7:10 PM
gerritbot added a comment.Sep 17 2021, 10:17 PM

Change 721912 had a related patch set uploaded (by Jforrester; author: Jforrester):

[mediawiki/extensions/WikiLambda@master] Update function-schemata sub-module to HEAD (cad97f3)

https://gerrit.wikimedia.org/r/721912

gerritbot added a project: Patch-For-Review.Sep 17 2021, 10:17 PM

Change 721913 had a related patch set uploaded (by Jforrester; author: Jforrester):

[mediawiki/services/function-orchestrator@master] Update function-schemata sub-module to HEAD (cad97f3)

https://gerrit.wikimedia.org/r/721913

gerritbot added a comment.Sep 17 2021, 10:18 PM

Change 721914 had a related patch set uploaded (by Jforrester; author: Jforrester):

[mediawiki/services/function-evaluator@master] Update function-schemata sub-module to HEAD (cad97f3)

https://gerrit.wikimedia.org/r/721914

gerritbot added a comment.Sep 27 2021, 4:28 PM

Change 721913 merged by jenkins-bot:

[mediawiki/services/function-orchestrator@master] Update function-schemata sub-module to HEAD (cad97f3)

https://gerrit.wikimedia.org/r/721913

Jdforrester-WMF mentioned this in rMSFO9d9661328c65: Update function-schemata sub-module to HEAD (cad97f3).Sep 27 2021, 4:29 PM
gerritbot added a comment.Sep 27 2021, 4:30 PM

Change 721912 merged by jenkins-bot:

[mediawiki/extensions/WikiLambda@master] Update function-schemata sub-module to HEAD (cad97f3)

https://gerrit.wikimedia.org/r/721912

gerritbot added a comment.Sep 27 2021, 4:31 PM

Change 721914 merged by jenkins-bot:

[mediawiki/services/function-evaluator@master] Update function-schemata sub-module to HEAD (cad97f3)

https://gerrit.wikimedia.org/r/721914

Maintenance_bot removed a project: Patch-For-Review.Sep 27 2021, 5:10 PM
Jdforrester-WMF mentioned this in rMSFE3a21c9c4d020: Update function-schemata sub-module to HEAD (cad97f3).Sep 27 2021, 5:24 PM
DVrandecic added a subtask: T293742: Navigate to "provide tests" after user define function, instead than to the newly defined object.Oct 20 2021, 11:00 PM
DVrandecic closed subtask T291025: Make it possible to define and implement functions using user-defined types as output or an input type as Resolved.Nov 3 2021, 4:18 PM
DVrandecic closed subtask T293742: Navigate to "provide tests" after user define function, instead than to the newly defined object as Resolved.Nov 3 2021, 4:20 PM
Jdforrester-WMF removed a parent task: T262089: Store type identity output in wikilambda_zobject_labels table .Nov 17 2021, 5:52 PM
Jdforrester-WMF changed the status of subtask T288555: Support serialisation/deserialisation of user-defined types from Open to In Progress.Dec 14 2021, 5:29 PM
DVrandecic closed subtask T288555: Support serialisation/deserialisation of user-defined types as Resolved.Jan 11 2022, 5:34 PM
cmassaro moved this task from Incoming to QA / Ready to close on the Abstract Wikipedia team (Phase η – Generic types) board.Jan 18 2022, 4:51 PM
Jdforrester-WMF subscribed.Jan 18 2022, 5:22 PM

@cmassaro You've moved this to "ready to close" but it has five open sub-tasks:

Do you think those should also be closed?

DVrandecic moved this task from QA / Ready to close to Ready to do on the Abstract Wikipedia team (Phase η – Generic types) board.Jan 18 2022, 5:23 PM
Jdforrester-WMF closed subtask T291031: Validator implementations can call Z101/object validator, and then add to it as Resolved.Jan 26 2022, 10:36 PM
Jdforrester-WMF closed subtask T262997: Validate the values on the keys on a user-defined type as Resolved.Feb 16 2022, 6:06 PM
Jdforrester-WMF moved this task from Ready to do to QA / Ready to close on the Abstract Wikipedia team (Phase η – Generic types) board.Mar 1 2022, 8:19 PM
DVrandecic closed subtask T291022: Validators for user-defined types can be defined and linked as Resolved.Mar 8 2022, 5:20 PM
DVrandecic closed subtask T291023: Instances of user-defined types can be entered using the default component as Resolved.
DVrandecic closed subtask T291028: Instances of a user-defined type which should not validate indeed do not validate as Resolved.Mar 8 2022, 5:24 PM
DVrandecic closed this task as Resolved.Mar 8 2022, 5:31 PM
Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL