Page MenuHomePhabricator
Create Task
Maniphest T275941

Extend the system to support generated instances of Z4/ZTypes by parameterised functions ("Generic types")
Closed, ResolvedPublic
Actions

Description

We introduce generic types. This requires the following tasks:

  • functions that take types as an argument and return a type can be implemented and evaluated (the result of such a function call is called a generic type)
  • a function call can be used as the type of an instance (i.e. instances of generic types can be created manually)
  • functions that take types as an argument and return a function can be implemented and evaluated (the result of such a function call is called a generic function)
  • functions created by a function can be evaluated (i.e. generic functions can be called)
  • instance validation (i.e. generic functions can be used as validators for generic types,)
  • instance validation works (i.e. I cannot store an instance of a generic type that does not pass validation)
  • instances of generic types are displayed correctly in the UX
  • functions using generic types as their input or output types can be defined and implemented

This goes hand in hand with changing the data-model to the full data model, in particular:

  • change Z10/List from a type to a function taking a type
  • change Z8/Function from a type to a function taking a list of types and a type
  • change Pair to take two types (note that this is currently on Z22, needs to be updated first)
  • update Z4K2 to take a list of Z3s, Z4K3 to the proper Z8, Z8K1 to a list of Z17, Z8K2 a list of Z20, Z8K3 a list of Z16, Z12K1 to Z10(Z11), Z22K1 to Z10(Z21), Z50K1 to Z10(Z3)
  • the builtin functions need to change their signatures as well

Once the move to Z8 is done, we can significantly tighten the validation of Z7s. Especially, in a composition or function call,

  • every argument with a literal should be compatible with that literal
  • every argument with a function call should be compatible with the return type of that function call
  • every argument with a function reference should be compatible with that function reference

Related Objects
Search...

StatusSubtypeAssignedTask
 OpenNoneT278321 Provide a special page listing invalid ZObjects
 OpenNoneT278318 Let users validate an unstored ZObject / edit on a ZObject
 StalledNoneT269177 ZObject DAO should have a isWellFormed method
 ResolvedcmassaroT260861 Use the orchestrator/evaluator to validate instances of each Z4/Type using on-wiki defined Z8/Functions instead of hard-coded
OpenNoneT278316 Provide a validation API endpoint for arbitrary ZObjects from both MediaWiki and the orchestrator
 OpenNoneT292240 Save Un- (or Under-) Validated ZObjects, Validate Asynchronously via Orchestrator, Then Annotate ZObjects As Valid or Not
 OpenNoneT278325 Store that a page contains an invalid ZObject in a tracking table
 OpenNoneT278320 Allow to store an invalid ZObject explicitly, so we can have failure examples for Validator functions' Testers
 OpenNoneT294045 Create a "Validate" Endpoint in Orchestrator
 DuplicateNoneT273125 Migrate hard-coded validators to validation defined on-wiki
 OpenNoneT278319 Provide functionality for users to trigger a re-validation of a stored object
 ResolvedcmassaroT290898 Implement (De)Serialization for Generic/Compound Types
 OpenNoneT287608 Reconsider dropping Nothing and Unit in favor of Maybe
 ResolvedNoneT290119 Phase η root task
 ResolvedNoneT290118 User-defined types work with validation
 ResolvedcmassaroT288555 Support serialisation/deserialisation of user-defined types
 ResolvedcmassaroT287263 Deserialize Objects in Evaluator Based on Z7K1.Z8K2
 ResolvedNoneT275941 Extend the system to support generated instances of Z4/ZTypes by parameterised functions ("Generic types")
 ResolvedgenghT277000 Validate a Z7/Function call in the wiki
 ResolvedgenghT281386 Use the formal ZObject validation definitions from the function-schemata repo in the ZObjectFactory validation code
 DeclinedLindsaykwardellT282745 Add function-schemata to frontend in order to remedy hybrid forms
 ResolvedLindsaykwardellT282816 Use canonicalizer to display JSON
 ResolvedcmassaroT284474 Add tests for normalize/canonicalize code in frontend.
 ResolvedcmassaroT284764 Fix Canonicalization Code in Frontend to Handle Z6s That Masquerade as Z9s
 ResolvedNoneT291033 A function call used as an argument should validate its return type against the expected type of the argument
 ResolvedNoneT291034 Every argument of a function call with a literal or reference should be of a type compatible for that argument
 ResolvedgenghT287700 Make error generation code produce an understandable result when called with non-existent arguments
 ResolvedcmassaroT291032 Arguments taking a function should validate functions as values
 ResolvedNoneT291040 Generic functions
 InvalidNoneT291037 Function model: update functions to the new generic types
 InvalidgenghT291038 Function model: updates to the data model to implement generic types
 ResolvedDVrandecicT287196 Update Pre-Generic Function Model
 ResolvedDVrandecicT287195 Function model: Z21 should be updated to be the null value of Unit
 ResolvedDVrandecicT287194 Function model: Z8K5 is a Z8/Function not a Z6/String, regardless of what our code says
 ResolvedSimoneThisDotT303302 Validate that the UX works with typed list for core types (e.g. Z4 has a typed list of Z3s)
 ResolvedSimoneThisDotT304101 Change the Type UX so that it works (viewing/creating/editing) with a typed list of Z3s for Z4K2
ResolvedJKiesermanT303303 Change the pre-defined core types to use typed lists and not general lists
 ResolvedNoneT291039 Functions using generic types as input types or output type can be defined and implemented
 ResolvedNoneT291045 Function created by a generic function call can be evaluated
 ResolvedJdforrester-WMFT291046 Generic functions can be evaluated
 ResolvedNoneT291047 Generic functions can be implemented
 ResolvedNoneT291048 Generic functions can be defined
 DeclinedNoneT291036 Function model: Z8 should change from a type to a function taking a type and a list of types and returning a type
 ResolvedSimoneThisDotT291041 Instances of a generic type are displayed correctly
 ResolvedSimoneThisDotT291042 Instances of generic types can be edited
 ResolvedcmassaroT291044 Instances of generic types are being validated
 ResolvedcmassaroT285260 Orchestrator Top-Level Validation Should Check Z1K1
 ResolvedSimoneThisDotT297244 Let front-end users create and edit instances of any generic type
 ResolvedSimoneThisDotT291043 Instances of generic typed lists can be created
 ResolvedcmassaroT266241 Normalizer and canonicalizer should deal with local and global keys
 ResolvedcmassaroT289681 Composition creating a type doesn't evaluate
 ResolvedBUG REPORTJdforrester-WMFT292890 Trying to create a Z14 throws "Cannot read properties of undefined (reading 'filter')" in Vue code
 ResolvedSimoneThisDotT295470 Change the type search API to allow users to search for functions returning a type in addition to instances of that type
 ResolvedgenghT262089 Store type identity output in wikilambda_zobject_labels table
ResolvedgenghT297925 Change object search API to optionally include functions' return types as the 'type' filter
 ResolvedcmassaroT286975 Make it possible to define the Typed List function fully
 ResolvedcmassaroT287102 Resolve Z18s Wherever They Occur
 ResolvedJdforrester-WMFT291049 Function that takes a type and returns a type can be evaluated
 ResolvedDVrandecicT291050 Functions that take a type and return a type can be implemented
 ResolvedDVrandecicT291051 Functions that take a type and return a type can be defined
 ResolvedJdforrester-WMFT293663 Fix instancePath vs. dataPath in function-schemata, Add Tests
 ResolvedSimoneThisDotT291023 Instances of user-defined types can be entered using the default component
 ResolvedJdforrester-WMFT291029 Instances of a user-defined type can be edited
 ResolvedDVrandecicT291025 Make it possible to define and implement functions using user-defined types as output or an input type
 ResolvedNoneT291028 Instances of a user-defined type which should not validate indeed do not validate
 ResolvedNoneT273124 Use evaluation for validation
 ResolvedcmassaroT260321 Allow users to trigger function calls for built-in functions (orchestrator-only)
 ResolvedDVrandecicT261964 Agree on architecture for first evaluation engine
 ResolvedLindsaykwardellT280558 Normalize Inputs to Orchestrator
 ResolvedarthurlorenziT275095 Move normalization and canonicalization code to function-schemata
 ResolvedNoneT262770 Normalize ZObjects
 InvalidNoneT280559 Retrieve Function Signature from Orchestrator
 ResolvedcmassaroT282843 Hook up orchestrator to the evaluator and pass through appropriately-dereferenced Z7 calls
 ResolvedcmassaroT271762 Create initial Function Evaluator service
 ResolvedcmassaroT269697 Turn Function Evaluator into a service
 ResolvedcmassaroT269698 Make Function Evaluator work async
 ResolvedcmassaroT272630 Define interface for the function-evaluator
 ResolvedJdforrester-WMFT276478 Provide "semantically peel-able" list of programming languages that we allow
 ResolvedcmassaroT273515 Create Execution Environments for Supported Languages
 ResolvedcmassaroT273517 Create Execution Environment for Python
 ResolvedcmassaroT275944 Create Execution Environment for JavaScript
 ResolvedNoneT261470 Sandboxing and monitoring of evaluations
 ResolvedSimoneThisDotT291022 Validators for user-defined types can be defined and linked
 ResolvedSimoneThisDotT291021 Make the UX for creating a user-defined type straightforward
 ResolvedSimoneThisDotT292891 Provide a custom UX for Z4/Type
 ResolvedJdforrester-WMFT291031 Validator implementations can call Z101/object validator, and then add to it
 ResolvedcmassaroT262997 Validate the values on the keys on a user-defined type
 ResolvedgenghT287734 Replace wikilambda extension php validation code with call to schemata validation
 ResolvedcmassaroT276369 Create PHP bindings for function-schemata
 ResolvedJdforrester-WMFT293831 WikiLambda documentation should explain how to get composer dependencies installed, lest users have missing ISchemaLoader fatals
 ResolvedcmassaroT291030 Validator of a user-defined type can be implemented
 ResolvedcmassaroT291026 Let user implementations throw a user-defined error during a user-defined validation
 ResolvedNoneT291027 Users can create error types
 ResolvedDVrandecicT293423 Create a function that turns an error type into a type
 ResolvedcmassaroT289687 Allow users to create instances of errors in composition
 ResolvedarthurlorenziT290346 Function model: Change the signature of validators from Type -> List to Type -> Type (pass-through)
 Resolved• AdesojiThisDotT293742 Navigate to "provide tests" after user define function, instead than to the newly defined object

Event Timeline

DVrandecic created this task.Feb 27 2021, 12:49 AM
Restricted Application added a subscriber: Aklapper. · View Herald TranscriptFeb 27 2021, 12:49 AM
DVrandecic triaged this task as High priority.Feb 27 2021, 12:49 AM
DVrandecic raised the priority of this task from High to Unbreak Now!.
Kemsguy added a subscriber: Kemsguy.Mar 2 2021, 3:48 AM
thiemowmde lowered the priority of this task from Unbreak Now! to Needs Triage.Mar 2 2021, 8:43 AM
thiemowmde added a subscriber: thiemowmde.

@DVrandecic A priority as extreme as "unbreak now" for an otherwise normal task appears to be a mistake. See https://www.mediawiki.org/wiki/Phabricator/Project_management#Priority_levels.

DVrandecic moved this task from Phase ζ to Phase η – Generic types on the Abstract Wikipedia team board.Mar 10 2021, 12:50 AM
DVrandecic edited projects, added Abstract Wikipedia team (Phase η – Generic types); removed Abstract Wikipedia team (Phase ζ).
DVrandecic triaged this task as High priority.Apr 7 2021, 5:14 AM
Jdforrester-WMF added a parent task: T287263: Deserialize Objects in Evaluator Based on Z7K1.Z8K2.Jul 28 2021, 4:39 PM
DVrandecic added a parent task: T287608: Reconsider dropping Nothing and Unit in favor of Maybe.Jul 28 2021, 5:18 PM
DVrandecic added a parent task: T290119: Phase η root task.Sep 1 2021, 3:47 AM
DVrandecic updated the task description. (Show Details)Sep 1 2021, 3:57 AM
DVrandecic updated the task description. (Show Details)Sep 1 2021, 4:06 AM
ArthurPSmith added a subscriber: ArthurPSmith.Sep 10 2021, 6:05 PM

@DVrandecic I'm trying to work through an example of how, for example, a list of strings would be implemented; is there a document anywhere we have that goes into this in detail? The sticking point I'm on is what would the keys for a specific value of the generic type look like. If the generic list type function is Z9999, then its main key (Z9999K1) would be just the type of the list, right? But that specific value of the type would also have keys - for a list it has "Head" and "Tail" keys. Presumably when you do the function call with Z9999K1 = Z6 (string) then it returns a Z4 object that looks a bit like our current Z10, but with the type for key Z10K1 as Z6 instead of Z1, etc. But how would the "Z10K1" key be referred to now? That is, in this section of what is now in Z10:

"Z1K1": "Z3",
"Z3K1": "Z1",
"Z3K2": "Z10K1"
"Z3K3": { ...

the function call would return an object like this but with "Z1" -> "Z6", but what happens to the "Z10K1" piece? Just "K1"? Something else? We need some way to specify the keys for the actual instance objects of this type!

ArthurPSmith added a comment.Sep 13 2021, 7:30 PM

Of course this is a very general problem - how do you supply the arguments to a function that is returned from a function call (or perhaps just constructed in place), rather than being a persistent ZObject with an id? Do we have any kind of general solution for this now? I was looking through documentation on metawiki and couldn't find anything...

DVrandecic removed a subtask: T291035: Function model: Z10 should be a function that takes a type and returns a type.Sep 15 2021, 1:28 AM
DVrandecic removed a subtask: T291036: Function model: Z8 should change from a type to a function taking a type and a list of types and returning a type.
DVrandecic removed a subtask: T291037: Function model: update functions to the new generic types.Sep 15 2021, 1:33 AM
DVrandecic removed a subtask: T291039: Functions using generic types as input types or output type can be defined and implemented.
Jdforrester-WMF added a parent task: T289796: Function model: Create a type for a return value/meta-data blob.Sep 15 2021, 9:15 PM
Jdforrester-WMF added a subtask: T277000: Validate a Z7/Function call in the wiki.Sep 15 2021, 9:43 PM
Jdforrester-WMF renamed this task from Generic types to Extend the system to support generated instances of Z4/ZTypes by parameterised functions ("Generic types").Jan 24 2022, 6:26 PM
Jdforrester-WMF moved this task from Incoming to QA / Ready to close on the Abstract Wikipedia team (Phase η – Generic types) board.Mar 1 2022, 7:03 PM
Jdforrester-WMF closed subtask T277000: Validate a Z7/Function call in the wiki as Resolved.
SimoneThisDot closed subtask T291041: Instances of a generic type are displayed correctly as Resolved.Mar 4 2022, 2:55 PM
DVrandecic closed subtask T291032: Arguments taking a function should validate functions as values as Resolved.Mar 8 2022, 5:22 PM
DVrandecic closed subtask T291040: Generic functions as Resolved.
DVrandecic closed subtask T291033: A function call used as an argument should validate its return type against the expected type of the argument as Resolved.Mar 8 2022, 5:25 PM
DVrandecic closed subtask T291034: Every argument of a function call with a literal or reference should be of a type compatible for that argument as Resolved.Mar 8 2022, 5:28 PM
DVrandecic closed this task as Resolved.Mar 8 2022, 5:32 PM
Jdforrester-WMF removed a parent task: T289796: Function model: Create a type for a return value/meta-data blob.Mar 8 2022, 10:42 PM
Content licensed under Creative Commons Attribution-ShareAlike 3.0 (CC-BY-SA) unless otherwise noted; code licensed under GNU General Public License (GPL) or other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL