Page MenuHomePhabricator
Create Task
Maniphest T266241

Normalizer and canonicalizer should deal with local and global keys
Closed, ResolvedPublic
Actions

Description

Normalization and canonicalization should be extended to deal with local and global keys.

In short, both the normal and canonical representations MUST use global keys when possible and use local keys only when there are no global keys.

Denny to write the spec, and then have it discussed and agreed on, and after agreement hand over for implementation.

Details

SubjectRepoBranchLines +/-
Normalize local keys to global keysmediawiki/extensions/WikiLambdamaster+28 -4
Customize query in gerrit

Related Objects
Search...

StatusSubtypeAssignedTask
 OpenNoneT278321 Provide a special page listing invalid ZObjects
 OpenNoneT278318 Let users validate an unstored ZObject / edit on a ZObject
 StalledNoneT269177 ZObject DAO should have a isWellFormed method
 ResolvedcmassaroT260861 Use the orchestrator/evaluator to validate instances of each Z4/Type using on-wiki defined Z8/Functions instead of hard-coded
OpenNoneT278316 Provide a validation API endpoint for arbitrary ZObjects from both MediaWiki and the orchestrator
 OpenNoneT292240 Save Un- (or Under-) Validated ZObjects, Validate Asynchronously via Orchestrator, Then Annotate ZObjects As Valid or Not
 OpenNoneT278325 Store that a page contains an invalid ZObject in a tracking table
 OpenNoneT278320 Allow to store an invalid ZObject explicitly, so we can have failure examples for Validator functions' Testers
 OpenNoneT294045 Create a "Validate" Endpoint in Orchestrator
 DuplicateNoneT273125 Migrate hard-coded validators to validation defined on-wiki
 OpenNoneT278319 Provide functionality for users to trigger a re-validation of a stored object
 ResolvedcmassaroT290898 Implement (De)Serialization for Generic/Compound Types
 ResolvedJdforrester-WMFT286974 Make it possible to implement Map function
 DeclinedNoneT287608 Reconsider dropping Nothing and Unit in favor of Maybe
 ResolvedNoneT290119 Phase η root task
 ResolvedNoneT290118 User-defined types work with validation
 ResolvedcmassaroT288555 Support serialisation/deserialisation of user-defined types
 ResolvedcmassaroT287263 Deserialize Objects in Evaluator Based on Z7K1.Z8K2
 ResolvedNoneT275941 Extend the system to support generated instances of Z4/ZTypes by parameterised functions ("Generic types")
 ResolvedgenghT277000 Validate a Z7/Function call in the wiki
 ResolvedgenghT281386 Use the formal ZObject validation definitions from the function-schemata repo in the ZObjectFactory validation code
 DeclinedLindsaykwardellT282745 Add function-schemata to frontend in order to remedy hybrid forms
 ResolvedLindsaykwardellT282816 Use canonicalizer to display JSON
 ResolvedcmassaroT284474 Add tests for normalize/canonicalize code in frontend.
 ResolvedcmassaroT284764 Fix Canonicalization Code in Frontend to Handle Z6s That Masquerade as Z9s
 ResolvedNoneT291033 A function call used as an argument should validate its return type against the expected type of the argument
 ResolvedNoneT291034 Every argument of a function call with a literal or reference should be of a type compatible for that argument
 ResolvedcmassaroT291032 Arguments taking a function should validate functions as values
 ResolvedNoneT291040 Generic functions
 InvalidNoneT291037 Function model: update functions to the new generic types
 InvalidgenghT291038 Function model: updates to the data model to implement generic types
 ResolvedNoneT291039 Functions using generic types as input types or output type can be defined and implemented
 ResolvedNoneT291045 Function created by a generic function call can be evaluated
 ResolvedJdforrester-WMFT291046 Generic functions can be evaluated
 ResolvedNoneT291047 Generic functions can be implemented
 ResolvedNoneT291048 Generic functions can be defined
 DeclinedNoneT291036 Function model: Z8 should change from a type to a function taking a type and a list of types and returning a type
 ResolvedSimoneThisDotT291041 Instances of a generic type are displayed correctly
 ResolvedSimoneThisDotT291042 Instances of generic types can be edited
 ResolvedcmassaroT291044 Instances of generic types are being validated
 ResolvedSimoneThisDotT297244 Let front-end users create and edit instances of any generic type
 ResolvedSimoneThisDotT291043 Instances of generic typed lists can be created
 ResolvedcmassaroT266241 Normalizer and canonicalizer should deal with local and global keys
 ResolvedJdforrester-WMFT293663 Fix instancePath vs. dataPath in function-schemata, Add Tests
 ResolvedSimoneThisDotT291023 Instances of user-defined types can be entered using the default component
 ResolvedJdforrester-WMFT291029 Instances of a user-defined type can be edited
 ResolvedDVrandecicT291025 Make it possible to define and implement functions using user-defined types as output or an input type
 ResolvedNoneT291028 Instances of a user-defined type which should not validate indeed do not validate
 ResolvedNoneT273124 Use evaluation for validation
 ResolvedcmassaroT260321 Allow users to trigger function calls for built-in functions (orchestrator-only)
 ResolvedDVrandecicT261964 Agree on architecture for first evaluation engine
 ResolvedLindsaykwardellT280558 Normalize Inputs to Orchestrator
 ResolvedarthurlorenziT275095 Move normalization and canonicalization code to function-schemata
 ResolvedNoneT262770 Normalize ZObjects
 InvalidNoneT280559 Retrieve Function Signature from Orchestrator
 ResolvedcmassaroT282843 Hook up orchestrator to the evaluator and pass through appropriately-dereferenced Z7 calls
 ResolvedcmassaroT271762 Create initial Function Evaluator service
 ResolvedcmassaroT269697 Turn Function Evaluator into a service
 ResolvedcmassaroT269698 Make Function Evaluator work async
 ResolvedcmassaroT272630 Define interface for the function-evaluator
 ResolvedJdforrester-WMFT276478 Provide "semantically peel-able" list of programming languages that we allow
 ResolvedcmassaroT273515 Create Execution Environments for Supported Languages
 ResolvedcmassaroT273517 Create Execution Environment for Python
 ResolvedcmassaroT275944 Create Execution Environment for JavaScript
 ResolvedNoneT261470 Sandboxing and monitoring of evaluations
 ResolvedSimoneThisDotT291022 Validators for user-defined types can be defined and linked
 ResolvedSimoneThisDotT291021 Make the UX for creating a user-defined type straightforward
 ResolvedSimoneThisDotT292891 Provide a custom UX for Z4/Type
 ResolvedJdforrester-WMFT291031 Validator implementations can call Z101/object validator, and then add to it
 ResolvedcmassaroT262997 Validate the values on the keys on a user-defined type
 ResolvedgenghT287734 Replace wikilambda extension php validation code with call to schemata validation
 ResolvedcmassaroT276369 Create PHP bindings for function-schemata
 ResolvedJdforrester-WMFT293831 WikiLambda documentation should explain how to get composer dependencies installed, lest users have missing ISchemaLoader fatals
 ResolvedcmassaroT291030 Validator of a user-defined type can be implemented
 ResolvedcmassaroT291026 Let user implementations throw a user-defined error during a user-defined validation
 ResolvedNoneT291027 Users can create error types
 ResolvedDVrandecicT293423 Create a function that turns an error type into a type
 ResolvedcmassaroT289687 Allow users to create instances of errors in composition
 ResolvedarthurlorenziT290346 Function model: Change the signature of validators from Type -> List to Type -> Type (pass-through)
 Resolved• AdesojiThisDotT293742 Navigate to "provide tests" after user define function, instead than to the newly defined object

Event Timeline

DVrandecic created this task.Oct 22 2020, 2:03 PM
DVrandecic moved this task from To Triage to Phase δ on the Abstract Wikipedia team board.Oct 22 2020, 6:33 PM
DVrandecic edited projects, added Abstract Wikipedia team (Phase δ); removed Abstract Wikipedia team.
Jdforrester-WMF added a parent task: T262770: Normalize ZObjects.Oct 22 2020, 6:33 PM
gerritbot added a comment.Oct 26 2020, 4:12 PM

Change 636456 had a related patch set uploaded (by DVrandecic; owner: DVrandecic):
[mediawiki/extensions/WikiLambda@master] Normalize local keys to global keys

https://gerrit.wikimedia.org/r/636456

gerritbot added a project: Patch-For-Review.Oct 26 2020, 4:12 PM
gerritbot added a comment.Oct 26 2020, 7:24 PM

Change 636456 merged by jenkins-bot:
[mediawiki/extensions/WikiLambda@master] Normalize local keys to global keys

https://gerrit.wikimedia.org/r/636456

Maintenance_bot removed a project: Patch-For-Review.Oct 26 2020, 8:10 PM
Jdforrester-WMF added a project: function-orchestrator.Mar 24 2021, 10:23 PM
DVrandecic moved this task from Phase δ to Phase ζ on the Abstract Wikipedia team board.Apr 7 2021, 4:46 AM
DVrandecic edited projects, added Abstract Wikipedia team (Phase ζ); removed Abstract Wikipedia team (Phase δ).
Jdforrester-WMF removed a parent task: T262770: Normalize ZObjects.May 6 2021, 4:19 PM
DVrandecic triaged this task as High priority.Jun 2 2021, 4:43 PM
DVrandecic lowered the priority of this task from High to Medium.
DVrandecic claimed this task.Jun 23 2021, 4:47 PM
DVrandecic updated the task description. (Show Details)
DVrandecic added a comment.Jul 14 2021, 5:01 AM

Here's a draft for local keys:

https://meta.wikimedia.org/wiki/Abstract_Wikipedia/Local_keys

Jdforrester-WMF removed DVrandecic as the assignee of this task.Jul 14 2021, 4:40 PM
DVrandecic mentioned this in T286974: Make it possible to implement Map function.Jul 20 2021, 2:21 AM
DVrandecic moved this task from Phase ζ to Phase η – Generic types on the Abstract Wikipedia team board.Aug 11 2021, 10:29 PM
DVrandecic edited projects, added Abstract Wikipedia team (Phase η – Generic types); removed Abstract Wikipedia team (Phase ζ).
Lindsaykwardell subscribed.Aug 26 2021, 3:35 PM

What's left to do on this task?

Jdforrester-WMF added a subtask: T291043: Instances of generic typed lists can be created.Sep 15 2021, 9:48 PM
Jdforrester-WMF removed a subtask: T291043: Instances of generic typed lists can be created.
Jdforrester-WMF added a parent task: T291043: Instances of generic typed lists can be created.
DVrandecic assigned this task to cmassaro.Nov 3 2021, 4:26 PM
DVrandecic moved this task from Incoming to QA / Ready to close on the Abstract Wikipedia team (Phase η – Generic types) board.
cmassaro added a comment.Dec 7 2021, 3:57 PM

We still need to implement the "local keys as shorthand" part described in Denny's proposal.

Can repurpose this task or create a new one. I prefer the latter so we can close this issue and address the shorthand part later--I don't think it blocks this phase.

DVrandecic closed this task as Resolved.Dec 7 2021, 5:29 PM
DVrandecic mentioned this in T297245: Augment local keys to global keys if possible.Dec 7 2021, 10:14 PM

I split out T297245 as a new task, "local keys as shorthand", so this part is not part of this task anymore.

Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL · Credits