Page MenuHomePhabricator

Split out the test suite for other evaluation engines
Open, LowestPublic

Description

We should define a format which we use to offer a test suite for evaluation engines.

Basically, inputs and expected outputs.

This can be used then for other evaluation engines besides our own, but we should also tie it up with out own evaluation engine, i.e. the function-orchestrator, and use it to check it.

For now, this should be living in function-schemata.

Event Timeline

Will this test suite also contain the objects needed to evaluate the inputs (functions, types, etc.), or are those expected to live somewhere else (e.g. WikiLambda’s data/ directory)?

DVrandecic renamed this task from Create a test suite for evaluation engines to Split out the test suite for other evaluation engines.Feb 24 2021, 5:15 PM
DVrandecic moved this task from To triage to Phase ε on the Abstract Wikipedia team board.
DVrandecic moved this task from Phase ε to Phase δ on the Abstract Wikipedia team board.
DVrandecic triaged this task as Lowest priority.Apr 7 2021, 4:50 AM