Implement a comparison algorithm which can compare different MathML outputs for automated testing on Jenkins.
Description
Details
Status | Subtype | Assigned | Task | ||
---|---|---|---|---|---|
Stalled | Stegmujo | T310373 Make Mathoid Client a standalone class | |||
Open | None | T327098 Implement Math Accessibility Features necessary for Intent attribute usage | |||
Open | None | T302628 Implement native MathML rendering in Math | |||
Resolved | Stegmujo | T327393 Implement a comparison algorithm for automated testing which can compare different MathML outputs |
Event Timeline
Collection of Information sources to realize a comparison algorithm:
- Performance_Metrics_and_Their_Extraction_Methods_for_Audio_Rendered_Mathematic : This checks three methods, Baseline Structure Tree Alignment, Syntax Tree Alignment, MathML Tree Edit Distance
- Improving the Representation and Conversion of Mathematical Formulae by Considering their Textual Context:
- MathMLBen: uses modified algorithm of M. Pawlik and N. Augsten. RTED
- MathPipe: Seems produce (and compare?) png outputs, i think this would be suitable for research-type-evaluation maybe, but for a evaluation during development the pipeline is too much different from the current testing-setup.
- Visual comparison through rendered HTML, all tests have the option to create a HTML composition of MathML from the sources Mathoid, LaTeXML and TexVC(PHP), it might be enough to have this files and read them or display them directly instead of running the complete MathPipe process again.
Open Questions:
- What would be the baseline for comparisons in scientific comparisons ?
Change 884960 had a related patch set uploaded (by Stegmujo; author: Stegmujo):
[mediawiki/extensions/Math@master] Add mechanism to compare MathML during testing for development.
Change 885342 had a related patch set uploaded (by Stegmujo; author: Stegmujo):
[mediawiki/extensions/Math@master] Moved the Util classes to source.
Change 884960 abandoned by Stegmujo:
[mediawiki/extensions/Math@master] Add mechanism to compare MathML during testing for development.
Reason:
based on other changeset
Algorithm implemented for this one, is now for automated testing. Scientific algorithm will move to another task.
Change 885342 abandoned by Stegmujo:
[mediawiki/extensions/Math@master] Moved the Util classes to source.
Reason:
not necessary
Change 886094 had a related patch set uploaded (by Stegmujo; author: Stegmujo):
[mediawiki/extensions/Math@master] Insert MathML-Comparator features in MathML-Tests
Change 886094 merged by jenkins-bot:
[mediawiki/extensions/Math@master] Insert MathML-Comparator features in MathML-Tests