Page MenuHomePhabricator

Implement a comparison algorithm for automated testing which can compare different MathML outputs
Closed, ResolvedPublic

Description

Implement a comparison algorithm which can compare different MathML outputs for automated testing on Jenkins.

Event Timeline

Collection of Information sources to realize a comparison algorithm:

  • Performance_Metrics_and_Their_Extraction_Methods_for_Audio_Rendered_Mathematic : This checks three methods, Baseline Structure Tree Alignment, Syntax Tree Alignment, MathML Tree Edit Distance
  • Improving the Representation and Conversion of Mathematical Formulae by Considering their Textual Context:
  • MathMLBen: uses modified algorithm of M. Pawlik and N. Augsten. RTED
  • MathPipe: Seems produce (and compare?) png outputs, i think this would be suitable for research-type-evaluation maybe, but for a evaluation during development the pipeline is too much different from the current testing-setup.
  • Visual comparison through rendered HTML, all tests have the option to create a HTML composition of MathML from the sources Mathoid, LaTeXML and TexVC(PHP), it might be enough to have this files and read them or display them directly instead of running the complete MathPipe process again.

Open Questions:

  • What would be the baseline for comparisons in scientific comparisons ?

Change 884960 had a related patch set uploaded (by Stegmujo; author: Stegmujo):

[mediawiki/extensions/Math@master] Add mechanism to compare MathML during testing for development.

https://gerrit.wikimedia.org/r/884960

Change 885342 had a related patch set uploaded (by Stegmujo; author: Stegmujo):

[mediawiki/extensions/Math@master] Moved the Util classes to source.

https://gerrit.wikimedia.org/r/885342

Change 884960 abandoned by Stegmujo:

[mediawiki/extensions/Math@master] Add mechanism to compare MathML during testing for development.

Reason:

based on other changeset

https://gerrit.wikimedia.org/r/884960

Algorithm implemented for this one, is now for automated testing. Scientific algorithm will move to another task.

Change 885342 abandoned by Stegmujo:

[mediawiki/extensions/Math@master] Moved the Util classes to source.

Reason:

not necessary

https://gerrit.wikimedia.org/r/885342

Stegmujo renamed this task from Implement a comparison algorithm which can compare different MathML outputs for scientific results to Implement a comparison algorithm for auomatated testing which can compare different MathML outputs.Feb 3 2023, 11:29 AM
Stegmujo updated the task description. (Show Details)
Stegmujo updated the task description. (Show Details)

Change 886094 had a related patch set uploaded (by Stegmujo; author: Stegmujo):

[mediawiki/extensions/Math@master] Insert MathML-Comparator features in MathML-Tests

https://gerrit.wikimedia.org/r/886094

Change 886094 merged by jenkins-bot:

[mediawiki/extensions/Math@master] Insert MathML-Comparator features in MathML-Tests

https://gerrit.wikimedia.org/r/886094

Stegmujo renamed this task from Implement a comparison algorithm for auomatated testing which can compare different MathML outputs to Implement a comparison algorithm for automated testing which can compare different MathML outputs.Mar 1 2023, 12:51 PM