Update to MathJax 3
Closed, DeclinedPublic
Actions

Assigned To

Authored By

	Physikerwelt
	Nov 6 2019, 11:21 AM

Description

Mathoid currently uses MathJax version 2 to convert the LaTeX dialect texvc to standard HTML (nativeHTML) and SVG fallback images. Now, MathJax 3 dropped support standard HTML5, but introduced a new variant they call common HTML. However, it seems that the internal MathML representation is still available from the API.
The update will improve the experience for most users, which is a very strong argument to update. I could not figure out if the new CHTML mode works without javascript enabled in the client. I think it should, but I could not find the information.
Preliminary analysis:

verify that the page can be rendered without javascript
verify that there are no significant regressions for users using the native MathML rendering

Advantages

one-pass rendering. No external images
use upstream fixes

Disadvantages

Please add your points here.

Related Objects
Search...

Status	Subtype	Assigned	Task
Declined		Physikerwelt	T237516 Update to MathJax 3
Declined		None	T252389 Prepare Math extension for MathJax
Resolved		Physikerwelt	T252390 Implement check endpoint using the MW:Rest-API
Declined		None	T253613 Improve FactoryArgTestTrait
Resolved		Jdforrester-WMF	T254031 Enable mediawiki-quibble-apitests-vendor-docker for extension Math
Duplicate		None	T255807 Implement formula endpoint using the MW:Rest-API
Duplicate		None	T255808 Implement render endpoint using the MW:Rest-API
Resolved		Tgr	T255782 Technical Advice: How to output binary (image) data using the MediaWiki\Rest API?
Resolved		Physikerwelt	T270601 Expose texvcinfo warnings in mathoids complete endpoint
Resolved		• Pchelolo	T274436 Enable RESTbaseless validation in wikibase
Open	Feature	None	T30258 texvc should support commutative diagrams via XY-packet
Resolved		Physikerwelt	T74240 Remove PNG only rendering mode
Resolved		• mobrovac	T71702 Support PNG output for mathoid
Declined		Physikerwelt	T78056 Storing PNG images retrieved from mathoid
Declined		Physikerwelt	T100514 use binary data rather than text data for math_mathml, math_html and math_svg fields
Resolved		Physikerwelt	T94379 Travis PNG looks different from vagrant png

Event Timeline

Physikerwelt created this task.Nov 6 2019, 11:21 AM

Restricted Application added a subscriber: Aklapper. · View Herald TranscriptNov 6 2019, 11:21 AM

Physikerwelt added a project: Mathoid.Nov 6 2019, 11:31 AM

Physikerwelt updated the task description. (Show Details)

Physikerwelt triaged this task as Low priority.Nov 6 2019, 11:49 AM

• mobrovac added projects: RESTBase-API, Platform Team Workboards (Clinic Duty Team).Nov 6 2019, 12:18 PM

• mobrovac moved this task from Inbox to Backlog on the Platform Team Workboards (Clinic Duty Team) board.

Physikerwelt updated the task description. (Show Details)Nov 6 2019, 12:31 PM

Physikerwelt mentioned this in T233213: XSS in Wikidata Query Service UI, DATATYPE_MATHML - CVE-2019-19329.Nov 6 2019, 12:35 PM

The deeper I investigate the situation, I get the impression that this update will be a big advancement. I can't see any disadvantages up to now.

Physikerwelt updated the task description. (Show Details)Nov 6 2019, 12:43 PM

Physikerwelt updated the task description. (Show Details)Nov 12 2019, 11:43 AM

Physikerwelt updated the task description. (Show Details)

I think the way to go forward is to introduce a new rendering mode and then phase out the current rendering mode. Otherwise regressions are too likely.

Physikerwelt added a subscriber: • Pchelolo.Nov 12 2019, 11:52 AM

Lucas_Werkmeister_WMDE mentioned this in T214980: Support mathematical formulae in Wikidata Query Service UI on all browsers.Nov 13 2019, 11:12 AM

@Physikerwelt Thank you for creating this ticket, I think this change is long overdue. What are your thoughts regarding the implementation, in particular:

does the new rendering mode still need this restbase setup? I am just asking because getting rid of this would greatly reduce the complexity and dependencies, would make it much easier for people to contribute to the development of the math extension and install it on their own servers.
as far as I know the legacy rendering mode for mhchem package is no longer supported in mathjax 3.0. In my opinion this should not block the transition to the new rendering mode because this change is also long overdue, we just have to keep in mind that it will break some mhchem formulas. I can take care of this and make sure that they will get fixed.
the new rendering mode should conserve the original LaTeX input, i.e. not have something like texvcjs (T188879). The necessary syntax modfications are done (T197925), except for those that we could not extract from the database dumps. If we want to fix those pages we need the new rendering mode assigning error categories in real time.
we should take the new rendering mode as an opportunity to discuss getting rid of "default" rendering mode and making the "default" without parameters "inline" (textstyle).

Just a warning that accessibility has changed considerably in V3. I filed a MathJax issue that has some discussion about the inaccessibility of V3 out of the box. If the output is to be accessible, MathML needs to be hidden as was done in V2 and is currently done on wikipedia pages. In V3, the way to include MathML is described here. MathJax may change it's defaults in some configurations based on the inaccessibility as V3 currently exists; definitely check the output for hidden MathML if you switch to V3.

• AMooney edited projects, added Platform Engineering (Icebox); removed Platform Team Workboards (Clinic Duty Team).Mar 13 2020, 1:34 PM

@Debenben maybe the most effective way of making progress would be a short chat on Skype on the phone. Just let me know if you are interested.

A few MathJax updates:

They have fixed the accessibility problems.
mhchem is supported in V3, although details have changed.
They just announced V3.0.5 saying they have enough confidence in it to officially announce V3 for general usage.

@SalixAlba this was scheduled for the Tirana Hackathon. With MathJax V3 the problem of whitespaces as you mentioned in T140217 might be resolved anyhow. However, with the common HTML layout, we will lose semantics and become more dependent on the features of individual browsers.

Physikerwelt mentioned this in T140217: Adjust texvcjs to prevent whitespace modifications in ce-tags.May 6 2020, 8:52 PM

Physikerwelt added a project: Wikimedia-Hackathon-2020.May 9 2020, 10:05 AM

Physikerwelt removed a project: Wikimedia-Hackathon-2020.May 11 2020, 10:07 AM

Aklapper added a project: Math.Jun 24 2020, 5:53 AM

Physikerwelt added a subtask: T30258: texvc should support commutative diagrams via XY-packet.Jul 8 2020, 11:53 AM

Physikerwelt mentioned this in T268785: IDEA: Move parallel tag parsing logic from Math to core.Nov 25 2020, 7:44 PM

He7d3r subscribed.Dec 14 2020, 5:17 PM

Physikerwelt moved this task from Inbox to ready to implement on the Mathoid board.Feb 3 2021, 12:23 PM

Xover subscribed.Jun 3 2021, 8:54 AM

@Aklapper This task is still active. There might be a different solution in the end, but I would keep it as it is for now.

Physikerwelt mentioned this in T308188: Vertical alignment of \overrightarrow with svg rendering.May 13 2022, 3:44 PM

Physikerwelt changed the task status from Open to Stalled.Jun 9 2022, 7:25 AM