Expose `modules` and `jsconfigvars` from Parsoid's parse API when converting wikitext
Open, Stalled, LowPublic8 Estimated Story Points
Actions

Assigned To

None

Authored By

	Esanders
	Jul 9 2016, 5:35 PM

Description

Currently a lot of extensions will conditionally load modules based on the content of the page, e.g. only load math code if equations are present, or only load MultimediaViewer if images are present.

When VE is used the content of the page will change asynchronously, and these modules will not be present if an equation or image is added, for example. In some cases (e.g. math) the module is actually loaded by VE, so the problem is bypassed, but others (e.g. MMV) aren't required in VE, but are required after save.

Ideally we could run the same content-checking hooks asynchronously and load any modules that are required automatically.

Related Objects
Search...

Status	Subtype	Assigned	Task
Open		None	T132023 VisualEditor support for editing inside CollaborationKit
Open	Feature	None	T138636 Allow using VisualEditor on Special:MassMessage
Open		None	T138642 VisualEditor should provide a clean integrated VE/WT editor widget that can be integrated into any context
Open		None	T130400 (Actually) Add wikitext support for citoid for automatic reference insertion
Open		None	T90864 Help VisualEditor users find the wikitext "Save" button
Open		None	T171974 Improve and consolidate our unified editing platform so that it's great on all devices
Open		None	T104479 Provide a modern wikitext editor
Open		None	T142523 Provide a second version of a beta modern wikitext editor integrated into the visual editor
Stalled		None	T139852 Expose `modules` and `jsconfigvars` from Parsoid's parse API when converting wikitext
Resolved		ssastry	T162399 Parsoid doesn't add JS modules to <head> in its output

Event Timeline

Esanders created this task.Jul 9 2016, 5:35 PM

Restricted Application added subscribers: Zppix, Aklapper. · View Herald TranscriptJul 9 2016, 5:35 PM

Could we perhaps do a fake page render after save in the VE API, and send back a list of modules to load? We have a similar hack for gathering up the edit page checkboxes for the save dialog.

I'm not sure what this is about. API action=parse can already return modules, which are needed to display the page correctly/fully. Extensions can add modules to ParserOutput in PHP with addModules(). Or if they're checking it client-side from a small "bootstrap" module on page load, they should instead use the 'wikipage.content' mw.hook, and other extensions that replace content on the page (like VE) should fire that hook (I think VE already does).

Krinkle triaged this task as Medium priority.Jul 12 2016, 7:00 PM

Krinkle moved this task from Inbox to Backlog on the MediaWiki-ResourceLoader board.

Jdforrester-WMF changed the task status from Open to Stalled.Jul 12 2016, 7:23 PM

I agree with @matmarex. Extensions that lazy-load modules based on server-side checks would be calling addModules() accordingly and be included in the API response that VisualEditor gets. Relevant code:

/modules/ve-mw/init/targets/ve.init.mw.DesktopArticleTarget.js#L878
/modules/ve-mw/init/ve.init.mw.ArticleTarget.js#L446-L467

ve.init.mw.DesktopArticleTarget.js

ve.init.mw.DesktopArticleTarget.prototype.saveComplete = function ( /* .., */ modules, jsconfigvars ) {
	// ..
		mw.config.set( jsconfigvars );
		mw.loader.load( modules );

Extensions, site-scripts and user-scripts that perform these checks client-side typically load a minimalistic module unconditionally on every page that performs its check from mw.hook( 'wikipage.content' ) handler, which VisualEditor re-triggers after save.

In this case I am using RESTBase to convert wikitext to HTML (to show preview in the new wikitext editor).

The client-side hooks would still work as long as VE triggers them. I'm not sure about the server-side ones. I imagine Parsoid won't reach out to the API for this stuff in most cases. And even when it does, it would probably ignore the modules and jsconfigvars` from the API response. Re-tagging as a Parsoid issue.

Krinkle renamed this task from Create a system for registering modules to load if content changes asynchronously to Expose `modules` and `jsconfigvars` from Parse API in Parsoid when converting wikitext.Nov 18 2016, 8:27 PM

Parsoid adds module styles to the page (see ApiRequest code and DOMProcessor code ) .

What endpoint are you guys talking about where this info is not showing up?

transform/wikitext/to/html

In T139852#2807447, @Esanders wrote:

transform/wikitext/to/html

I think I know what is going on. The modules are added to the head and you request a parse with bodyOnly => the header is stripped. Can't you process this without bodyOnly? I don't remember the reasoning why that flag was introduced. /cc @GWicke

But, anyway, I think Parsoid's output doesn't expose jsconfigvars even though it requests it from the MediaWiki API.

TheDJ added a parent task: T147702: NWE's 'Show preview' doesn't load in new modules based on added content, e.g. gallery/maps.Dec 16 2016, 9:51 AM

Arlolra mentioned this in T161278: Add default gadget styling to Parsoid's output.Mar 24 2017, 12:11 AM

ssastry mentioned this in T162360: Differences in Parsoid HTML compared to PHP parser output breaks javascript that is tailored ot the PHP parser output.Apr 6 2017, 2:12 PM

In T139852#2807689, @ssastry wrote:

But, anyway, I think Parsoid's output doesn't expose jsconfigvars even though it requests it from the MediaWiki API.

This part is now covered by T162399 as a separate ticket.

Is there anything to do in this ticket now since Parsoid is already adding modules to the <head> and the issue seems to be that VE is requesting body-only and thus not getting the information?

ssastry mentioned this in T162399: Parsoid doesn't add JS modules to <head> in its output.Apr 6 2017, 7:31 PM

Jdforrester-WMF moved this task from To Triage to External and Administrivia on the VisualEditor board.Jun 28 2017, 12:00 PM

Jdforrester-WMF set the point value for this task to 0.

@Jdforrester-WMF Note that in T139852#3160428 I am saying that this is a VE issue, not a Parsoid one. The Parsoid piece is a separate ticket.

Ah, OK.

Jdforrester-WMF renamed this task from Expose `modules` and `jsconfigvars` from Parse API in Parsoid when converting wikitext to Expose `modules` and `jsconfigvars` from Parsoid's parse API when converting wikitext.Jun 28 2017, 2:25 PM

Jdforrester-WMF lowered the priority of this task from Medium to Low.

Jdforrester-WMF added a subtask: T162399: Parsoid doesn't add JS modules to <head> in its output.

Jdforrester-WMF removed a project: Parsoid.

Jdforrester-WMF added a project: Technical-Debt.

Jdforrester-WMF changed the point value for this task from 0 to 8.

Jdforrester-WMF moved this task from External and Administrivia to TR1: Releases on the VisualEditor board.

Our workaround in T147702 re-implements expandModuleNames to extract the style modules from the link tag.

Izno added a parent task: T142523: Provide a second version of a beta modern wikitext editor integrated into the visual editor.Jun 2 2021, 8:46 PM

Izno removed a parent task: T147702: NWE's 'Show preview' doesn't load in new modules based on added content, e.g. gallery/maps.Jun 2 2021, 8:49 PM

Arlolra closed subtask T162399: Parsoid doesn't add JS modules to <head> in its output as Resolved.Jul 30 2021, 10:20 PM