Installer stylesheet fails to load on 1.36/master
Closed, ResolvedPublic5 Estimated Story PointsBUG REPORT
Actions

Assigned To

Authored By

	Mainframe98
	Dec 13 2020, 11:11 AM

Description

Using rMWdbb1a9ef64604cedfd85b7c04a6b4699cad5c3c2, the installer is missing styles. Opening the console traces it to an exception throw when generating the stylesheet:

/mw-config/index.php?css=1 Wikimedia\Services\ServiceDisabledException from line 412 of mediawiki/vendor/wikimedia/services/src/ServiceContainer.php: Service disabled: DBLoadBalancer

Backtrace:

#0 mediawiki/includes/MediaWikiServices.php(709): Wikimedia\Services\ServiceContainer->getService(string)
#1 mediawiki/includes/GlobalFunctions.php(2467): MediaWiki\MediaWikiServices->getDBLoadBalancer()
#2 mediawiki/includes/GlobalFunctions.php(2453): wfGetLB(boolean)
#3 mediawiki/includes/resourceloader/MessageBlobStore.php(156): wfGetDB(integer)
#4 mediawiki/includes/resourceloader/MessageBlobStore.php(120): MessageBlobStore->recacheMessageBlob(string, ResourceLoaderSkinModule, string)
#5 mediawiki/includes/resourceloader/MessageBlobStore.php(85): MessageBlobStore->getBlobs(array, string)
#6 mediawiki/includes/resourceloader/ResourceLoaderModule.php(585): MessageBlobStore->getBlob(ResourceLoaderSkinModule, string)
#7 mediawiki/includes/resourceloader/ResourceLoaderLessVarFileModule.php(111): ResourceLoaderModule->getMessageBlob(ResourceLoaderContext)
#8 mediawiki/includes/resourceloader/ResourceLoaderSkinModule.php(514): ResourceLoaderLessVarFileModule->getLessVars(ResourceLoaderContext)
#9 mediawiki/includes/resourceloader/ResourceLoaderFileModule.php(1098): ResourceLoaderSkinModule->getLessVars(ResourceLoaderContext)
#10 mediawiki/includes/resourceloader/ResourceLoaderFileModule.php(990): ResourceLoaderFileModule->compileLessString(string, string, ResourceLoaderContext)
#11 mediawiki/includes/resourceloader/ResourceLoaderFileModule.php(966): ResourceLoaderFileModule->processStyle(string, string, ResourceLoaderFilePath, ResourceLoaderContext)
#12 mediawiki/includes/resourceloader/ResourceLoaderFileModule.php(943): ResourceLoaderFileModule->readStyleFile(ResourceLoaderFilePath, ResourceLoaderContext)
#13 mediawiki/includes/installer\WebInstallerOutput.php(160): ResourceLoaderFileModule->readStyleFiles(array, ResourceLoaderContext)
#14 mediawiki/includes/installer\WebInstaller.php(1218): WebInstallerOutput->getCSS()
#15 mediawiki/includes/installer\WebInstaller.php(178): WebInstaller->outputCss()
#16 mediawiki/mw-config/index.php(82): WebInstaller->execute(array)
#17 mediawiki/mw-config/index.php(40): wfInstallerMain()
#18 {main}

Problem:

When introducing the "toc" feature, we made ResourceLoaderSkinModule use LESS messages. Even though this feature is not in the installer it has an impact on caching and requires access to the MessageBlobStore. The MessageBlobStore access the database which is not available in the installer so an exception is thrown.

The required fix would be to make it possible for ResourceLoader to disable database access and/or to avoid the message lookup for ResourceLoaderSkinModules which do not use the toc feature.

Details

Subject	Repo	Branch	Lines +/-
ResourceLoaderSkinModule: When `toc` is enabled messages are empty	mediawiki/core	REL1_36	+10 -5
ResourceLoaderSkinModule: When `toc` is enabled messages are empty	mediawiki/core	master	+10 -5
Installer: Do not use `mediawiki.skinning.interface` module	mediawiki/core	REL1_36	+43 -26
Installer: Do not use `mediawiki.skinning.interface` module	mediawiki/core	master	+43 -26
Fix the styling of the installer and deprecate its RL module	mediawiki/core	master	+58 -49
Fix the styling of the installer and deprecate its RL module	mediawiki/core	master	+58 -33

Customize query in gerrit

Related Objects

Mentioned In: T280260: mw-empty-elt element is not hidden in old Vector
T271651: Example Skin: Your skin is incompatible with VisualEditor.
Mentioned Here: T268230: Roll out the new logo of MediaWiki
T252774: Merge mediawiki.toc.styles styles into ResourceLoaderSkinModule
rMW9c253febe232: Merge "Remove deprecated content-related fields and methods."
rMWdb3c8ea16b3f: Add new 'toc' feature to ResourceLoaderSkinModule
rMWdbb1a9ef6460: Decapitalize autonyms for Võro, Livvi-Karelian and Komi-Permyak

Event Timeline

Mainframe98 created this task.Dec 13 2020, 11:11 AM

rMW9c253febe2323c8bcdb2be871e4c9e7699a7b847 works fine, rMWdb3c8ea16b3f5c9fa80a8778cef1e234c6efffff (T252774: Merge mediawiki.toc.styles styles into ResourceLoaderSkinModule) does not. Based on the stacktrace, it appears that ResourceLoaderSkinModule extending ResourceLoaderLessVarFileModule is the culprit.

To be more precise: ResourceLoaderLessVarModule gets the message blob for ResourceLoaderSkinModule::LESS_MESSAGES, which after a bit of indirection gets that from MessageBlobStore, which eventually calls recacheMessageBlob. In recacheMessageBlob there's a call to wfGetDB, which isn't going to work in the installer.

I managed to fix this locally with an overridden instance of MessageBlobStore that changes getBlobs not to call recacheMessageBlob, and have WebInstallerOutput::getCSS set that as the MessageBlobStore on the ResourceLoader that is created in that method. @Krinkle is this an approach that is acceptable?

Restricted Application added a project: Performance-Team. · View Herald TranscriptDec 13 2020, 12:59 PM

taavi subscribed.Dec 13 2020, 2:22 PM

@Mainframe98 It's possible, but I don't recommend it. There is no need to make this work in the installer. The problem is that code is being activated that afaik has no place in the installer.

@Jdlrobson It looks like change 621040 as part of T252774 enabled the toc feature in the SkinModule used by the installer, which thus causes the localisation system and LessMessages to be activated there which are not safe for use during the installer and afaik don't need to be. Turning this stylesheet off there should fix it. Can you look into that?

Krinkle renamed this task from WebInstaller is served without styles to Installer stylesheet fails to load on 1.36 master.Dec 13 2020, 8:42 PM

Krinkle edited projects, added Web-Team-Backlog-Archived, MediaWiki-Core-Skin-Architecture, MW-1.36-release, Regression; removed Performance-Team, MediaWiki-ResourceLoader.

Krinkle unsubscribed.

Change 649409 had a related patch set uploaded (by Jdlrobson; owner: Jdlrobson):
[mediawiki/core@master] WIP: Fix the styling of the installer

https://gerrit.wikimedia.org/r/649409

gerritbot added a project: Patch-For-Review.Dec 14 2020, 4:38 PM

Jdlrobson triaged this task as Low priority.Dec 14 2020, 10:39 PM

Jdlrobson moved this task from Backlog to Phase 4 - Standardize ResourceLoaderSkinModules styling rules on the MediaWiki-Core-Skin-Architecture board.Dec 15 2020, 11:29 PM

Mainframe98 merged a task: T271734: MediaWiki 1.36.0-alpha installation failed.Jan 11 2021, 6:00 PM

Mainframe98 added a subscriber: Nasirkhan.

is there any estimated time to fix this issue? already one month gone till the date of reporting the issue. Can you tell me how should I continue the installation?

It should be possible to use the installer without styles, but you can apply the patch https://gerrit.wikimedia.org/r/649409 to your mediawiki instance in the mean time.

The 1.36 release is not for several months now, so this is not a high priority right now and our volunteer/staff are spread pretty thin.

Change 649409 abandoned by Jdlrobson:
[mediawiki/core@master] Fix the styling of the installer and deprecate its RL module

Reason:
This has grown a lot in scope since I first started it and now involves fixing ResourceLoader internals. I don't have time to focus time on this right now. Others should feel free to pick up the task.

https://gerrit.wikimedia.org/r/649409

Jdlrobson removed a project: Patch-For-Review.Jan 21 2021, 6:20 PM

Jdlrobson updated the task description. (Show Details)Jan 21 2021, 9:03 PM

@Jdlrobson added to the task description:

When introducing the "toc" feature, we made ResourceLoaderSkinModule use LESS messages. Even though this feature is not in the installer it has an impact on caching and requires access to the MessageBlobStore. The MessageBlobStore access the database which is not available in the installer so an exception is thrown.
The required fix would be to make it possible for ResourceLoader to disable database access and/or to avoid the message lookup for ResourceLoaderSkinModules which do not use the toc feature.

MessageBlobStore was always constructed by ResourceLoader, and does not require the database service during instantiation.

ResourceLoader does not intract with MessageBlobStore if a module has no messages. In addition, even if it did somehow ask for a blob from MessageBlobStore, that service does not perform any message cache lookups if getMessages() is empty as it is by default. I was not able to break this assumption in my local set up.

From what I can tell, the issue is simply that the SkinModule instance used in the installer, does not have an empty lessMessages array. The SkinModule class currently hardcodes [ 'hidetoc', 'showtoc' ] as lessMessages option, regardless of which features are enabled. Fixing that mean getMessages() returns empty and thus it all works again.

Jdlrobson moved this task from Incoming to Triaged but Future on the Web-Team-Backlog-Archived board.Feb 18 2021, 11:25 PM

1.36 is getting closer, and this is still broke. Resetting to Needs Triage; a pretty broken looking installer is not "low priority"

I hit this when I was making patches for the new mediawiki logo (T268230: Roll out the new logo of MediaWiki). The branch cut is pretty soon.

RhinosF1 subscribed.Mar 13 2021, 4:48 PM

The associated patch I worked on (https://gerrit.wikimedia.org/r/c/649409) is mostly there. Feel free to restore it and tinker, otherwise, I'll plan to get round to this in about 2-4 weeks. Feel free to poke me and bump to high after then.

taavi merged a task: T278038: mw-config fails to load CSS.Mar 21 2021, 10:51 AM

taavi added a subscriber: BrandonXLF.

Change 649409 restored by Jdlrobson:
[mediawiki/core@master] Fix the styling of the installer and deprecate its RL module

https://gerrit.wikimedia.org/r/649409

Change 674457 had a related patch set uploaded (by Jdlrobson; owner: Jdlrobson):
[mediawiki/core@master] Fix the styling of the installer and deprecate its RL module

https://gerrit.wikimedia.org/r/674457

gerritbot added a project: Patch-For-Review.Mar 24 2021, 12:25 AM

Change 649409 abandoned by Jdlrobson:
[mediawiki/core@master] Fix the styling of the installer and deprecate its RL module

Reason:
see https://gerrit.wikimedia.org/r/c/mediawiki/core/ /674457

https://gerrit.wikimedia.org/r/649409

MessageBlobStore was always constructed by ResourceLoader, and does not require the database service during instantiation.

MessageBlobStore->getBlobs requires the database.

ResourceLoader does not intract with MessageBlobStore if a module has no messages. In addition, even if it did somehow ask for a blob from MessageBlobStore, that service does not perform any message cache lookups if getMessages() is empty as it is by default. I was not able to break this assumption in my local set up.

True. That's what https://gerrit.wikimedia.org/r/c/mediawiki/core/+/674457/2/includes/resourceloader/ResourceLoaderSkinModule.php change is trying to do, by making sure the lessMessages is defined as an empty array when toc feature is not present.

From what I can tell, the issue is simply that the SkinModule instance used in the installer, does not have an empty lessMessages array. The SkinModule class currently hardcodes [ 'hidetoc', 'showtoc' ] as lessMessages option, regardless of which features are enabled. Fixing that mean getMessages() returns empty and thus it all works again.

So yes and no. Yes, the array needs to be empty (see above), but it also seems that this is not enough. This results in:

[34f6a76a3a511efeabc44a70] /w/mw-config/index.php?css=1222 TypeError: Return value of ResourceLoaderLessVarFileModule::pluckFromMessageBlob() must be of the type array, null returned

The problem here is that ResourceLoaderLessVarFileModule::getLessVars calls parent::getMessageBlob which calls ResourceLoaderModule::getMessageBlob which can return null.

This is what the following tries to fix:
https://gerrit.wikimedia.org/r/c/mediawiki/core/+/674457/2/includes/resourceloader/ResourceLoaderLessVarFileModule.php

Jdlrobson moved this task from Triaged but Future to Needs Prioritization on the Web-Team-Backlog-Archived board.Mar 24 2021, 9:25 PM

This is going to block the next release Olga which is in roughly 2 months time so I think we should look at this sooner rather than later in case it proves trickier than expected.

Jdlrobson moved this task from Needs Analysis to Upcoming on the Web-Team-Backlog-Archived (Kanbanana-FY-2020-21) board.Apr 6 2021, 11:52 PM

In T270027#6978454, @Jdlrobson wrote:

This is going to block the next release Olga which is in roughly 2 months time so I think we should look at this sooner rather than later in case it proves trickier than expected.

Not two months' time. The rc.0 cut is nominally scheduled for two weeks' time. I'd suggest this is raised to High verging on UBN.

ovasileva raised the priority of this task from Medium to High.Apr 14 2021, 5:13 PM

@Jdforrester-WMF The rc.0 cut schedule hit not only me by surprise. Thanks for adding the info! What calendars could I subscribe to know this with enough time ahead?

ovasileva subscribed.Apr 14 2021, 5:14 PM

In T270027#6999504, @Volker_E wrote:

@Jdforrester-WMF The rc.0 cut schedule hit not only me by surprise. Thanks for adding the info! What calendars could I subscribe to know this with enough time ahead?

https://www.mediawiki.org/wiki/Version_lifecycle is the most high-profile place; that was changed from March 2021 to May 2021 in January after I guesstimated May for the release, as it was nine months after the previous one (normally we're every-six months, but COVID meant things were slower).

Ideally there'd have been an announcement a few days before the branch cut, but no-one remembered, sorry.

ovasileva set the point value for this task to 5.Apr 14 2021, 5:19 PM

ovasileva moved this task from Upcoming to Ready for Development on the Web-Team-Backlog-Archived (Kanbanana-FY-2020-21) board.

Jdlrobson moved this task from Ready for Development to Doing on the Web-Team-Backlog-Archived (Kanbanana-FY-2020-21) board.Apr 14 2021, 5:28 PM

Change 674457 abandoned by Jdlrobson:

[mediawiki/core@master] Fix the styling of the installer and deprecate its RL module

Reason:

See https://gerrit.wikimedia.org/r/c/mediawiki/core/ /679503

https://gerrit.wikimedia.org/r/674457

Jdlrobson moved this task from Doing to Code Review on the Web-Team-Backlog-Archived (Kanbanana-FY-2020-21) board.Apr 14 2021, 10:23 PM

Change 679505 had a related patch set uploaded (by Jdlrobson; author: Jdlrobson):

[mediawiki/core@master] Installer: Do not use `mediawiki.skinning.interface` module

https://gerrit.wikimedia.org/r/679505

LGoto assigned this task to Jdrewniak.Apr 15 2021, 5:05 PM

Reedy renamed this task from Installer stylesheet fails to load on 1.36 master to Installer stylesheet fails to load on 1.36/master.Apr 15 2021, 6:03 PM

Jdlrobson mentioned this in T280260: mw-empty-elt element is not hidden in old Vector.Apr 16 2021, 12:25 AM

Change 679505 merged by jenkins-bot:

[mediawiki/core@master] Installer: Do not use `mediawiki.skinning.interface` module

https://gerrit.wikimedia.org/r/679505

ReleaseTaggerBot added a project: MW-1.37-notes (1.37.0-wmf.3; 2021-04-27).Apr 19 2021, 2:00 PM

Change 680861 had a related patch set uploaded (by Jforrester; author: Jdlrobson):

[mediawiki/core@REL1_36] Installer: Do not use `mediawiki.skinning.interface` module

https://gerrit.wikimedia.org/r/680861

Is this Resolved if we land it into REL1_36 or is there more to do?

Change 679503 had a related patch set uploaded (by Jdlrobson; author: Jdlrobson):

[mediawiki/core@master] ResourceLoaderSkinModule: When `toc` is enabled messages are empty

https://gerrit.wikimedia.org/r/679503

@Jdforrester-WMF https://gerrit.wikimedia.org/r/c/mediawiki/core/+/679503 also needs to be reviewed and cherry-picked. https://gerrit.wikimedia.org/r/680861 on its own does not fix the issue.

Change 680861 merged by jenkins-bot:

[mediawiki/core@REL1_36] Installer: Do not use `mediawiki.skinning.interface` module

https://gerrit.wikimedia.org/r/680861

ReleaseTaggerBot added a project: MW-1.36-notes.Apr 19 2021, 5:00 PM

Change 679503 merged by jenkins-bot:

[mediawiki/core@master] ResourceLoaderSkinModule: When `toc` is enabled messages are empty

https://gerrit.wikimedia.org/r/679503

Change 681148 had a related patch set uploaded (by Jforrester; author: Jdlrobson):

[mediawiki/core@REL1_36] ResourceLoaderSkinModule: When `toc` is enabled messages are empty

https://gerrit.wikimedia.org/r/681148

Change 681148 merged by jenkins-bot:

[mediawiki/core@REL1_36] ResourceLoaderSkinModule: When `toc` is enabled messages are empty

https://gerrit.wikimedia.org/r/681148

Jdlrobson moved this task from Code Review to Ready for Signoff on the Web-Team-Backlog-Archived (Kanbanana-FY-2020-21) board.Apr 19 2021, 8:57 PM

Jdlrobson claimed this task.Apr 20 2021, 5:04 PM

Jdlrobson added a subscriber: Jdrewniak.

Screen Shot 2021-04-20 at 4.08.59 PM.png (1×2 px, 444 KB)

Thanks everyone. I can confirm this is finally working and backported.

Thank you!

	F34408995: Screen Shot 2021-04-20 at 4.08.59 PM.png
	Apr 20 2021, 11:09 PM

Installer stylesheet fails to load on 1.36/masterClosed, ResolvedPublic5 Estimated Story PointsBUG REPORTActions

Description

Problem:

Details

Related Objects

Event Timeline

Installer stylesheet fails to load on 1.36/master
Closed, ResolvedPublic5 Estimated Story PointsBUG REPORT
Actions