Page MenuHomePhabricator

Add flag to rebuildLocalisationCache.php to skip MessageBlobStore::clearGlobalCacheEntry
Closed, ResolvedPublic

Description

Normally rebuildLocalisationCache.php clears the MessageBlobStore global cache after it rebuilds the CDB file for a given language. Sometimes this call happens at an inappropriate time, such as before new CDB files have been prepared on target servers. We need a way to control whether or not rebuildLocalisationCache clears the global cache.

Event Timeline

Change 643370 had a related patch set uploaded (by Ahmon Dancy; owner: Ahmon Dancy):
[mediawiki/core@master] Add flag to rebuildLocalisationCache.php to skip MessageBlobStore clear

https://gerrit.wikimedia.org/r/643370

@dancy: Assuming this task is about the maintenance scripts in MediaWiki core, hence adding that project tag so other people who don't know or don't care about team tags can also find this task when searching via projects. Please set appropriate project tags when possible. Thanks!

Change 643370 merged by jenkins-bot:
[mediawiki/core@master] Add flag to rebuildLocalisationCache.php to skip MessageBlobStore clear

https://gerrit.wikimedia.org/r/643370

Krinkle added a subscriber: Krinkle.

Moving to LocalisationCache component since it's not a issue with the Maintenance script system in general.

dancy triaged this task as Medium priority.Nov 25 2020, 3:34 PM

@Krinkle
Regarding your question in mediawiki IRC: at the end of scap sync-world or scap sync-l10n, scap calls tasks.clear_message_blobs() which runs mwscript extensions/WikimediaMaintenance/refreshMessageBlobs.php
Also, my concern with the unnecessary MBS clearing is that it (presumably) increases the load on the appservers due to the subsequent cache misses. I don't know what the magnitude of that impact is though.

For the record https://gerrit.wikimedia.org/r/c/mediawiki/core/+/667735 replaced --no-clear-message-blob-store with --offline.

Change 677375 had a related patch set uploaded (by Krinkle; author: Krinkle):

[mediawiki/core@master] rebuildLocalisationCache: Add --skip-message-purge and accompanying script

https://gerrit.wikimedia.org/r/677375

Change 677616 had a related patch set uploaded (by Ahmon Dancy; author: Ahmon Dancy):

[mediawiki/tools/scap@master] Use --skip-message-purge instead of --offline

https://gerrit.wikimedia.org/r/677616

Change 677375 merged by jenkins-bot:

[mediawiki/core@master] rebuildLocalisationCache: Add --skip-message-purge and accompanying script

https://gerrit.wikimedia.org/r/677375

Change 678987 had a related patch set uploaded (by Legoktm; author: Krinkle):

[mediawiki/core@REL1_36] rebuildLocalisationCache: Add --skip-message-purge and accompanying script

https://gerrit.wikimedia.org/r/678987

Change 678987 merged by jenkins-bot:

[mediawiki/core@REL1_36] rebuildLocalisationCache: Add --skip-message-purge and accompanying script

https://gerrit.wikimedia.org/r/678987

Change 677616 merged by jenkins-bot:

[mediawiki/tools/scap@master] Use --skip-message-purge instead of --offline

https://gerrit.wikimedia.org/r/677616