Page MenuHomePhabricator

Wikidata Change Dispatching Broken
Closed, ResolvedPublic

Description

Reported by @Lucas_Werkmeister_WMDE

it looks like change dispatching has completely stopped since ca. 15:08 CEST?
which is suspiciously close to https://sal.toolforge.org/log/PFCTUnMBLkHzneNNWaAk 13:04 jforrester@deploy1001 Synchronized php: group1 wikis to 1.35.0-wmf.41 (duration: 01m 05s)

Event Timeline

Tarrow created this task.Jul 15 2020, 2:29 PM
Restricted Application added a subscriber: Aklapper. · View Herald TranscriptJul 15 2020, 2:29 PM
Tarrow claimed this task.Jul 15 2020, 2:29 PM
Tarrow added a comment.EditedJul 15 2020, 2:32 PM
#2 /srv/mediawiki/multiversion/MWScript.php(101): require_once('/srv/mediawiki/...')
#3 {main}
6703: Dispatcher exited with 1
7442: Starting dispatcher
MWException from line 230 of /srv/mediawiki/php-1.35.0-wmf.41/extensions/Wikibase/repo/maintenance/dispatchChanges.php: WikibaseLib has not been loaded.
#0 /srv/mediawiki/php-1.35.0-wmf.41/maintenance/doMaintenance.php(107): Wikibase\Repo\Maintenance\DispatchChanges->execute()
#1 /srv/mediawiki/php-1.35.0-wmf.41/extensions/Wikibase/repo/maintenance/dispatchChanges.php(403): require_once('/srv/mediawiki/...')
#2 /srv/mediawiki/multiversion/MWScript.php(101): require_once('/srv/mediawiki/...')
#3 {main}
7442: Dispatcher exited with 1
Tarrow renamed this task from Investigate possible failure is dispatching to Wikidata Change Dispatching Broken.Jul 15 2020, 2:32 PM

Change 612876 had a related patch set uploaded (by Lucas Werkmeister (WMDE); owner: Lucas Werkmeister (WMDE)):
[mediawiki/extensions/Wikibase@master] Stop checking if WikibaseLib is loaded

https://gerrit.wikimedia.org/r/612876

Change 612723 had a related patch set uploaded (by Lucas Werkmeister (WMDE); owner: Lucas Werkmeister (WMDE)):
[mediawiki/extensions/Wikibase@wmf/1.35.0-wmf.41] Stop checking if WikibaseLib is loaded

https://gerrit.wikimedia.org/r/612723

Majavah triaged this task as Unbreak Now! priority.Jul 15 2020, 2:35 PM
Majavah added a subscriber: Majavah.

Blockers are UBN

#2 /srv/mediawiki/multiversion/MWScript.php(101): require_once('/srv/mediawiki/...')
#3 {main}
6703: Dispatcher exited with 1
7442: Starting dispatcher
MWException from line 230 of /srv/mediawiki/php-1.35.0-wmf.41/extensions/Wikibase/repo/maintenance/dispatchChanges.php: WikibaseLib has not been loaded.
#0 /srv/mediawiki/php-1.35.0-wmf.41/maintenance/doMaintenance.php(107): Wikibase\Repo\Maintenance\DispatchChanges->execute()
#1 /srv/mediawiki/php-1.35.0-wmf.41/extensions/Wikibase/repo/maintenance/dispatchChanges.php(403): require_once('/srv/mediawiki/...')
#2 /srv/mediawiki/multiversion/MWScript.php(101): require_once('/srv/mediawiki/...')
#3 {main}
7442: Dispatcher exited with 1

(For the record, that’s from /var/log/wikidata/dispatchChanges-wikidatawiki.log on mwmaint1002.)

Change 612724 had a related patch set uploaded (by Lucas Werkmeister (WMDE); owner: Lucas Werkmeister (WMDE)):
[mediawiki/extensions/Wikibase@REL1_35] Stop checking if WikibaseLib is loaded

https://gerrit.wikimedia.org/r/612724

Change 612723 merged by Addshore:
[mediawiki/extensions/Wikibase@wmf/1.35.0-wmf.41] Stop checking if WikibaseLib is loaded

https://gerrit.wikimedia.org/r/612723

Mentioned in SAL (#wikimedia-operations) [2020-07-15T14:58:28Z] <addshore@deploy1001> Synchronized php-1.35.0-wmf.41/extensions/Wikibase/repo: [[gerrit:612723]] Stop checking if WikibaseLib is loaded T258062 (already on mwmaint1002) (duration: 01m 08s)

Change 612876 merged by jenkins-bot:
[mediawiki/extensions/Wikibase@master] Stop checking if WikibaseLib is loaded

https://gerrit.wikimedia.org/r/612876

Addshore added a subscriber: Addshore.

Putting this on the campsite so we make sure the REL1_35 one gets merged.

We should also file a ticket about alerts for dispatching being broken on testwikidatawiki

Addshore lowered the priority of this task from Unbreak Now! to High.Jul 15 2020, 3:01 PM

Change 612724 merged by jenkins-bot:
[mediawiki/extensions/Wikibase@REL1_35] Stop checking if WikibaseLib is loaded

https://gerrit.wikimedia.org/r/612724

Lucas_Werkmeister_WMDE closed this task as Resolved.Jul 15 2020, 3:02 PM

All done, except for follow-up tasks about alerting, I think.