Page MenuHomePhabricator
Create Task
Maniphest T258062

Wikidata Change Dispatching Broken
Closed, ResolvedPublic
Actions

Description

Reported by @Lucas_Werkmeister_WMDE

image.png (258×910 px, 86 KB)

it looks like change dispatching has completely stopped since ca. 15:08 CEST?
which is suspiciously close to https://sal.toolforge.org/log/PFCTUnMBLkHzneNNWaAk 13:04 jforrester@deploy1001 Synchronized php: group1 wikis to 1.35.0-wmf.41 (duration: 01m 05s)

Details

SubjectRepoBranchLines +/-
Stop checking if WikibaseLib is loadedmediawiki/extensions/Wikibasemaster+5 -5
Stop checking if WikibaseLib is loadedmediawiki/extensions/WikibaseREL1_35+5 -5
Stop checking if WikibaseLib is loadedmediawiki/extensions/Wikibasewmf/1.35.0-wmf.41+5 -5
Customize query in gerrit

Related Objects

Event Timeline

Tarrow created this task.Jul 15 2020, 2:29 PM
Restricted Application added a subscriber: Aklapper. · View Herald TranscriptJul 15 2020, 2:29 PM
Tarrow claimed this task.Jul 15 2020, 2:29 PM
Tarrow added a comment.EditedJul 15 2020, 2:32 PM
#2 /srv/mediawiki/multiversion/MWScript.php(101): require_once('/srv/mediawiki/...')
#3 {main}
6703: Dispatcher exited with 1
7442: Starting dispatcher
MWException from line 230 of /srv/mediawiki/php-1.35.0-wmf.41/extensions/Wikibase/repo/maintenance/dispatchChanges.php: WikibaseLib has not been loaded.
#0 /srv/mediawiki/php-1.35.0-wmf.41/maintenance/doMaintenance.php(107): Wikibase\Repo\Maintenance\DispatchChanges->execute()
#1 /srv/mediawiki/php-1.35.0-wmf.41/extensions/Wikibase/repo/maintenance/dispatchChanges.php(403): require_once('/srv/mediawiki/...')
#2 /srv/mediawiki/multiversion/MWScript.php(101): require_once('/srv/mediawiki/...')
#3 {main}
7442: Dispatcher exited with 1
Tarrow renamed this task from Investigate possible failure is dispatching to Wikidata Change Dispatching Broken.Jul 15 2020, 2:32 PM
gerritbot added a comment.Jul 15 2020, 2:33 PM

Change 612876 had a related patch set uploaded (by Lucas Werkmeister (WMDE); owner: Lucas Werkmeister (WMDE)):
[mediawiki/extensions/Wikibase@master] Stop checking if WikibaseLib is loaded

https://gerrit.wikimedia.org/r/612876

gerritbot added a project: Patch-For-Review.Jul 15 2020, 2:33 PM
Lucas_Werkmeister_WMDE added a parent task: T256669: 1.35.0-wmf.41 deployment blockers.Jul 15 2020, 2:33 PM
gerritbot added a comment.Jul 15 2020, 2:34 PM

Change 612723 had a related patch set uploaded (by Lucas Werkmeister (WMDE); owner: Lucas Werkmeister (WMDE)):
[mediawiki/extensions/Wikibase@wmf/1.35.0-wmf.41] Stop checking if WikibaseLib is loaded

https://gerrit.wikimedia.org/r/612723

taavi triaged this task as Unbreak Now! priority.Jul 15 2020, 2:35 PM
taavi subscribed.

Blockers are UBN

RhinosF1 subscribed.Jul 15 2020, 2:38 PM
Lucas_Werkmeister_WMDE added a comment.Jul 15 2020, 2:39 PM
In T258062#6308590, @Tarrow wrote:
#2 /srv/mediawiki/multiversion/MWScript.php(101): require_once('/srv/mediawiki/...')
#3 {main}
6703: Dispatcher exited with 1
7442: Starting dispatcher
MWException from line 230 of /srv/mediawiki/php-1.35.0-wmf.41/extensions/Wikibase/repo/maintenance/dispatchChanges.php: WikibaseLib has not been loaded.
#0 /srv/mediawiki/php-1.35.0-wmf.41/maintenance/doMaintenance.php(107): Wikibase\Repo\Maintenance\DispatchChanges->execute()
#1 /srv/mediawiki/php-1.35.0-wmf.41/extensions/Wikibase/repo/maintenance/dispatchChanges.php(403): require_once('/srv/mediawiki/...')
#2 /srv/mediawiki/multiversion/MWScript.php(101): require_once('/srv/mediawiki/...')
#3 {main}
7442: Dispatcher exited with 1

(For the record, that’s from /var/log/wikidata/dispatchChanges-wikidatawiki.log on mwmaint1002.)

gerritbot added a comment.Jul 15 2020, 2:42 PM

Change 612724 had a related patch set uploaded (by Lucas Werkmeister (WMDE); owner: Lucas Werkmeister (WMDE)):
[mediawiki/extensions/Wikibase@REL1_35] Stop checking if WikibaseLib is loaded

https://gerrit.wikimedia.org/r/612724

gerritbot added a comment.Jul 15 2020, 2:48 PM

Change 612723 merged by Addshore:
[mediawiki/extensions/Wikibase@wmf/1.35.0-wmf.41] Stop checking if WikibaseLib is loaded

https://gerrit.wikimedia.org/r/612723

Stashbot added a comment.Jul 15 2020, 2:58 PM

Mentioned in SAL (#wikimedia-operations) [2020-07-15T14:58:28Z] <addshore@deploy1001> Synchronized php-1.35.0-wmf.41/extensions/Wikibase/repo: [[gerrit:612723]] Stop checking if WikibaseLib is loaded T258062 (already on mwmaint1002) (duration: 01m 08s)

gerritbot added a comment.Jul 15 2020, 2:59 PM

Change 612876 merged by jenkins-bot:
[mediawiki/extensions/Wikibase@master] Stop checking if WikibaseLib is loaded

https://gerrit.wikimedia.org/r/612876

ReleaseTaggerBot added projects: MW-1.36-notes (1.36.0-wmf.1; 2020-07-21), MW-1.35-notes (1.35.0-wmf.41; 2020-07-14).Jul 15 2020, 3:00 PM
Addshore added a project: Wikidata-Campsite (Wikidata-Campsite-Iteration-∞ (On Hold)).Jul 15 2020, 3:00 PM
Addshore subscribed.

Putting this on the campsite so we make sure the REL1_35 one gets merged.

Addshore moved this task from To Do (prioritised from top to bottom) to Peer Review on the Wikidata-Campsite (Wikidata-Campsite-Iteration-∞ (On Hold)) board.Jul 15 2020, 3:00 PM

We should also file a ticket about alerts for dispatching being broken on testwikidatawiki

Addshore lowered the priority of this task from Unbreak Now! to High.Jul 15 2020, 3:01 PM
gerritbot added a comment.Jul 15 2020, 3:01 PM

Change 612724 merged by jenkins-bot:
[mediawiki/extensions/Wikibase@REL1_35] Stop checking if WikibaseLib is loaded

https://gerrit.wikimedia.org/r/612724

taavi removed a parent task: T256669: 1.35.0-wmf.41 deployment blockers.Jul 15 2020, 3:01 PM
Lucas_Werkmeister_WMDE closed this task as Resolved.Jul 15 2020, 3:02 PM
Lucas_Werkmeister_WMDE moved this task from Peer Review to Done on the Wikidata-Campsite (Wikidata-Campsite-Iteration-∞ (On Hold)) board.

All done, except for follow-up tasks about alerting, I think.

Maintenance_bot removed a project: Patch-For-Review.Jul 15 2020, 3:10 PM
Maintenance_bot moved this task from incoming to in progress on the Wikidata board.Jul 15 2020, 3:15 PM
Michael mentioned this in T258374: Create Icinga alert for Test Wikidata dispatchlag.Aug 3 2020, 3:29 PM
Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL