labs -Database is offline
Closed, ResolvedPublic

Description

look at https://tools.wmflabs.org/replag/ => 500 Server Internal Error

or results like this

https://tools.wmflabs.org/templatecount/index.php?lang=de&namespace=10&name=Cite+web

Warning: mysqli::mysqli(): (HY000/2003): Can't connect to MySQL server on 'dewiki.labsdb' (111) in /data/project/jarry-common/public_html/libs/database.php on line 27 Call Stack: 0.0130 710128 1. {main}() /data/project/templatecount/public_html/index.php:0 0.7229 3510720 2. dbconnect() /data/project/templatecount/public_html/index.php:52 0.7320 3515320 3. mysqli->mysqli() /data/project/jarry-common/public_html/libs/database.php:27

Boshomi created this task.Feb 14 2016, 10:54 PM
Boshomi updated the task description. (Show Details)
Boshomi raised the priority of this task from to Needs Triage.
Boshomi added a subscriber: Boshomi.
Restricted Application added subscribers: StudiesWorld, Aklapper. · View Herald TranscriptFeb 14 2016, 10:54 PM
Krenair added a subscriber: Krenair.

known, being worked on. one of the DB server's drives has failed

labsdb1002 has a broken disk which resulted in the partition with the db being off line. Folks will be redirecting queries to other servers shortly.

Change 270650 had a related patch set uploaded (by Jcrespo):
Depool labsdb1002

https://gerrit.wikimedia.org/r/270650

Change 270650 merged by Andrew Bogott:
Depool labsdb1002

https://gerrit.wikimedia.org/r/270650

chasemp closed this task as Resolved.Feb 14 2016, 11:17 PM
chasemp claimed this task.
chasemp added a subscriber: chasemp.

this should be worked around now with https://gerrit.wikimedia.org/r/#/c/270650/

replag and templatecount have been restarted.