Page MenuHomePhabricator
Create Task
Maniphest T216045

Beta cluster is broken: No working replica DB server: Unknown error (172.16.5.5:3306))
Closed, ResolvedPublic
Actions

Description

none of deployment-db03.eqiad.wmflabs or deployment-db04.eqiad.wmflabs seem accessible:

ssh deployment-db03.deployment-prep.eqiad.wmflabs
Creating directory '/home/dcausse'.
Unable to create and initialize directory '/home/dcausse'.
Could not chdir to home directory /home/dcausse: No such file or directory
-bash: /etc/profile: Input/output error
Connection to deployment-db03.deployment-prep.eqiad.wmflabs closed.

and deployment-db04 refuses my key.

Related Objects

Event Timeline

dcausse created this task.Feb 13 2019, 3:11 PM
Restricted Application added a subscriber: Aklapper. · View Herald TranscriptFeb 13 2019, 3:11 PM
dcausse triaged this task as High priority.Feb 13 2019, 3:12 PM
jcrespo subscribed.EditedFeb 13 2019, 3:20 PM

That is T216030 https://lists.wikimedia.org/pipermail/cloud/2019-February/000538.html

dcausse closed this task as Resolved.Feb 14 2019, 5:09 PM
Ryasmeen subscribed.EditedFeb 19 2019, 9:06 PM

Hey @dcausse/@jcrespo, it seems Beta cluster is still broken.I see it's in read-only mode and also sometimes getting the error:
"Cannot access the database: Unknown error". Is there a separate task on these issues?

This is kinda blocking VE testing work.

Screen Shot 2019-02-19 at 1.53.43 PM.png (526×1 px, 198 KB)

Restricted Application added a project: User-Ryasmeen. · View Herald TranscriptFeb 19 2019, 9:06 PM
jcrespo added a comment.Feb 20 2019, 8:35 AM

Sorry, I don't maintain Beta cluster, in fact, I was denied access to it some time ago.

jcrespo unsubscribed.Feb 20 2019, 8:35 AM
jcrespo added a comment.Feb 20 2019, 8:48 AM

I found this, though: T216404

Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL · Credits