Page MenuHomePhabricator
Create Task
Maniphest T121431

maps-wma1 instance unresponsive (second time in 3 days)
Closed, ResolvedPublic
Actions

Description

I am unable to log into the instance maps-wma1.maps.eqiad.wmflabs (also reachable at http://wma.wmflabs.org) currently. My public key is not accepted (leading me to speculate that maybe a filesystem is not mounted?)
Could anyone please take a look? This happened on Saturday as well and I "fixed" it with a reboot, but I fear there might be a pattern behind this and I don;t wan t my instance to die every few days.

Event Timeline

dschwen created this task.Dec 14 2015, 7:34 PM
dschwen raised the priority of this task from to Needs Triage.
dschwen updated the task description. (Show Details)
dschwen subscribed.
Restricted Application added subscribers: StudiesWorld, Aklapper. · View Herald TranscriptDec 14 2015, 7:34 PM
Aklapper added a project: Cloud-VPS.Dec 14 2015, 7:56 PM
Restricted Application added a project: Cloud-Services. · View Herald TranscriptDec 14 2015, 7:56 PM
yuvipanda subscribed.Dec 14 2015, 9:18 PM

I can't seem to ssh into this even as root :|

yuvipanda added a comment.Dec 14 2015, 10:24 PM

A restart didn't do anything either.

yuvipanda added a comment.Dec 14 2015, 10:25 PM

Hmm, I wonder / suspect if puppet ever ran on this instance in a while? https://tools.wmflabs.org/nagf/?project=maps is all empty.

yuvipanda added subscribers: Andrew, coren.Dec 14 2015, 10:27 PM

We can try with @Andrew or @coren's key when they're back from their vacation since it's been there longer than mine or chase's, but I also recommend rebuilding the instance side by side...

Andrew closed this task as Resolved.Dec 15 2015, 4:42 PM
Andrew claimed this task.

My key worked. The puppet cron was clearly disabled -- I started a puppet run and things seem reasonable now. Puppet still throws a bunch of errors, but those should probably be handled by whoever set up the conf in the first place.

(Also, obligatory: don't disable puppet! It makes us waste time like we just did.)

dschwen added a comment.Dec 15 2015, 4:43 PM

Thanks Andrew. I was not aware that I disable puppet. I'll check out what I did there.

• Phabricator_maintenance removed a subscriber: yuvipanda.Jun 7 2017, 6:45 PM
Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL