phd has stopped working a few times on August 14 (and before)
Closed, DuplicatePublic
Actions

Assigned To

None

Authored By

	Mainframe98
	Aug 14 2022, 1:20 PM

Description

See for example https://phabricator.wikimedia.org/diffusion/EMML/manage/.

Example:

09:33:12 <icinga-wm> PROBLEM - PHD should be supervising processes on phab1001 is CRITICAL: PROCS CRITICAL: 2 processes with UID = 497 (phd) https://wikitech.wikimedia.org/wiki/Phabricator
09:35:35 <icinga-wm> RECOVERY - PHD should be supervising processes on phab1001 is OK: PROCS OK: 4 processes with UID = 497 (phd) https://wikitech.wikimedia.org/wiki/Phabricator

Maybe check logs and icinga to see if it needs fixing

Event Timeline

Mainframe98 created this task.Aug 14 2022, 1:20 PM

Restricted Application added a subscriber: Aklapper. · View Herald TranscriptAug 14 2022, 1:20 PM

This was a temp issue. They sometimes crash. As far as I can see, it's happened 3 times today based on icinga and recovered within 3 minutes of alert.

RhinosF1 renamed this task from Diffusion's working copy status mentions that the Pull and Task daemon are not running to phd has stopped working a few times on August 14 (and before).Aug 14 2022, 1:41 PM

RhinosF1 updated the task description. (Show Details)

Peachey88 closed this task as a duplicate of T315962: Flapping Phabricator processes monitoring.Aug 23 2022, 8:07 AM

phd has stopped working a few times on August 14 (and before)Closed, DuplicatePublicActions

Description

Event Timeline

phd has stopped working a few times on August 14 (and before)
Closed, DuplicatePublic
Actions