Maniphest T219456

Add ram to Proton*
Closed, ResolvedPublic
Actions

Assigned To

Authored By

	• crusnov
	Mar 27 2019, 9:43 PM

Description

All of the proton instances seem to regularly alert due to RAM exhaustion (hitting swap, causing CPU usage to spike and causing alerts to fire, and causing proton subprocesses to OOM). It is suggested that we double the RAM on these instances. Both Ganeti clusters have pleanty of RAM headroom for this change.

proton1001
proton1002
proton2001
proton2002

Related Objects

Mentioned In: T214975: proton experienced a period of high CPU usage, busy queue, lockups
Mentioned Here: T214975: proton experienced a period of high CPU usage, busy queue, lockups

Event Timeline

• crusnov created this task.Mar 27 2019, 9:43 PM

Restricted Application added a subscriber: Aklapper. · View Herald TranscriptMar 27 2019, 9:43 PM

• crusnov closed this task as Resolved.Mar 27 2019, 10:00 PM

• crusnov triaged this task as Medium priority.

• crusnov updated the task description. (Show Details)

Krenair added a project: SRE.Mar 27 2019, 10:03 PM

Mentioned in SAL (#wikimedia-operations) [2019-04-24T17:23:46Z] <mutante> proton1001 - restarting proton service - low RAM caused facter/puppet fails (https://tickets.puppetlabs.com/browse/PUP-8048) freed memory and fixed puppet run (cc: T219456 T214975)

Stashbot mentioned this in T214975: proton experienced a period of high CPU usage, busy queue, lockups.Apr 24 2019, 5:23 PM

Add ram to Proton*Closed, ResolvedPublicActions

Description

Related Objects

Event Timeline

Add ram to Proton*
Closed, ResolvedPublic
Actions