Page MenuHomePhabricator
Create Task
Maniphest T414604

Increase Grafana VM memory
Closed, ResolvedPublic
Actions

Description

Today we had grafana-rw become saturated and unresponsive. The VM has been sitting very close to its memory limit for a long time, it needs a bit more breathing room. The allocation should be increased (ideally doubled) given the importance of Grafana.

Related Objects

Event Timeline

hnowlan created this task.Wed, Jan 14, 4:32 PM
Restricted Application added a subscriber: Aklapper. · View Herald TranscriptWed, Jan 14, 4:32 PM
herron claimed this task.Wed, Jan 14, 4:38 PM
Stashbot added a comment.Wed, Jan 14, 4:42 PM

Mentioned in SAL (#wikimedia-operations) [2026-01-14T16:42:44Z] <herron> restarting grafana1002 for memory increase T414604

ops-monitoring-bot added a comment.Wed, Jan 14, 4:44 PM

VM grafana1002.eqiad.wmnet rebooted by herron@cumin1003 with reason: memory increase

hnowlan mentioned this in T414607: Improve Grafana scalability.Wed, Jan 14, 4:48 PM
ops-monitoring-bot added a comment.Wed, Jan 14, 4:51 PM

VM grafana2001.codfw.wmnet rebooted by herron@cumin1003 with reason: memory increase

herron closed this task as Resolved.Wed, Jan 14, 4:56 PM

Bumped the grafana VMs in codfw and eqiad to 12G (up from 4) and used this as an opportunity to increase VCPUs to 2 as well

andrea.denisse subscribed.Wed, Jan 14, 5:03 PM
Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL · Credits