As documented in T259167, the input data for the ArcLamp pipeline has been steadily increasing over time, and the memory required to process the full-day files now exceeds the available RAM on webperf1002.eqiad and webperf2002.codfw. (ArcLamp is a sampling profiler, which produces the flamegraphs seen at https://performance.wikimedia.org/arclamp from PHP stack traces taken at regular intervals in production; it is an essential tool for identifying performance regressions.)
In I247b774d and Ic697ad6b, I reduced RAM usage by ensuring only one graph is being produced at a time, however we continue to see OOMs.
These hosts are Ganeti instances with (currently) 8GB of RAM. We would like to increase the RAM for these instances to at least 16GB, or 32GB if possible.