Quarry is killing web pods once in a while with this error:
Message: Usage of EmptyDir volume "tmp" exceeds the limit "1Gi".
Description
Description
| Status | Subtype | Assigned | Task | ||
|---|---|---|---|---|---|
| Resolved | BUG REPORT | taavi | T395201 Quarry down - web service unreachable | ||
| Resolved | BUG REPORT | taavi | T395237 quarry is leaking tmp files |
Event Timeline
Comment Actions
Sample file in there:
<?xml version="1.0" encoding="UTF-8" standalone="yes"?> <Properties xmlns="http://schemas.openxmlformats.org/officeDocument/2006/extended-properties" xmlns:vt="http://schemas.openxmlformats.org/officeDocument/2006/docPropsVTypes"><Application>Microsoft Excel</Application><DocSecurity>0</DocSecurity><ScaleCrop>false</ScaleCrop><HeadingPairs><vt:vector size="2" baseType="variant"><vt:variant><vt:lpstr>Worksheets</vt:lpstr></vt:variant><vt:variant><vt:i4>1</vt:i4></vt:variant></vt:vector></HeadingPairs><TitlesOfParts><vt:vector size="1" baseType="lpstr"><vt:lpstr>Sheet1</vt:lpstr></vt:vector></TitlesOfParts><Company></Company><LinksUpToDate>false</LinksUpToDate><SharedDoc>false</SharedDoc><HyperlinksChanged>false</HyperlinksChanged><AppVersion>12.0000</AppVersion></Properties>
so this seems to be about the excel export feature?
Comment Actions
Saw another instance of this today, it was paired with redis being down (shown as 'completed', so the pod did not restart by itself).
Comment Actions
Mentioned in SAL (#wikimedia-cloud) [2025-06-13T10:27:00Z] <taavi> disable excel exports (T395237) and tweak redis resources (T396785)