Page MenuHomePhabricator

Ingenico WX audit parser taking crazy long, mysql connect dying
Closed, ResolvedPublic2 Estimated Story Points

Description

Something's wrong with the WX parser - it seems to have taken 10 hrs to parse wx1.000000657020171207.010231.xml.gz

After that, it tries doing some SQL queries and gets a 'MySQL server has gone away' error.

Something exponential going on in the parsing?

Event Timeline

Change 397608 had a related patch set uploaded (by Ejegg; owner: Ejegg):
[wikimedia/fundraising/SmashPig@master] Use XMLReader for WX audit

https://gerrit.wikimedia.org/r/397608

Change 397608 merged by jenkins-bot:
[wikimedia/fundraising/SmashPig@master] Use XMLReader for WX audit

https://gerrit.wikimedia.org/r/397608

Thanks for calling out those missing refunds @MBeat33 ! Turned out to be a great opportunity for a performance fix.

Ejegg claimed this task.
Ejegg set the point value for this task to 2.