Page MenuHomePhabricator

Parsoid runs out of memory when parsing 'User_talk:Trekphiler/Archive_6'
Closed, DeclinedPublic

Description

time node roundtrip-test.js --debug 'User_talk:Trekphiler/Archive_6'
FATAL ERROR: JS Allocation failed - process out of memory

real 26m49.157s
user 25m59.680s
sys 0m18.936s


Version: unspecified
Severity: normal

Details

Reference
bz49374

Event Timeline

bzimport raised the priority of this task from to Medium.Nov 22 2014, 2:04 AM
bzimport added a project: Parsoid.
bzimport set Reference to bz49374.

Since this is an extremely large page I lowered the priority to 'normal'.

Similar issue: [[:fr:Liste_des_premiers_préfets_français_(1800-1815)]]

(In reply to Gabriel Wicke from comment #2)

Similar issue: [[:fr:Liste_des_premiers_préfets_français_(1800-1815)]]

This one seems ok on master now,

time node roundtrip-test.js --prefix frwiki 'Liste_des_premiers_préfets_français_(1800-1815)'

SUMMARY:
Semantic differences : 0

Syntactic differences: 5

ALL differences : 5

master shutting down, killing workers

real 4m54.542s
user 2m23.546s
sys 0m1.474s

Arlolra set Security to None.

Bots seem to be transcluding a lot of repeating newsletters on that page,

<!-- EdwardsBot 0412 -->
== WPF1 Newsletter (November) ==

{{Wikipedia:WikiProject Formula One/Newsletter/201211}}
<small>This newsletter was delivered by [[User:EdwardsBot|EdwardsBot]] ([[User talk:EdwardsBot|talk]]) 00:34, 4 December 2012 (UTC)</small>

Eventually, the php parser hits its post-expand include size limit and stops transcluding content. See:
https://en.wikipedia.org/w/index.php?title=User:Arlolra/sandbox&oldid=692714016

Parsoid doesn't have any such protection and eventually reaches memory exhaustion.

Nowadays parsoid/js has been replaced by parsoid/php. Also see T236833

There is no reason to keep this bug open for a specific page, especially for Parsoid/JS. Parsoid/PHP OOMs are tackled separately.