Parsoid runs out of memory when parsing 'User_talk:Trekphiler/Archive_6'
Closed, DeclinedPublic
Actions

Assigned To

None

Authored By

	• GWicke
	Jun 10 2013, 2:56 AM

Project Tags

Referenced Files

None

Subscribers

Description

time node roundtrip-test.js --debug 'User_talk:Trekphiler/Archive_6'
FATAL ERROR: JS Allocation failed - process out of memory

real 26m49.157s
user 25m59.680s
sys 0m18.936s

Version: unspecified
Severity: normal

Details

Reference: bz49374

Related Objects

Mentioned Here: T236833: wt2html: Out of memory crashers

Event Timeline

• bzimport raised the priority of this task from to Medium.Nov 22 2014, 2:04 AM

• bzimport added a project: Parsoid.

• bzimport set Reference to bz49374.

• GWicke created this task.Jun 10 2013, 2:56 AM

Since this is an extremely large page I lowered the priority to 'normal'.

Similar issue: [[:fr:Liste_des_premiers_préfets_français_(1800-1815)]]

(In reply to Gabriel Wicke from comment #2)

Similar issue: [[:fr:Liste_des_premiers_préfets_français_(1800-1815)]]

This one seems ok on master now,

time node roundtrip-test.js --prefix frwiki 'Liste_des_premiers_préfets_français_(1800-1815)'

SUMMARY:
Semantic differences : 0

Syntactic differences: 5

ALL differences : 5

master shutting down, killing workers

real 4m54.542s
user 2m23.546s
sys 0m1.474s

Arlolra removed • GWicke as the assignee of this task.Nov 25 2014, 8:08 PM

Arlolra set Security to None.

ssastry moved this task from Needs Triage to Performance on the Parsoid board.Dec 20 2014, 1:01 AM

• marcoil added a project: Performance Issue.Feb 10 2015, 3:11 PM

• marcoil moved this task from Performance to Needs Triage on the Parsoid board.Feb 13 2015, 12:51 PM

Bots seem to be transcluding a lot of repeating newsletters on that page,

<!-- EdwardsBot 0412 -->
== WPF1 Newsletter (November) ==

{{Wikipedia:WikiProject Formula One/Newsletter/201211}}
<small>This newsletter was delivered by [[User:EdwardsBot|EdwardsBot]] ([[User talk:EdwardsBot|talk]]) 00:34, 4 December 2012 (UTC)</small>

Eventually, the php parser hits its post-expand include size limit and stops transcluding content. See:
https://en.wikipedia.org/w/index.php?title=User:Arlolra/sandbox&oldid=692714016

Parsoid doesn't have any such protection and eventually reaches memory exhaustion.

Restricted Application added a subscriber: Aklapper. · View Herald TranscriptNov 27 2015, 8:09 PM

ssastry moved this task from Needs Triage to Performance on the Parsoid board.Dec 18 2017, 10:07 PM

Nowadays parsoid/js has been replaced by parsoid/php. Also see T236833

There is no reason to keep this bug open for a specific page, especially for Parsoid/JS. Parsoid/PHP OOMs are tackled separately.

Parsoid runs out of memory when parsing 'User_talk:Trekphiler/Archive_6'Closed, DeclinedPublicActions