Page MenuHomePhabricator

CirrusSearch: forceSearchIndex.php leaks memory
Closed, ResolvedPublic

Description

forceSearchIndex.php leaks memory. After queueing three million titles the process takes up ~2GB of memory.


Version: unspecified
Severity: normal

Details

Reference
bz59164

Event Timeline

bzimport raised the priority of this task from to High.
bzimport set Reference to bz59164.

Change 104745 had a related patch set uploaded by Manybubbles:
Leak less memory in forceSearchIndex.php

https://gerrit.wikimedia.org/r/104745

Change 104745 merged by jenkins-bot:
Leak less memory in forceSearchIndex.php

https://gerrit.wikimedia.org/r/104745

Change 105091 had a related patch set uploaded by Manybubbles:
Build fixed size chunks when indexing

https://gerrit.wikimedia.org/r/105091

Change 105091 merged by Chad:
Build fixed size chunks when indexing

https://gerrit.wikimedia.org/r/105091

We've worked around this in two ways:

  1. Leaking less memory.
  2. Letting you spit out fixed sized chunks and telling you to do so in the README.