Page MenuHomePhabricator

CirrusSearch: Problems during in place reindex while changing number of shards
Closed, ResolvedPublic

Description

Cirrus has some problems performing an in place reindex while changing the number of shards.

  1. The size parameter sent to elasticsearch is based on the new shard count rather than the current shard count.
  2. The size parameter is sent as a floating point number if the new shard count doesn't evenly divide 1000.

For ease of work it is probably simpler to fix the second problem first.


Version: unspecified
Severity: normal

Details

Reference
bz58550

Event Timeline

bzimport raised the priority of this task from to High.Nov 22 2014, 2:26 AM
bzimport added a project: CirrusSearch.
bzimport set Reference to bz58550.

I'm really not sure that the size parameter is working properly at all - it looks like it is being used bare rather than as per shard. Note to self: check that when doing this.

Change 102024 had a related patch set uploaded by Manybubbles:
Fix chunk size on in place reindex

https://gerrit.wikimedia.org/r/102024

Change 102024 merged by jenkins-bot:
Fix chunk size on in place reindex

https://gerrit.wikimedia.org/r/102024