Page MenuHomePhabricator

Replace custom reindexing code with the Elasticsearch 5 reindex api
Closed, ResolvedPublic

Description

Elasticsearch 5 contains a reindexing api. We should replace our custom work with this more standardized method.

https://www.elastic.co/guide/en/elasticsearch/reference/current/docs-reindex.html

Event Timeline

Change 334009 had a related patch set uploaded (by EBernhardson):
[WIP] Replace reindexing with _reindex API

https://gerrit.wikimedia.org/r/334009

Patch works for the common use case, i need to spend some more time testing it locally. Even once merged we will probably want to try it on some larger indexes on relforge or some such to make sure what it does on small indices with a thousand documents is also sane on multi-million document indices.

Change 334009 merged by jenkins-bot:
[mediawiki/extensions/CirrusSearch] Replace reindexing with _reindex API

https://gerrit.wikimedia.org/r/334009

Change 345248 had a related patch set uploaded (by EBernhardson):
[mediawiki/extensions/CirrusSearch@master] Better handling of slices in reindexing api

https://gerrit.wikimedia.org/r/345248

Change 345248 merged by jenkins-bot:
[mediawiki/extensions/CirrusSearch@master] Better handling of slices in reindexing api

https://gerrit.wikimedia.org/r/345248