Page MenuHomePhabricator

Evaluate merging multiple small indices into the same index in elasticsearch
Closed, DeclinedPublic

Description

Talking to a couple elasticsearch engineers at elasticon one suggestion for how to deal with our master node timeout on cluster state update issues was to compact multiple small indices into a single index. The suggested method was to use different field names for each type, such as title_aawiki, title_abwiki, etc. etc. This would allow to massively shrink the number of indices and shards the elasticsearch master needs to keep track of.

Event Timeline

EBernhardson raised the priority of this task from to Needs Triage.
EBernhardson updated the task description. (Show Details)
EBernhardson added a project: CirrusSearch.
EBernhardson added subscribers: EBernhardson, dcausse.
Restricted Application added subscribers: StudiesWorld, Aklapper. · View Herald Transcript
Gehel subscribed.

The approach we've taken is to create multiple clusters, to this task does not make sense anymore.