Page MenuHomePhabricator

Evaluate merging multiple small indices into the same index in elasticsearch
Open, Needs TriagePublic

Description

Talking to a couple elasticsearch engineers at elasticon one suggestion for how to deal with our master node timeout on cluster state update issues was to compact multiple small indices into a single index. The suggested method was to use different field names for each type, such as title_aawiki, title_abwiki, etc. etc. This would allow to massively shrink the number of indices and shards the elasticsearch master needs to keep track of.

Event Timeline

EBernhardson raised the priority of this task from to Needs Triage.
EBernhardson updated the task description. (Show Details)
EBernhardson added a project: CirrusSearch.
EBernhardson added subscribers: EBernhardson, dcausse.
Restricted Application added a project: Discovery. · View Herald TranscriptFeb 18 2016, 12:53 AM
Restricted Application added subscribers: StudiesWorld, Aklapper. · View Herald Transcript
Deskana moved this task from Uncategorised to Technical on the CirrusSearch board.Feb 18 2016, 4:10 AM