Page MenuHomePhabricator

Adapt or configure mjolnir so that it knows all search clusters within a DC
Closed, ResolvedPublic

Description

Mjolnir is currently configured to get the list of indices from localhost:9200, with multi-instances per node in place this will no longer work.
Adding more ports to check won't work neither since not all clusters are running as a dedicated instance on every node.
Using LVS+port endpoints is not an option as well since the LVS hostname resolves to localhost.

  1. We could add another set of configuration parameters using puppet by picking a list of "seed" nodes per cluster
  2. We could use the cluster state available from localhost:9200 because it should have a list of seed hosts configured as a cross cluster search pointing to the two small clusters.

Options 2 seems easier to implement and seems to help to reduce the moving parts in the multi-instance setup.

Event Timeline

Restricted Application added a subscriber: Aklapper. · View Herald Transcript
dcausse triaged this task as Medium priority.Dec 12 2018, 10:14 AM
dcausse updated the task description. (Show Details)

Change 479232 had a related patch set uploaded (by DCausse; owner: DCausse):
[search/MjoLniR@master] Augment the list of known clusters using cluster conf

https://gerrit.wikimedia.org/r/479232

Change 479232 merged by jenkins-bot:
[search/MjoLniR@master] Augment the list of known clusters using cluster conf

https://gerrit.wikimedia.org/r/479232