Allow elasticsearch machines to communicate with each others on port 9500 and 9700
Closed, ResolvedPublic
Actions

Assigned To

Authored By

	dcausse
	Dec 20 2018, 5:32 PM

Description

Currently only machines within the same cluster can communicate with each others, problem is that with cross cluster search we want node1 to open node2 on port 9700 even if node node1 is not on the cluster responsible for 9700.

Current behavior:

from elastic2042: curl elastic2027.codfw.wmnet:9700 => DENIED
from elastic2042: curl elastic2027.codfw.wmnet:9600 => OK
from elastic2042: curl elastic2027.codfw.wmnet:9643 => OK
from elastic2027: curl elastic2042.codfw.wmnet:9500 => DENIED
from elastic2027: curl elastic2042.codfw.wmnet:9400 => OK
from elastic2027: curl elastic2042.codfw.wmnet:9443 => OK

Expected behavior:

connection opens on all these ports

Same problem is present on eqiad.

Details

	Subject	Repo	Branch	Lines +/-
	elasticsearch: allow cross cluster communication	operations/puppet	production	+9 -3

Customize query in gerrit

Related Objects
Search...

Status	Assigned	Task
Resolved	EBernhardson	T183281 [epic] ELK upgrade to 6.x (elasticsearch, kibana, logstash)
Resolved	None	T183282 [epic] Search cluster upgrade to 6.x
Resolved	debt	T193654 [epic] Run multiple elasticsearch clusters on same hardware
Resolved	• Mathew.onipe	T212434 Allow elasticsearch machines to communicate with each others on port 9500 and 9700

Event Timeline

dcausse created this task.Dec 20 2018, 5:32 PM

Restricted Application added a subscriber: Aklapper. · View Herald TranscriptDec 20 2018, 5:32 PM

dcausse triaged this task as Medium priority.Dec 20 2018, 5:32 PM

dcausse moved this task from needs triage to Current work on the Discovery-Search board.

dcausse edited projects, added Discovery-Search (Current work); removed Discovery-Search.

dcausse added a subscriber: • Mathew.onipe.

dcausse updated the task description. (Show Details)Dec 20 2018, 5:38 PM

dcausse updated the task description. (Show Details)Dec 20 2018, 5:43 PM

dcausse added a parent task: T193654: [epic] Run multiple elasticsearch clusters on same hardware.Dec 20 2018, 5:45 PM

• Mathew.onipe claimed this task.Dec 21 2018, 7:57 AM

• Mathew.onipe added a project: Elasticsearch.Dec 21 2018, 8:00 AM

Restricted Application edited projects, added Discovery-Search; removed Discovery-Search (Current work). · View Herald TranscriptDec 21 2018, 8:00 AM

• Mathew.onipe edited projects, added Discovery-Search (Current work); removed Discovery-Search.Dec 21 2018, 8:15 AM

• Mathew.onipe moved this task from Incoming to not in use - please delete on the Discovery-Search (Current work) board.

Change 481125 had a related patch set uploaded (by Mathew.onipe; owner: Mathew.onipe):
[operations/puppet@production] elasticsearch: allow cross cluster communication

https://gerrit.wikimedia.org/r/481125

gerritbot added a project: Patch-For-Review.Dec 21 2018, 8:19 AM

• Mathew.onipe moved this task from not in use - please delete to Needs review on the Discovery-Search (Current work) board.Dec 27 2018, 7:22 AM

Change 481125 merged by Gehel:
[operations/puppet@production] elasticsearch: allow cross cluster communication

https://gerrit.wikimedia.org/r/481125

• Mathew.onipe moved this task from Needs review to Needs Reporting on the Discovery-Search (Current work) board.Jan 7 2019, 4:49 PM

debt closed this task as Resolved.Jan 14 2019, 11:45 PM