[epic] Upgrade elasticsearch to 5.3.2
Closed, ResolvedPublic
Actions

Assigned To

Authored By

	dcausse
	Apr 24 2017, 3:45 PM

Description

Top level task for elasticsearch 5.3.2 upgrade.

Related Objects
Search...

Status	Assigned	Task
Resolved	dcausse	T160829 Wildcard characters not working in CirrusSearch when using uppercase characters
Resolved	Gehel	T163703 [epic] Upgrade elasticsearch to 5.3.2
Resolved	dcausse	T163704 Upgrade and publish wmf elastic plugins to 5.3.2
Resolved	Gehel	T160948 Deploy new versions of Wikimedia and other Elasticsearch plugins
Resolved	Gehel	T163705 Upload elastic 5.3.2 to the experimental apt repo
Resolved	Gehel	T163707 Upgrade the deployment-prep cluster to elastic 5.3.2
Resolved	None	T163708 Upgrade the production search cluster to elastic 5.3.2
Resolved	debt	T163709 Upgrade the logstash cluster to elastic 5.3.2
Resolved	Paladox	T163710 Check compatibility with phab search and elastic 5.3.1
Resolved	• bd808	T164842 Upgrade Tool Labs elasticsearch to 5.x

Event Timeline

dcausse created this task.Apr 24 2017, 3:45 PM

Restricted Application edited projects, added Discovery-ARCHIVED, Discovery-Search; removed Discovery-Search (Current work). · View Herald TranscriptApr 24 2017, 3:45 PM

Restricted Application added a subscriber: Aklapper. · View Herald Transcript

dcausse created subtask T163704: Upgrade and publish wmf elastic plugins to 5.3.2.Apr 24 2017, 3:46 PM

dcausse added a subtask: T160948: Deploy new versions of Wikimedia and other Elasticsearch plugins.Apr 24 2017, 3:51 PM

dcausse added a subtask: T163705: Upload elastic 5.3.2 to the experimental apt repo.

dcausse added a parent task: T160829: Wildcard characters not working in CirrusSearch when using uppercase characters.

dcausse created subtask T163707: Upgrade the deployment-prep cluster to elastic 5.3.2.Apr 24 2017, 3:57 PM

dcausse created subtask T163708: Upgrade the production search cluster to elastic 5.3.2.

dcausse created subtask T163709: Upgrade the logstash cluster to elastic 5.3.2.

dcausse created subtask T163710: Check compatibility with phab search and elastic 5.3.1.Apr 24 2017, 4:00 PM

dcausse closed subtask T163707: Upgrade the deployment-prep cluster to elastic 5.3.2 as Resolved.Apr 24 2017, 5:10 PM

dcausse reopened subtask T163707: Upgrade the deployment-prep cluster to elastic 5.3.2 as Open.

dcausse closed subtask T163710: Check compatibility with phab search and elastic 5.3.1 as Resolved.Apr 24 2017, 5:13 PM

We'll need to discuss and figure out when we want to tackle this.

• ksmith added a project: Epic.Apr 27 2017, 5:08 PM

debt mentioned this in T160829: Wildcard characters not working in CirrusSearch when using uppercase characters.Apr 27 2017, 5:09 PM

dcausse renamed this task from [epic] Upgrade elasticsearch to 5.3.1 to [epic] Upgrade elasticsearch to 5.3.2.May 2 2017, 7:31 AM

dcausse updated the task description. (Show Details)

Gehel claimed this task.May 9 2017, 1:21 PM

Gehel edited projects, added Discovery-Search (Current work); removed Discovery-Search.

Gehel moved this task from Incoming to not in use - please delete on the Discovery-Search (Current work) board.

Mentioned in SAL (#wikimedia-operations) [2017-05-09T13:23:38Z] <gehel> upgrading elasticsearch on relforge - T163703

Mentioned in SAL (#wikimedia-operations) [2017-05-09T13:39:41Z] <gehel> cancel upgrading elasticsearch on relforge (plugin under test is missing a release for 5.3.2) - T163703

• bd808 added a subtask: T164842: Upgrade Tool Labs elasticsearch to 5.x.May 9 2017, 3:11 PM

This upgrade will generate huge log spam in elastic config:
One is related to a bug in elastic we had to workaround and now fixed (but generates deprecation warning):
[2017-05-10T02:41:46,682][WARN ][org.elasticsearch.deprecation.common.ParseField] Deprecated field [max_determined_states] used, expected [max_determinized_states] instead
And will be fixed by deploying https://gerrit.wikimedia.org/r/#/c/353100/

Another lines that is currently spamming deployment-prep logs is :
[2017-05-10T02:41:41,311][WARN ][org.elasticsearch.deprecation.rest.RestController] Content type detection for rest requests is deprecated. Specify the content type using the [Content-Type] header.
This one is unexpected and we should probably look into fixing before upgrading the production cluster.

debt closed subtask T163709: Upgrade the logstash cluster to elastic 5.3.2 as Resolved.May 30 2017, 5:18 PM

debt closed subtask T163707: Upgrade the deployment-prep cluster to elastic 5.3.2 as Resolved.

debt closed subtask T163705: Upload elastic 5.3.2 to the experimental apt repo as Resolved.

debt closed subtask T163704: Upgrade and publish wmf elastic plugins to 5.3.2 as Resolved.May 30 2017, 5:23 PM

EBernhardson moved this task from not in use - please delete to Needs Reporting on the Discovery-Search (Current work) board.Jun 13 2017, 5:22 PM

EBernhardson moved this task from Needs Reporting to not in use - please delete on the Discovery-Search (Current work) board.

EBernhardson moved this task from not in use - please delete to Needs Reporting on the Discovery-Search (Current work) board.Jun 15 2017, 4:41 PM

Shizhao closed subtask T160948: Deploy new versions of Wikimedia and other Elasticsearch plugins as Resolved.Jun 16 2017, 2:08 AM

debt closed this task as Resolved.Jun 16 2017, 5:33 PM

debt closed subtask T163708: Upgrade the production search cluster to elastic 5.3.2 as Resolved.

• bd808 closed subtask T164842: Upgrade Tool Labs elasticsearch to 5.x as Resolved.Jul 14 2017, 12:39 AM