Page MenuHomePhabricator
Create Task
Maniphest T194199

[Epic] Prepare for Elasticsearch 6 upgrade
Closed, ResolvedPublic
Actions

Description

Search Platform is preparing for an upgrade to Elasticsearch 6 and needs to determine any needs regarding deprecations and other code changes required to any custom plugins in order to complete the upgrade. Related tasks will be attached to this task as they are created.

Details

SubjectRepoBranchLines +/-
elasticsearch: allow a version of configuration independant of the packageoperations/puppetproduction+16 -11
elasticsearch: expose elastic65 APT component to hieraoperations/puppetproduction+2 -1
Customize query in gerrit

Related Objects
Search...

StatusSubtypeAssignedTask
 ResolvedEBernhardsonT183281 [epic] ELK upgrade to 6.x (elasticsearch, kibana, logstash)
 ResolvedNoneT183282 [epic] Search cluster upgrade to 6.x
 ResolvedNoneT194199 [Epic] Prepare for Elasticsearch 6 upgrade
 ResolvedEBernhardsonT192614 Resolve current deprecation warnings in elasticsearch 5
 ResolvedTJonesT194849 Investigate language analyzers in ElasticSearch 6
 ResolvedTJonesT214439 Review Manually re-built Hebmorph plugin
 ResolveddcausseT197960 Upgrade plugins to elastic 6.3
 ResolveddcausseT198066 Upgrade the LTR plugin to elastic 6.3
 ResolveddcausseT198067 Upgrade the extra plugin to elastic 6.3
 ResolveddcausseT198068 Upgrade the extra-analysis plugin to elastic 6.3
 ResolveddcausseT198069 Upgrade the experimental highlighter to elastic 6.3
 ResolveddcausseT199791 Build wmf-elasticsearch-search-plugins.deb that supports elastic 6.5.4
 ResolveddcausseT206468 Upgrade the elasticsearch plugin ltr to elasticsearch 6.4.2
 ResolveddcausseT206469 Upgrade the elasticsearch plugin extra to elasticsearch 6.4.2
 ResolveddcausseT206470 Upgrade the elasticsearch plugin extra-analysis to elasticsearch 6.4.2
 ResolveddcausseT206472 Upgrade the elasticsearch plugin experimental highlighter to elasticsearch 6.4.2
 ResolveddcausseT214312 Upgrade the elasticsearch plugins extra, extra-analysis and highlighter to elasticsearch 6.5.4
ResolveddcausseT200198 Drop the "archive" type in the general index
 ResolvedEBernhardsonT213851 Drop "archive" from generic index on testwiki
 ResolveddcausseT209348 Port the elasticsearch plugin extra-analysis-surrogates to 6.4.2 as a noop plugin
 DuplicateEBernhardsonT215345 Verify ttmserver continues to operate in elastic 6
 ResolvedEBernhardsonT215475 Ensure mjolnir daemons work seamlessly with elasticsearch 5 or 6
 ResolveddcausseT215621 Make sure that ApiFeatureUsage still works with elasticsearch 6.5.4
 Declined• mmodellT181393 Make sure elasticsearch 6 is supported in phabricator
 Resolved• mmodellT230787 Make search context highlights work with the ferret search engine
 ResolvedGehelT218113 Upload elastic 6.5.4 packages to reprepro

Event Timeline

• EBjune created this task.May 8 2018, 7:12 PM
Restricted Application added a subscriber: Aklapper. · View Herald TranscriptMay 8 2018, 7:12 PM
• EBjune added a project: Epic.May 8 2018, 7:13 PM
• EBjune added a subtask: T192614: Resolve current deprecation warnings in elasticsearch 5.
debt closed subtask T192614: Resolve current deprecation warnings in elasticsearch 5 as Resolved.Jun 14 2018, 8:12 PM
EBernhardson added a parent task: T183282: [epic] Search cluster upgrade to 6.x.Jun 27 2018, 7:30 PM
Paladox subscribed.Jun 27 2018, 9:08 PM
• Vvjjkkii renamed this task from [Epic] Prepare for Elasticsearch 6 upgrade to wcdaaaaaaa.Jul 1 2018, 1:11 AM
• Vvjjkkii triaged this task as High priority.
• Vvjjkkii added projects: CheckUser, Connected-Open-Heritage-Batch-uploads (RAÄ-KMB_1_2017-02), Tamil-Sites, Gamepress, Hashtags, Jade, KartoEditor, Language-2018-Apr-June, New-Editor-Experiences, Mail, TCB-Team (now WMDE-TechWish).
• Vvjjkkii updated the task description. (Show Details)
• Vvjjkkii removed a subscriber: Aklapper.
CommunityTechBot renamed this task from wcdaaaaaaa to [Epic] Prepare for Elasticsearch 6 upgrade.Jul 1 2018, 3:16 PM
CommunityTechBot raised the priority of this task from High to Needs Triage.
CommunityTechBot updated the task description. (Show Details)
CommunityTechBot removed projects: TCB-Team (now WMDE-TechWish), Mail, New-Editor-Experiences, Language-2018-Apr-June, KartoEditor, Jade, Hashtags, Gamepress, Tamil-Sites, Connected-Open-Heritage-Batch-uploads (RAÄ-KMB_1_2017-02), CheckUser.
CommunityTechBot added a subscriber: Aklapper.
TJones mentioned this in T202173: Create Esperanto Analysis Chain using new Esperanto Plugin.Aug 17 2018, 9:20 PM
EBernhardson closed subtask T197960: Upgrade plugins to elastic 6.3 as Resolved.Sep 13 2018, 9:59 PM
dcausse removed a subtask: T206468: Upgrade the elasticsearch plugin ltr to elasticsearch 6.4.2.Oct 8 2018, 4:13 PM
debt closed subtask T209348: Port the elasticsearch plugin extra-analysis-surrogates to 6.4.2 as a noop plugin as Resolved.Dec 13 2018, 6:05 PM
debt closed subtask T200198: Drop the "archive" type in the general index as Resolved.Jan 26 2019, 7:27 PM
TJones edited projects, added Discovery-Search; removed Discovery-Search (Current work).Jan 29 2019, 10:04 PM
TJones moved this task from needs triage to [epic] on the Discovery-Search board.
dcausse added a subtask: T215621: Make sure that ApiFeatureUsage still works with elasticsearch 6.5.4.Feb 8 2019, 3:17 PM
dcausse triaged this task as High priority.Feb 12 2019, 10:34 AM
dcausse added a subtask: T181393: Make sure elasticsearch 6 is supported in phabricator.
debt closed subtask T215621: Make sure that ApiFeatureUsage still works with elasticsearch 6.5.4 as Resolved.Feb 15 2019, 7:05 PM
debt closed subtask T215475: Ensure mjolnir daemons work seamlessly with elasticsearch 5 or 6 as Resolved.Feb 15 2019, 7:10 PM
debt closed subtask T194849: Investigate language analyzers in ElasticSearch 6 as Resolved.
gerritbot subscribed.Mar 12 2019, 3:39 PM

Change 495915 had a related patch set uploaded (by Gehel; owner: Gehel):
[operations/puppet@production] elasticsearch: expose elastic65 APT component to hiera

https://gerrit.wikimedia.org/r/495915

gerritbot added a project: Patch-For-Review.Mar 12 2019, 3:39 PM
gerritbot added a comment.Mar 12 2019, 3:52 PM

Change 495919 had a related patch set uploaded (by Gehel; owner: Gehel):
[operations/puppet@production] elasticsearch: allow a version of configuration independant of the package

https://gerrit.wikimedia.org/r/495919

gerritbot added a comment.Mar 13 2019, 4:31 PM

Change 495915 merged by Gehel:
[operations/puppet@production] elasticsearch: expose elastic65 APT component to hiera

https://gerrit.wikimedia.org/r/495915

gerritbot added a comment.Mar 13 2019, 4:39 PM

Change 495919 merged by Gehel:
[operations/puppet@production] elasticsearch: allow a version of configuration independant of the package

https://gerrit.wikimedia.org/r/495919

debt closed subtask T218113: Upload elastic 6.5.4 packages to reprepro as Resolved.Mar 14 2019, 9:14 PM
• Lucas_Werkmeister_WMDE mentioned this in T219364: Elasticsearch indices went read-only causing huge lag.Mar 27 2019, 11:01 AM
Maintenance_bot removed a project: Patch-For-Review.May 22 2019, 3:20 PM
EBernhardson closed this task as Resolved.Jun 3 2019, 5:04 PM
• mmodell changed the status of subtask T181393: Make sure elasticsearch 6 is supported in phabricator from Open to Stalled.Jan 22 2020, 6:13 PM
• mmodell closed subtask T181393: Make sure elasticsearch 6 is supported in phabricator as Declined.Aug 19 2020, 3:48 PM
Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL