Page MenuHomePhabricator
Create Task
Maniphest T263142

[EPIC] Upgrade Elasticsearch to version 7.10
Closed, ResolvedPublic
Actions

Details

SubjectRepoBranchLines +/-
Deprecate MWElasticUtils::isFrozen()mediawiki/extensions/Elasticamaster+2 -13
Customize query in gerrit

Related Objects
Search...

StatusSubtypeAssignedTask
 ResolvedNoneT248925 Make MediaWiki release tarball compatible with PHP 8.0
 ResolvedJdforrester-WMFT300463 Make PHP 8.0 voting on MW master
 ResolvedNoneT283275 Make MW master tests pass on PHP 8.0
 ResolvedReedyT268861 CirrusSearch uses Elastica's Match class
 ResolvedReedyT268863 Translate uses Elastica's Match class
 ResolvedmatthiasmullieT268866 WikibaseMediaInfo uses Elastica's Match class
 InvalidNoneT268864 WikibaseCirrusSearch uses Elastica's Match class
 ResolvedReedyT268865 WikibaseLexemeCirrusSearch uses Elastica's Match class
 ResolvedEBernhardsonT271777 Bump rufin/elastica (and related libraries) to versions that support PHP 8.0
 ResolvedGehelT263142 [EPIC] Upgrade Elasticsearch to version 7.10
 ResolvedEBernhardsonT218994 Deprecation warning on elasticsearch 6
ResolvedEBernhardsonT218995 re-enable deprecation warning logger on elasticsearch once issues are solved
 ResolveddcausseT219265 Elasticsearch 6: _retry_on_conflict is deprecated
 ResolveddcausseT219266 Elasticsearch 6 nested_path and nested_filter are deprecated
 ResolveddcausseT219267 Elasticsearch 6: auto_generate_phrase_queries is deprecated and ineffective
 ResolveddcausseT219268 Elasticsearch 6: the classic similarity is deprecated
 ResolveddcausseT219533 Reindex space less languages wikis to use BM25
 OpenNoneT219534 Test MLR models for zhwiki, jawiki and kowiki
 ResolvedEBernhardsonT219269 Elasticsearch 6: silence deprecation warnings to avoid logspam
 DuplicateNoneT215615 Stop using negative scores for deboosting statements
 ResolvedEBernhardsonT288764 Set include_type_name in all get requests
 Resolved• EJosephT288765 Always provide minimum_should_match in bool queries
 ResolvedEBernhardsonT306123 Ensure mjolnir models have positive scores
 DuplicateNoneT273814 Create ElasticSearch 7.10 image in releng/dev-images
 ResolvedGehelT295666 Upgrade Cirrus elasticsearch clusters to 6.8.23
 Resolved• EJosephT294499 Upgrade Cirrus elasticsearch plugins to 6.8.23
 ResolvedbkingT301954 Upgrade deployment-prep to elasticsearch 6.8.23
 ResolvedbkingT301955 Upgrade relforge to elasticsearch 6.8.23
 ResolvedRKemperT278378 Pull Elasticsearch config out of Spicerack
 ResolvedRKemperT301956 Upgrade cloudelastic to elasticsearch 6.8.23
 ResolvedRKemperT301958 Upgrade Search elasticsearch cluster / codfw to elasticsearch 6.8.23
 ResolvedRKemperT301959 Upgrade Search elasticsearch cluster / eqiad to elasticsearch 6.8.23
 ResolvedGehelT304570 elasticsearch: make rolling upgrade proceed to second host after shards are stable
 ResolvedbkingT289135 Upgrade Cirrus Elasticsearch clusters to Debian Bullseye
 ResolvedbkingT299797 Deploy new bullseye elastic cluster nodes on deployment-prep
 ResolvedbkingT301408 Enable search team SRE access to deployment-prep VMs
 ResolvedbkingT307510 Update tls proxy config for Bullseye
 ResolvedbkingT308770 Reimage relforge elastic hosts from Stretch to Bullseye
 ResolvedbkingT309343 Upgrade cloudelastic clusters to Debian Bullseye
 ResolvedbkingT312298 Update NIC firmware on all Elastic PowerEdge R440 elastic hosts
 ResolvedEBernhardsonT295736 Evaluate deployed elasticsearch plugins for 7.10 compatability
 ResolvedEBernhardsonT295734 Bring up two copies of the CirrusSearch browser integration env in cloud
 ResolvedTJonesT300302 Test Elastic 6.8 language analyzers
 Resolved• ZbyszkoT300833 Address "Log4shell" vulnerability in Elasticsearch 7.10.2
 DeclinedNoneT301724 Sunset ApiFeatureUsage
 DeclinedNoneT302638 Sunset ApiFeatureUsage (TDMP)
 ResolvedTJonesT301131 Test Elastic 7.10 language analyzers
 ResolvedEBernhardsonT317200 Reindex all wikis to fix nnbsp regression
 DeclinedNoneT303443 Ensure that all applications depending on the Search Elasticsearch cluster are compatible with Elasticsearch 7.10
 Resolvedbd808T303444 Ensure Toolhub is compatible with Elasticsearch 7.10
 DeclinedNoneT303445 Ensure Phabricator is compatible with Elasticsearch 7.10
 ResolvedEBernhardsonT304290 Create docker elasticsearch images with wmf search plugins
 DeclinedNoneT304569 Remove row/rack awareness in Elasticsearch config
 ResolveddcausseT305428 Upgrade the Translate TTM Elasticsearch implementation to elasticsearch 6.8 and onwards
ResolvedEBernhardsonT306644 re-run wbsearchentities optimization process
ResolvedEBernhardsonT307931 Run CirrusSearch test suite against Elasticsearch 7.10
 ResolvedEBernhardsonT308676 Elasticsearch 7.10.2 rollout plan
 ResolvedbkingT315604 Upgrade relforge cluster to 7.10.2
 ResolvedGehelT316159 Upgrade cloudelastic cluster to 7.10.2
 ResolvedGehelT316240 Upgrade deployment-prep to Elasticsearch 7.10.2
 ResolvedRKemperT316719 Upgrade codfw cluster to Elasticsearch 7.10.2
 ResolvedBUG REPORTEBernhardsonT317381 Reduction in helpfulness and quantity of autocomplete search results
 ResolvedEBernhardsonT317374 Search now caps total results count at 10k because of elasticsearch 7 upgrade
 ResolvedRKemperT317686 Upgrade eqiad cluster to Elasticsearch 7.10.2
 ResolvedEBernhardsonT313434 Migrate apifeatureusage to elasticsearch 7
 ResolvedkostajhT317513 Flow is incompatible with Elastica - Remove ElasticSearch integration / Flow search

Event Timeline

Gehel created this task.Sep 17 2020, 3:55 PM
Restricted Application added a subscriber: Aklapper. · View Herald TranscriptSep 17 2020, 3:55 PM
Gehel added a subtask: T218994: Deprecation warning on elasticsearch 6 .Sep 17 2020, 3:56 PM
CBogen renamed this task from Upgrade Elasticsearch to version 7.x to [EPIC] Upgrade Elasticsearch to version 7.x.Sep 17 2020, 3:57 PM
fgiunchedi subscribed.Sep 21 2020, 5:00 PM
CBogen triaged this task as High priority.Sep 28 2020, 3:40 PM
CBogen moved this task from needs triage to [epic] on the Discovery-Search board.Sep 28 2020, 3:42 PM
Reedy mentioned this in T268861: CirrusSearch uses Elastica's Match class.Nov 27 2020, 4:20 AM
Jdforrester-WMF mentioned this in T271777: Bump rufin/elastica (and related libraries) to versions that support PHP 8.0.Jan 12 2021, 1:50 AM
Jdforrester-WMF added a parent task: T271777: Bump rufin/elastica (and related libraries) to versions that support PHP 8.0.
WMDE-leszek subscribed.Jan 21 2021, 6:19 AM
Daimona subscribed.Feb 17 2021, 9:00 PM
Reedy mentioned this in T275166: CirrusSearch ParseError: "syntax error, unexpected token "match", expecting ":"" (collision with new PHP8 match keyword?).Feb 18 2021, 10:49 PM
kostajh changed the status of subtask T273814: Create ElasticSearch 7.10 image in releng/dev-images from Open to Stalled.Feb 23 2021, 8:54 AM
• toan subscribed.Mar 4 2021, 1:54 PM
dcausse mentioned this in T280482: Validate that OpenSearch is a viable replacement for Elasticsearch for CirrusSearch.Apr 19 2021, 8:34 AM
Gehel mentioned this in T289135: Upgrade Cirrus Elasticsearch clusters to Debian Bullseye.Aug 18 2021, 11:51 AM
taavi subscribed.Aug 22 2021, 4:03 PM
Reedy mentioned this in T271736: Migrate WMF production from PHP 7.2 to PHP 7.4.Sep 2 2021, 12:54 PM
Reedy removed a parent task: T271777: Bump rufin/elastica (and related libraries) to versions that support PHP 8.0.Oct 8 2021, 2:25 PM
• MPhamWMF moved this task from [epic] to Current work on the Discovery-Search board.Oct 18 2021, 3:30 PM
• MPhamWMF edited projects, added Discovery-Search (Current work); removed Discovery-Search.
• MPhamWMF moved this task from Incoming to Epics on the Discovery-Search (Current work) board.Oct 18 2021, 3:50 PM
• MPhamWMF renamed this task from [EPIC] Upgrade Elasticsearch to version 7.x to [EPIC] Upgrade Elasticsearch to version 7.11.Oct 26 2021, 4:34 PM
• MPhamWMF renamed this task from [EPIC] Upgrade Elasticsearch to version 7.11 to [EPIC] Upgrade Elasticsearch to version 7.10.Oct 27 2021, 9:14 PM
• MPhamWMF added a subtask: T295666: Upgrade Cirrus elasticsearch clusters to 6.8.23.Nov 15 2021, 1:48 PM
• MPhamWMF added a subtask: T289135: Upgrade Cirrus Elasticsearch clusters to Debian Bullseye.Nov 15 2021, 2:04 PM
• MPhamWMF added a subtask: T295736: Evaluate deployed elasticsearch plugins for 7.10 compatability.Nov 16 2021, 4:02 AM
• MPhamWMF added a subtask: T295734: Bring up two copies of the CirrusSearch browser integration env in cloud.
• sdkim mentioned this in T295942: Add optimized Elasticsearch field mappings for autocomplete searches.Nov 24 2021, 7:46 PM
• toan mentioned this in T297002: Elasticsearch 6.5.4 docker image contains critical security issues.Dec 9 2021, 11:09 AM
Justin_C_Lloyd subscribed.Dec 13 2021, 7:59 PM
bd808 subscribed.Jan 6 2022, 12:22 AM
Universal_Omega subscribed.Jan 25 2022, 5:52 PM
• MPhamWMF added a subtask: T300302: Test Elastic 6.8 language analyzers.Jan 31 2022, 3:49 PM
• MPhamWMF added a subtask: T301724: Sunset ApiFeatureUsage.Feb 14 2022, 11:33 PM
• Zbyszko closed subtask T300833: Address "Log4shell" vulnerability in Elasticsearch 7.10.2 as Resolved.Feb 15 2022, 9:16 AM
TJones added a subtask: T301131: Test Elastic 7.10 language analyzers.Feb 16 2022, 8:16 PM
Gehel closed subtask T294499: Upgrade Cirrus elasticsearch plugins to 6.8.23 as Resolved.Feb 21 2022, 2:22 PM
Gehel closed subtask T295736: Evaluate deployed elasticsearch plugins for 7.10 compatability as Resolved.
Gehel closed subtask T300302: Test Elastic 6.8 language analyzers as Resolved.Feb 21 2022, 2:25 PM
Krinkle mentioned this in T302638: Sunset ApiFeatureUsage (TDMP).Feb 26 2022, 2:01 PM
Gehel added a subtask: T303444: Ensure Toolhub is compatible with Elasticsearch 7.10.Mar 14 2022, 3:19 PM
Gehel added a subtask: T303445: Ensure Phabricator is compatible with Elasticsearch 7.10.
Gehel closed subtask T303443: Ensure that all applications depending on the Search Elasticsearch cluster are compatible with Elasticsearch 7.10 as Declined.
Gehel added a subtask: T304290: Create docker elasticsearch images with wmf search plugins.Mar 21 2022, 3:16 PM
• MPhamWMF added a subtask: T304569: Remove row/rack awareness in Elasticsearch config.Mar 24 2022, 1:32 PM
bking closed subtask T304569: Remove row/rack awareness in Elasticsearch config as Declined.Mar 28 2022, 3:17 PM
brennen closed subtask T303445: Ensure Phabricator is compatible with Elasticsearch 7.10 as Declined.Mar 30 2022, 12:37 AM
dcausse added a subtask: T305428: Upgrade the Translate TTM Elasticsearch implementation to elasticsearch 6.8 and onwards .Apr 5 2022, 7:21 AM
Gehel added a parent task: T271777: Bump rufin/elastica (and related libraries) to versions that support PHP 8.0.Apr 6 2022, 7:46 PM
IijimaYun subscribed.Apr 11 2022, 6:12 AM
gerritbot added a comment.Apr 12 2022, 4:35 PM

Change 779508 had a related patch set uploaded (by DCausse; author: DCausse):

[mediawiki/extensions/Elastica@master] Deprecate MWElasticUtils::isFrozen()

https://gerrit.wikimedia.org/r/779508

gerritbot added a project: Patch-For-Review.Apr 12 2022, 4:35 PM
gerritbot added a comment.Apr 14 2022, 3:19 PM

Change 779508 merged by jenkins-bot:

[mediawiki/extensions/Elastica@master] Deprecate MWElasticUtils::isFrozen()

https://gerrit.wikimedia.org/r/779508

Maintenance_bot removed a project: Patch-For-Review.Apr 14 2022, 3:32 PM
ReleaseTaggerBot added a project: MW-1.39-notes (1.39.0-wmf.8; 2022-04-18).Apr 14 2022, 4:00 PM
• MPhamWMF added a subtask: T306644: re-run wbsearchentities optimization process .Apr 26 2022, 9:19 PM
kostajh subscribed.May 4 2022, 1:00 PM
Gehel closed subtask T304290: Create docker elasticsearch images with wmf search plugins as Resolved.May 9 2022, 9:24 AM
Gehel closed subtask T295666: Upgrade Cirrus elasticsearch clusters to 6.8.23 as Resolved.
Gehel closed subtask T295734: Bring up two copies of the CirrusSearch browser integration env in cloud as Resolved.
dcausse added a subtask: T308676: Elasticsearch 7.10.2 rollout plan.May 18 2022, 2:18 PM
Reedy closed subtask T301724: Sunset ApiFeatureUsage as Declined.May 18 2022, 7:23 PM
bd808 closed subtask T303444: Ensure Toolhub is compatible with Elasticsearch 7.10 as Resolved.Jun 30 2022, 9:15 PM
bd808 mentioned this in T303444: Ensure Toolhub is compatible with Elasticsearch 7.10.
bd808 mentioned this in T311787: Upgrade elasticsearch python client libraries after production service.Jun 30 2022, 9:28 PM
0xDeadbeef subscribed.Jul 24 2022, 10:48 AM
Gehel closed subtask T306644: re-run wbsearchentities optimization process as Resolved.Jul 25 2022, 2:18 PM
Gehel closed subtask T307931: Run CirrusSearch test suite against Elasticsearch 7.10 as Resolved.
Gehel closed subtask T305428: Upgrade the Translate TTM Elasticsearch implementation to elasticsearch 6.8 and onwards as Resolved.
bking closed subtask T289135: Upgrade Cirrus Elasticsearch clusters to Debian Bullseye as Resolved.Aug 22 2022, 3:20 PM
Gehel closed subtask T218994: Deprecation warning on elasticsearch 6 as Resolved.Aug 29 2022, 2:32 PM
Jdforrester-WMF closed subtask T317513: Flow is incompatible with Elastica - Remove ElasticSearch integration / Flow search as Resolved.Sep 12 2022, 8:53 AM
Gehel closed subtask T301131: Test Elastic 7.10 language analyzers as Resolved.Sep 26 2022, 10:24 AM
Gehel closed subtask T308676: Elasticsearch 7.10.2 rollout plan as Resolved.Sep 26 2022, 10:38 AM
Gehel closed subtask T313434: Migrate apifeatureusage to elasticsearch 7 as Resolved.
Gehel closed this task as Resolved.Sep 29 2022, 7:24 AM
Gehel claimed this task.

Migration is completed!

bd808 awarded a token.Sep 29 2022, 3:37 PM
Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL · Credits