Page MenuHomePhabricator
Create Task
Maniphest T210381

Update mw-config to use the psi&omega elastic clusters
Closed, ResolvedPublic
Actions

Description

psi and omega are ready in codfw&eqiad. Next step is testing how CirrusSearch behaves with the multi-instance config in place and enable it.

Details

Show related patches Customize query in gerrit

Related Objects
Search...

Event Timeline

dcausse renamed this task from Update mw-config to use the psy&omega elastic clusters in codfw to Update mw-config to use the psi&omega elastic clusters in codfw .Nov 26 2018, 10:16 AM
dcausse triaged this task as Medium priority.
dcausse created this task.
dcausse updated the task description. (Show Details)
dcausse claimed this task.Nov 26 2018, 10:18 AM
dcausse edited projects, added Discovery-Search (Current work); removed Discovery-Search.
dcausse moved this task from Incoming to not in use - please delete on the Discovery-Search (Current work) board.
gerritbot added a subscriber: gerritbot.Nov 26 2018, 2:27 PM

Change 475746 had a related patch set uploaded (by DCausse; owner: DCausse):
[operations/mediawiki-config@master] [cirrus] multi-instance: add cirrussearch-big-indices.dblist

https://gerrit.wikimedia.org/r/475746

gerritbot added a project: Patch-For-Review.Nov 26 2018, 2:28 PM

Change 475747 had a related patch set uploaded (by DCausse; owner: DCausse):
[operations/mediawiki-config@master] [cirrus] Allow configuration arrays in production services

https://gerrit.wikimedia.org/r/475747

gerritbot added a comment.Nov 26 2018, 2:28 PM

Change 475748 had a related patch set uploaded (by DCausse; owner: DCausse):
[operations/mediawiki-config@master] [cirrus] switch to explicit config in production services

https://gerrit.wikimedia.org/r/475748

gerritbot added a comment.Nov 26 2018, 2:28 PM

Change 475749 had a related patch set uploaded (by DCausse; owner: DCausse):
[operations/mediawiki-config@master] [cirrus] prepare multi-instance services

https://gerrit.wikimedia.org/r/475749

gerritbot added a comment.Nov 26 2018, 2:28 PM

Change 475750 had a related patch set uploaded (by DCausse; owner: DCausse):
[operations/mediawiki-config@master] [cirrus] Start using cirrus multi-instance config

https://gerrit.wikimedia.org/r/475750

gerritbot added a comment.Nov 26 2018, 2:28 PM

Change 475751 had a related patch set uploaded (by DCausse; owner: DCausse):
[operations/mediawiki-config@master] [cirrus] Start using psi&omega in codfw

https://gerrit.wikimedia.org/r/475751

gerritbot added a comment.Nov 26 2018, 2:28 PM

Change 475752 had a related patch set uploaded (by DCausse; owner: DCausse):
[operations/mediawiki-config@master] [cirrus] Start using psi&omega in eqiad

https://gerrit.wikimedia.org/r/475752

dcausse moved this task from not in use - please delete to Needs review on the Discovery-Search (Current work) board.Nov 27 2018, 9:16 AM
gerritbot added a comment.Nov 28 2018, 2:34 PM

Change 475751 abandoned by DCausse:
[cirrus] Start using psi&omega in codfw

https://gerrit.wikimedia.org/r/475751

gerritbot added a comment.Nov 28 2018, 2:35 PM

Change 475752 abandoned by DCausse:
[cirrus] Start using psi&omega in eqiad

https://gerrit.wikimedia.org/r/475752

gerritbot added a comment.Nov 28 2018, 2:35 PM

Change 476271 had a related patch set uploaded (by DCausse; owner: DCausse):
[operations/mediawiki-config@master] [cirrus] Start writing to psi & omega

https://gerrit.wikimedia.org/r/476271

gerritbot added a comment.Nov 28 2018, 2:35 PM

Change 476272 had a related patch set uploaded (by DCausse; owner: DCausse):
[operations/mediawiki-config@master] [cirrus] Start using replica group settings

https://gerrit.wikimedia.org/r/476272

gerritbot added a comment.Nov 28 2018, 2:35 PM

Change 476273 had a related patch set uploaded (by DCausse; owner: DCausse):
[operations/mediawiki-config@master] [cirrus] Cleanup transitional states

https://gerrit.wikimedia.org/r/476273

Stashbot added a subscriber: Stashbot.Nov 29 2018, 12:09 PM

Mentioned in SAL (#wikimedia-operations) [2018-11-29T12:09:54Z] <dcausse@deploy1001> Synchronized wmf-config/CirrusSearch-production.php: T210381: [cirrus] Use normal config for labswiki (duration: 00m 55s)

gerritbot added a comment.Nov 29 2018, 12:11 PM

Change 475746 merged by jenkins-bot:
[operations/mediawiki-config@master] [cirrus] multi-instance: add cirrussearch-big-indices.dblist

https://gerrit.wikimedia.org/r/475746

Stashbot added a comment.Nov 29 2018, 12:13 PM

Mentioned in SAL (#wikimedia-operations) [2018-11-29T12:13:45Z] <dcausse@deploy1001> Synchronized dblists/cirrussearch-big-indices.dblist: T210381: [cirrus] multi-instance: add cirrussearch-big-indices.dblist (duration: 00m 53s)

gerritbot added a comment.Dec 3 2018, 7:01 PM

Change 475747 merged by jenkins-bot:
[operations/mediawiki-config@master] [cirrus] Allow configuration arrays in production services

https://gerrit.wikimedia.org/r/475747

Stashbot added a comment.Dec 3 2018, 7:08 PM

Mentioned in SAL (#wikimedia-operations) [2018-12-03T19:08:08Z] <jforrester@deploy1001> Synchronized wmf-config/CommonSettings.php: SWAT T210381 I2ae162f5 Part I (duration: 00m 46s)

Stashbot added a comment.Dec 3 2018, 7:09 PM

Mentioned in SAL (#wikimedia-operations) [2018-12-03T19:09:14Z] <jforrester@deploy1001> Synchronized wmf-config/CirrusSearch-production.php: SWAT T210381 I2ae162f5 Part II (duration: 00m 47s)

gerritbot added a comment.Dec 3 2018, 7:11 PM

Change 475748 merged by jenkins-bot:
[operations/mediawiki-config@master] [cirrus] switch to explicit config in production services

https://gerrit.wikimedia.org/r/475748

Stashbot added a comment.Dec 3 2018, 7:15 PM

Mentioned in SAL (#wikimedia-operations) [2018-12-03T19:15:36Z] <jforrester@deploy1001> Synchronized wmf-config/ProductionServices.php: SWAT T210381 I73c7596818b Actual config (duration: 00m 46s)

gerritbot added a comment.Dec 5 2018, 12:22 AM

Change 475749 merged by jenkins-bot:
[operations/mediawiki-config@master] [cirrus] prepare multi-instance services

https://gerrit.wikimedia.org/r/475749

Stashbot added a comment.Dec 5 2018, 12:28 AM

Mentioned in SAL (#wikimedia-operations) [2018-12-05T00:28:57Z] <dcausse@deploy1001> Synchronized wmf-config/ProductionServices.php: [cirrus] prepare multi-instance services (T210381) (duration: 00m 46s)

Stashbot added a comment.Dec 5 2018, 12:30 AM

Mentioned in SAL (#wikimedia-operations) [2018-12-05T00:30:10Z] <dcausse@deploy1001> Synchronized wmf-config/InitialiseSettings.php: [cirrus] prepare multi-instance services (T210381) (duration: 00m 46s)

dcausse renamed this task from Update mw-config to use the psi&omega elastic clusters in codfw to Update mw-config to use the psi&omega elastic clusters.Dec 5 2018, 9:50 AM
dcausse updated the task description. (Show Details)
gerritbot added a comment.Dec 5 2018, 12:33 PM

Change 475750 merged by jenkins-bot:
[operations/mediawiki-config@master] [cirrus] Add temp clusters but still write to the old ones

https://gerrit.wikimedia.org/r/475750

Stashbot added a comment.Dec 5 2018, 12:42 PM

Mentioned in SAL (#wikimedia-operations) [2018-12-05T12:42:47Z] <dcausse@deploy1001> Synchronized wmf-config/CommonSettings.php: T210381: [cirrus] Add temp clusters but still write to the old ones 1/2 (duration: 00m 46s)

Stashbot added a comment.Dec 5 2018, 12:44 PM

Mentioned in SAL (#wikimedia-operations) [2018-12-05T12:44:47Z] <dcausse@deploy1001> Synchronized wmf-config/CirrusSearch-production.php: T210381: [cirrus] Add temp clusters but still write to the old ones 2/2 (duration: 00m 46s)

gerritbot added a comment.Dec 12 2018, 10:35 AM

Change 479180 had a related patch set uploaded (by DCausse; owner: DCausse):
[operations/mediawiki-config@master] [cirrus] fix temp clusters for codfw

https://gerrit.wikimedia.org/r/479180

gerritbot added a comment.Dec 13 2018, 12:09 AM

Change 479180 merged by jenkins-bot:
[operations/mediawiki-config@master] [cirrus] fix temp clusters for codfw

https://gerrit.wikimedia.org/r/479180

Stashbot added a comment.Dec 13 2018, 12:13 AM

Mentioned in SAL (#wikimedia-operations) [2018-12-13T00:13:18Z] <dcausse@deploy1001> Synchronized wmf-config/CirrusSearch-production.php: T210381: [cirrus] fix temp clusters for codfw (duration: 00m 52s)

gerritbot added a comment.Dec 13 2018, 1:40 PM

Change 479432 had a related patch set uploaded (by DCausse; owner: DCausse):
[operations/mediawiki-config@master] [cirrus] fix cluster settings for temp clusters psi&omega

https://gerrit.wikimedia.org/r/479432

gerritbot added a comment.Dec 13 2018, 7:39 PM

Change 479432 merged by jenkins-bot:
[operations/mediawiki-config@master] [cirrus] fix cluster settings for temp clusters psi&omega

https://gerrit.wikimedia.org/r/479432

Stashbot added a comment.Dec 13 2018, 7:44 PM

Mentioned in SAL (#wikimedia-operations) [2018-12-13T19:44:51Z] <dcausse@deploy1001> Synchronized wmf-config/CirrusSearch-production.php: T210381: [cirrus] fix cluster settings for temp clusters psi&omega (duration: 00m 44s)

Stashbot added a comment.Jan 14 2019, 2:18 PM

Mentioned in SAL (#wikimedia-operations) [2019-01-14T14:18:46Z] <dcausse> elasticsearch (search cluster): pre-populating omega & psi clusters in eqiad & codfw (from mwmaint1002 and mwmaint2001 respectively) (T210381)

gerritbot added a comment.Jan 14 2019, 7:45 PM

Change 476271 merged by jenkins-bot:
[operations/mediawiki-config@master] [cirrus] Start writing to psi & omega

https://gerrit.wikimedia.org/r/476271

gerritbot added a comment.Jan 15 2019, 10:02 AM

Change 484387 had a related patch set uploaded (by DCausse; owner: DCausse):
[operations/mediawiki-config@master] [cirrus] Add cirrussearch-big-indices tag

https://gerrit.wikimedia.org/r/484387

gerritbot added a comment.Jan 15 2019, 10:02 AM

Change 484388 had a related patch set uploaded (by DCausse; owner: DCausse):
[operations/mediawiki-config@master] [cirrus] Start writing to psi & omega (take 2)

https://gerrit.wikimedia.org/r/484388

gerritbot added a comment.Jan 15 2019, 12:03 PM

Change 484387 merged by jenkins-bot:
[operations/mediawiki-config@master] [cirrus] Add cirrussearch-big-indices tag

https://gerrit.wikimedia.org/r/484387

Stashbot added a comment.Jan 15 2019, 12:09 PM

Mentioned in SAL (#wikimedia-operations) [2019-01-15T12:09:08Z] <dcausse@deploy1001> Synchronized wmf-config/CommonSettings.php: [cirrus] Add cirrussearch-big-indices tag T210381 (duration: 00m 46s)

gerritbot added a comment.Jan 15 2019, 12:28 PM

Change 484388 merged by jenkins-bot:
[operations/mediawiki-config@master] [cirrus] Start writing to psi & omega (take 2)

https://gerrit.wikimedia.org/r/484388

Stashbot added a comment.Jan 15 2019, 12:33 PM

Mentioned in SAL (#wikimedia-operations) [2019-01-15T12:33:15Z] <dcausse@deploy1001> Synchronized wmf-config/CirrusSearch-production.php: T210381: [cirrus] Start writing to psi & omega (take 2) (1/2) (duration: 00m 45s)

Stashbot added a comment.Jan 15 2019, 12:36 PM

Mentioned in SAL (#wikimedia-operations) [2019-01-15T12:36:33Z] <dcausse@deploy1001> Synchronized wmf-config/InitialiseSettings.php: T210381: [cirrus] Start writing to psi & omega (take 2) (2/2) (duration: 00m 45s)

Stashbot added a comment.Jan 15 2019, 3:53 PM

Mentioned in SAL (#wikimedia-operations) [2019-01-15T15:53:12Z] <dcausse> T210381: elastic search clusters, catching up updates since first import on new psi&omega clusters in eqiad&codfw (from mwmaint1002)

Stashbot added a comment.Jan 16 2019, 9:10 AM

Mentioned in SAL (#wikimedia-operations) [2019-01-16T09:10:39Z] <dcausse> T210381: elasticsearch search cluster, creating completion suggester indices on psi&omega elastic instances in eqiad&codfw

gerritbot added a comment.Jan 16 2019, 12:45 PM

Change 476272 merged by jenkins-bot:
[operations/mediawiki-config@master] [cirrus] Start using replica group settings

https://gerrit.wikimedia.org/r/476272

gerritbot added a comment.Jan 16 2019, 3:56 PM

Change 484693 had a related patch set uploaded (by DCausse; owner: DCausse):
[operations/mediawiki-config@master] [cirrus] Start using replica group settings (take 2)

https://gerrit.wikimedia.org/r/484693

gerritbot added a comment.Jan 16 2019, 5:22 PM

Change 484693 merged by jenkins-bot:
[operations/mediawiki-config@master] [cirrus] Start using replica group settings (take 2)

https://gerrit.wikimedia.org/r/484693

Stashbot added a comment.Jan 16 2019, 5:35 PM

Mentioned in SAL (#wikimedia-operations) [2019-01-16T17:35:13Z] <dcausse@deploy1001> Synchronized wmf-config/InitialiseSettings.php: [cirrus] Start using replica group settings (take 2) (T210381) (duration: 00m 51s)

Stashbot added a comment.Jan 16 2019, 5:36 PM

Mentioned in SAL (#wikimedia-operations) [2019-01-16T17:36:53Z] <dcausse@deploy1001> Synchronized wmf-config/CirrusSearch-production.php: [cirrus] Start using replica group settings (take 2) (T210381) (duration: 00m 51s)

gerritbot added a comment.Jan 16 2019, 6:02 PM

Change 484720 had a related patch set uploaded (by DCausse; owner: DCausse):
[operations/mediawiki-config@master] [cirrus] Enable CirrusSearchCrossClusterSearch

https://gerrit.wikimedia.org/r/484720

gerritbot added a comment.Jan 17 2019, 12:48 PM

Change 484720 merged by jenkins-bot:
[operations/mediawiki-config@master] [cirrus] Enable CirrusSearchCrossClusterSearch

https://gerrit.wikimedia.org/r/484720

Stashbot added a comment.Jan 17 2019, 12:53 PM

Mentioned in SAL (#wikimedia-operations) [2019-01-17T12:53:41Z] <dcausse@deploy1001> Synchronized wmf-config/CirrusSearch-production.php: T210381: [cirrus] Enable CirrusSearchCrossClusterSearch (duration: 00m 51s)

EBernhardson added a comment.Mar 6 2019, 9:57 PM

Only open patch remaining: https://gerrit.wikimedia.org/r/#/c/operations/mediawiki-config/+/476273/

gerritbot added a comment.Mar 19 2019, 3:10 PM

Change 476273 had a related patch set uploaded (by DCausse; owner: DCausse):
[operations/mediawiki-config@master] [cirrus] Cleanup transitional states

https://gerrit.wikimedia.org/r/476273

gerritbot added a comment.Apr 1 2019, 6:28 PM

Change 476273 merged by jenkins-bot:
[operations/mediawiki-config@master] [cirrus] Cleanup transitional states

https://gerrit.wikimedia.org/r/476273

Stashbot added a comment.Apr 1 2019, 6:33 PM

Mentioned in SAL (#wikimedia-operations) [2019-04-01T18:33:41Z] <dcausse@deploy1001> Synchronized wmf-config/CirrusSearch-production.php: T210381: [cirrus] Cleanup transitional states (duration: 00m 53s)

EBernhardson moved this task from Needs review to Needs Reporting on the Discovery-Search (Current work) board.Apr 2 2019, 4:23 PM
debt closed this task as Resolved.Apr 5 2019, 10:34 PM
Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL