Page MenuHomePhabricator
Create Task
Maniphest T281217

Replace rdb1005, rdb1006 with rdb1011, rdb1012
Closed, ResolvedPublic
Actions

Details

SubjectRepoBranchLines +/-
rdb1005: Remove from site.ppoperations/puppetproduction+1 -6
rdb1011: Switch to masteroperations/puppetproduction+2 -4
Have rdb1012 replicate from rdb1011operations/puppetproduction+6 -3
Switch all usages of rdb1005 to rdb1011operations/deployment-chartsmaster+9 -9
rdb1005: Switch all usages to rdb1011operations/puppetproduction+3 -3
rdb1006: Switch to decomoperations/puppetproduction+6 -2
rdb1012: Switch to use rdb1011 as masteroperations/puppetproduction+2 -2
site.pp: Setup rdb1011, rdb1012operations/puppetproduction+3 -5
Reimage rdb1011, rdb1012, rdb2009, rdb2010 as bullseyeoperations/puppetproduction+4 -4
Customize query in gerrit

Related Objects
Search...

StatusSubtypeAssignedTask
 ResolvedRequest• CmjohnsonT273139 decommission rdb100[56].eqiad.wmnet
 ResolvedakosiarisT281217 Replace rdb1005, rdb1006 with rdb1011, rdb1012
Unknown Object (Task)
 ResolvedRobHT266724 (Need By: TBD) rack/setup/install rdb101[12]

Event Timeline

Legoktm triaged this task as High priority.Apr 27 2021, 7:21 AM
Legoktm created this task.
Restricted Application added a subscriber: Aklapper. · View Herald TranscriptApr 27 2021, 7:21 AM
Legoktm added a parent task: T273139: decommission rdb100[56].eqiad.wmnet.Apr 27 2021, 7:22 AM
gerritbot added a comment.Apr 27 2021, 7:31 AM

Change 682892 had a related patch set uploaded (by Legoktm; author: Legoktm):

[operations/puppet@production] site.pp: Setup rdb1011, rdb1012

https://gerrit.wikimedia.org/r/682892

gerritbot added a project: Patch-For-Review.Apr 27 2021, 7:31 AM

Change 682893 had a related patch set uploaded (by Legoktm; author: Legoktm):

[operations/puppet@production] Have rdb1012 replicate from rdb1011

https://gerrit.wikimedia.org/r/682893

gerritbot added a comment.Apr 27 2021, 7:52 AM

Change 682896 had a related patch set uploaded (by Legoktm; author: Legoktm):

[operations/puppet@production] Reimage rdb1011, rdb1012, rdb2009, rdb2010 as bullseye

https://gerrit.wikimedia.org/r/682896

gerritbot added a comment.Apr 27 2021, 8:45 AM

Change 682896 merged by Legoktm:

[operations/puppet@production] Reimage rdb1011, rdb1012, rdb2009, rdb2010 as bullseye

https://gerrit.wikimedia.org/r/682896

ops-monitoring-bot added a comment.Apr 27 2021, 8:50 AM

Script wmf-auto-reimage was launched by legoktm on cumin1001.eqiad.wmnet for hosts:

['rdb1011.eqiad.wmnet', 'rdb1012.eqiad.wmnet']

The log can be found in /var/log/wmf-auto-reimage/202104270850_legoktm_24357.log.

ops-monitoring-bot added a comment.Apr 27 2021, 9:04 AM

Completed auto-reimage of hosts:

['rdb1011.eqiad.wmnet', 'rdb1012.eqiad.wmnet']

Of which those FAILED:

['rdb1011.eqiad.wmnet', 'rdb1012.eqiad.wmnet']
gerritbot added a comment.Apr 27 2021, 10:28 PM

Change 682892 merged by Legoktm:

[operations/puppet@production] site.pp: Setup rdb1011, rdb1012

https://gerrit.wikimedia.org/r/682892

Krinkle added a subtask: Unknown Object (Task).Aug 19 2021, 6:27 PM
gerritbot added a comment.Mar 3 2022, 10:15 AM

Change 767730 had a related patch set uploaded (by Alexandros Kosiaris; author: Alexandros Kosiaris):

[operations/puppet@production] rdb1012: Switch to use rdb1011 as master

https://gerrit.wikimedia.org/r/767730

gerritbot added a comment.Mar 3 2022, 10:15 AM

Change 767731 had a related patch set uploaded (by Alexandros Kosiaris; author: Alexandros Kosiaris):

[operations/puppet@production] rdb1006: Switch to decom

https://gerrit.wikimedia.org/r/767731

gerritbot added a comment.Mar 3 2022, 10:15 AM

Change 767732 had a related patch set uploaded (by Alexandros Kosiaris; author: Alexandros Kosiaris):

[operations/puppet@production] rdb1005: Switch all usages to rdb1011

https://gerrit.wikimedia.org/r/767732

gerritbot added a comment.Mar 3 2022, 10:15 AM

Change 767733 had a related patch set uploaded (by Alexandros Kosiaris; author: Alexandros Kosiaris):

[operations/puppet@production] rdb1011: Switch to master

https://gerrit.wikimedia.org/r/767733

gerritbot added a comment.Mar 3 2022, 10:15 AM

Change 767734 had a related patch set uploaded (by Alexandros Kosiaris; author: Alexandros Kosiaris):

[operations/puppet@production] rdb1005: Move to system::spare

https://gerrit.wikimedia.org/r/767734

akosiaris mentioned this in T273139: decommission rdb100[56].eqiad.wmnet.Mar 3 2022, 10:16 AM
gerritbot added a comment.Mar 3 2022, 10:20 AM

Change 767730 merged by Alexandros Kosiaris:

[operations/puppet@production] rdb1012: Switch to use rdb1011 as master

https://gerrit.wikimedia.org/r/767730

gerritbot added a comment.Mar 3 2022, 10:38 AM

Change 767731 merged by Alexandros Kosiaris:

[operations/puppet@production] rdb1006: Switch to decom

https://gerrit.wikimedia.org/r/767731

gerritbot added a comment.Mar 3 2022, 10:49 AM

Change 767742 had a related patch set uploaded (by Alexandros Kosiaris; author: Alexandros Kosiaris):

[operations/deployment-charts@master] Switch all usages of rdb1005 to rdb1011

https://gerrit.wikimedia.org/r/767742

gerritbot added a comment.Mar 3 2022, 1:38 PM

Change 767732 merged by Alexandros Kosiaris:

[operations/puppet@production] rdb1005: Switch all usages to rdb1011

https://gerrit.wikimedia.org/r/767732

gerritbot added a comment.Mar 3 2022, 1:40 PM

Change 767742 merged by jenkins-bot:

[operations/deployment-charts@master] Switch all usages of rdb1005 to rdb1011

https://gerrit.wikimedia.org/r/767742

Stashbot added a comment.Mar 3 2022, 1:45 PM

Mentioned in SAL (#wikimedia-operations) [2022-03-03T13:45:43Z] <akosiaris> roll restart ores uwsgi and celery for rdb1005 decommissioning. T281217

Stashbot added a comment.Mar 3 2022, 1:54 PM

Mentioned in SAL (#wikimedia-operations) [2022-03-03T13:54:06Z] <akosiaris> switch changeprop, changeprop-jobqueue to use rdb1011. T281217

gerritbot added a comment.Mar 3 2022, 4:27 PM

Change 682893 abandoned by Alexandros Kosiaris:

[operations/puppet@production] Have rdb1012 replicate from rdb1011

Reason:

Done in https://gerrit.wikimedia.org/r/c/767730

https://gerrit.wikimedia.org/r/682893

gerritbot added a comment.Mar 4 2022, 7:57 AM

Change 767733 merged by Alexandros Kosiaris:

[operations/puppet@production] rdb1011: Switch to master

https://gerrit.wikimedia.org/r/767733

akosiaris closed this task as Resolved.Mar 4 2022, 8:15 AM
akosiaris claimed this task.
akosiaris subscribed.

Resolving, rdb1011 is now the master for all applications. Decommissioning of rdb1005,6 tracked in T273139

gerritbot added a comment.Mar 4 2022, 8:16 AM

Change 767734 merged by Alexandros Kosiaris:

[operations/puppet@production] rdb1005: Remove from site.pp

https://gerrit.wikimedia.org/r/767734

akosiaris mentioned this in T317189: Reimage rdb1009, rdb1010 as bullseye.Sep 7 2022, 1:08 PM
Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL