Page MenuHomePhabricator
Create Task
Maniphest T88693

Rebalance mc locations & update mgmt addresses for mc2001-mc2018 memcached servers in codfw
Closed, ResolvedPublic
Actions

Description

We need to rebalance the deployment/location of the mc servers in codfw to exist across 6 racks in 3 rows, rather than the existing 4 racks in 2 rows.

Please reshuffle the systems so they exist in the following racks (and then update racktables accordingly):

mc2001 = A2-CODFW
mc2002 = A2-CODFW
mc2003 = A2-CODFW
mc2004 = A7-CODFW
mc2005 = A7-CODFW
mc2006 = A7-CODFW
mc2007 = B2-CODFW
mc2008 = B2-CODFW
mc2009 = B2-CODFW
mc2010 = B7-CODFW
mc2011 = B7-CODFW
mc2012 = B7-CODFW
mc2013 = C2-CODFW
mc2014 = C2-CODFW
mc2015 = C2-CODFW
mc2016 = C7-CODFW
mc2017 = C7-CODFW
mc2018 = C7-CODFW

Please confirm the bios settings on mc2001-2008 and ensure they have the CPU logical processor enabled (hyperthreading). Then confirm all other bios and drac settings, assign the following mgmt IP addresses, and test function:

mc2001 = 10.193.2.121
mc2002 = 10.193.2.122
mc2003 = 10.193.2.123
mc2004 = 10.193.2.124
mc2005 = 10.193.2.125
mc2006 = 10.193.2.126
mc2007 = 10.193.2.127
mc2008 = 10.193.2.128
mc2009 = 10.193.2.129
mc2010 = 10.193.2.130
mc2011 = 10.193.2.131
mc2012 = 10.193.2.132
mc2013 = 10.193.2.133
mc2014 = 10.193.2.134
mc2015 = 10.193.2.135
mc2016 = 10.193.2.136
mc2017 = 10.193.2.137
mc2018 = 10.193.2.138

Once this is done, please update this task listing the production network port each system is plugged into on their switches.

Related Objects
Search...

Event Timeline

Joe created this task.Feb 5 2015, 4:19 PM
Joe raised the priority of this task from to Medium.
Joe updated the task description. (Show Details)
Joe added projects: ops-codfw, codfw-rollout-Apr-Jun-2015.
Joe added a subscriber: Joe.
Restricted Application added a project: acl*sre-team. · View Herald TranscriptFeb 5 2015, 4:19 PM
Restricted Application added a subscriber: Aklapper. · View Herald Transcript
Joe added a parent task: T86888: Setup memcached cluster in codfw.Feb 5 2015, 4:20 PM
RobH claimed this task.Feb 5 2015, 5:05 PM
RobH added a subscriber: RobH.

Claiming until I update this ticket with the IP addresses for papaul to use for their mgmt.

RobH reassigned this task from RobH to Papaul.Feb 5 2015, 5:30 PM

Papaul,

Please confirm the bios settings on mc2001-2008 and ensure they have the CPU logical processor enabled (hyperthreading). Then confirm all other bios and drac settings, assign the following mgmt IP addresses, and test function:

+mc2001 1H IN A 10.193.2.121
+mc2002 1H IN A 10.193.2.122
+mc2003 1H IN A 10.193.2.123
+mc2004 1H IN A 10.193.2.124
+mc2005 1H IN A 10.193.2.125
+mc2006 1H IN A 10.193.2.126
+mc2007 1H IN A 10.193.2.127
+mc2008 1H IN A 10.193.2.128
+mc2009 1H IN A 10.193.2.129
+mc2010 1H IN A 10.193.2.130
+mc2011 1H IN A 10.193.2.131
+mc2012 1H IN A 10.193.2.132
+mc2013 1H IN A 10.193.2.133
+mc2014 1H IN A 10.193.2.134
+mc2015 1H IN A 10.193.2.135
+mc2016 1H IN A 10.193.2.136
+mc2017 1H IN A 10.193.2.137
+mc2018 1H IN A 10.193.2.138

Once this is done, please update this task listing the production network port each system is plugged into on their switches.

Thanks!

RobH raised the priority of this task from Medium to High.Feb 5 2015, 5:30 PM
RobH set Security to None.
RobH renamed this task from Update mgmt addresses for mc2001-mc2018 memcached servers in codfw to Rebalance mc locations & update mgmt addresses for mc2001-mc2018 memcached servers in codfw.Feb 5 2015, 6:42 PM
RobH claimed this task.
RobH reassigned this task from RobH to Papaul.
RobH updated the task description. (Show Details)

Ok, the task info has now been updated to fully reflect both the mgmt ip assignments and the new rack locations for mc2001-2018.

Papaul added a comment.Feb 5 2015, 7:43 PM

Rebalance complete and racktable updated.

Papaul added a comment.Feb 5 2015, 8:09 PM

complete

mc2001 port ge-2/0/0
mc2002 port ge-2/0/1
mc2003 port ge-2/0/2

mgmt setup, BIOS configuration and test complete.

Papaul added a comment.Feb 6 2015, 4:16 PM

complete

mc2004 = port ge-70/0
mc2005 = port ge-7/0/1
mc2006 = port ge-7/0/2

mgtm setup, BIOS configuration and test complete

Papaul added a comment.Feb 6 2015, 4:39 PM

complete

mc2007 = port ge-2/0/0
mc2008 = port ge-2/0/1
mc2009 = port ge-2/0/2

mgtm setup, BIOS configuration and test complete

Papaul added a comment.Feb 6 2015, 5:07 PM

complete

mc2010 = port ge-7/0/0
mc2011 = port ge-7/0/1
mc2012 = port ge-7/0/2

mgtm setup, BIOS configuration and test complete

Papaul closed this task as Resolved.Feb 6 2015, 8:22 PM

complete

mc2013 = port ge-2/0/0
mc2014 = port ge-2/0/0
mc2015 = port ge-2/0/0
mc2016 = port ge-7/0/0
mc2017 = port ge-7/0/1
mc2018 = port ge-7/0/2

mgtm setup, BIOS configuration and test complete

RobH added a comment.Feb 6 2015, 8:37 PM

FYI: When its 10Gb port on juniper like these, they are xe-7/0/0 not ge-7/0/0

Papaul added a comment.Feb 6 2015, 8:41 PM

Got it. Thanks

RobH mentioned this in rODNS8ecef76c2b67: setting mc2001-2018 mgmt entries.Feb 18 2015, 4:33 PM
BBlack mentioned this in T101204: setup/install/deploy cp2001-cp2026.Jun 19 2015, 3:25 AM
Aklapper added a project: codfw-rollout.Jan 20 2016, 6:29 PM
Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL