Page MenuHomePhabricator
Create Task
Maniphest T86806

setup and deploy mw2135 through mw2215
Closed, ResolvedPublic
Actions

Description

This is the tracking ticket for the racking and initial system configuration for the new 80 mw systems coming in on RT#9011 (80 mw + 20 wtp).

I'll update this task later for Papaul's ownership, and include mgmt ip, rack locations, etc...

Related Objects
Search...

Event Timeline

RobH created this task.Jan 14 2015, 7:35 PM
RobH claimed this task.
RobH raised the priority of this task from to Medium.
RobH updated the task description. (Show Details)
RobH added a project: ops-codfw.
RobH changed the edit policy from "All Users" to "WMF-NDA (Project)".
RobH added subscribers: RobH, Joe, Papaul.
Restricted Application added a subscriber: Aklapper. · View Herald TranscriptJan 14 2015, 7:35 PM
RobH added a comment.Jan 14 2015, 10:22 PM

I'll update this task later with the mgmt IP info. For now the racking locations:

b4-codfw (AFTER new WTP systems are racked): mw2135 through mw2148
c3-codfw: mw2149 through mw2188
c4-codfw: mw2189 through mw2215

RobH added a subtask: T86807: rack and initial configuration of wtp2001-2020.Jan 14 2015, 10:22 PM
RobH added a comment.Jan 14 2015, 10:40 PM

mgmt ips:

mw2135 1H IN A 10.193.2.35
mw2136 1H IN A 10.193.2.36
mw2137 1H IN A 10.193.2.37
mw2138 1H IN A 10.193.2.38
mw2139 1H IN A 10.193.2.39
mw2140 1H IN A 10.193.2.40
mw2141 1H IN A 10.193.2.41
mw2142 1H IN A 10.193.2.42
mw2143 1H IN A 10.193.2.43
mw2144 1H IN A 10.193.2.44
mw2145 1H IN A 10.193.2.45
mw2146 1H IN A 10.193.2.46
mw2147 1H IN A 10.193.2.47
mw2148 1H IN A 10.193.2.48
mw2149 1H IN A 10.193.2.49
mw2150 1H IN A 10.193.2.50
mw2151 1H IN A 10.193.2.51
mw2152 1H IN A 10.193.2.52
mw2153 1H IN A 10.193.2.53
mw2154 1H IN A 10.193.2.54
mw2155 1H IN A 10.193.2.55
mw2156 1H IN A 10.193.2.56
mw2157 1H IN A 10.193.2.57
mw2158 1H IN A 10.193.2.58
mw2159 1H IN A 10.193.2.59
mw2160 1H IN A 10.193.2.60
mw2161 1H IN A 10.193.2.61
mw2162 1H IN A 10.193.2.62
mw2163 1H IN A 10.193.2.63
mw2164 1H IN A 10.193.2.64
mw2165 1H IN A 10.193.2.65
mw2166 1H IN A 10.193.2.66
mw2167 1H IN A 10.193.2.67
mw2168 1H IN A 10.193.2.68
mw2169 1H IN A 10.193.2.69
mw2170 1H IN A 10.193.2.70
mw2171 1H IN A 10.193.2.71
mw2172 1H IN A 10.193.2.72
mw2173 1H IN A 10.193.2.73
mw2174 1H IN A 10.193.2.74
mw2175 1H IN A 10.193.2.75
mw2176 1H IN A 10.193.2.76
mw2177 1H IN A 10.193.2.77
mw2178 1H IN A 10.193.2.78
mw2179 1H IN A 10.193.2.79
mw2180 1H IN A 10.193.2.80
mw2181 1H IN A 10.193.2.81
mw2182 1H IN A 10.193.2.82
mw2183 1H IN A 10.193.2.83
mw2184 1H IN A 10.193.2.84
mw2185 1H IN A 10.193.2.85
mw2186 1H IN A 10.193.2.86
mw2187 1H IN A 10.193.2.87
mw2188 1H IN A 10.193.2.88
mw2189 1H IN A 10.193.2.89
mw2190 1H IN A 10.193.2.90
mw2191 1H IN A 10.193.2.91
mw2192 1H IN A 10.193.2.92
mw2193 1H IN A 10.193.2.93
mw2194 1H IN A 10.193.2.94
mw2195 1H IN A 10.193.2.95
mw2196 1H IN A 10.193.2.96
mw2197 1H IN A 10.193.2.97
mw2198 1H IN A 10.193.2.98
mw2199 1H IN A 10.193.2.99
mw2200 1H IN A 10.193.2.100
mw2201 1H IN A 10.193.2.101
mw2202 1H IN A 10.193.2.102
mw2203 1H IN A 10.193.2.103
mw2204 1H IN A 10.193.2.104
mw2205 1H IN A 10.193.2.105
mw2206 1H IN A 10.193.2.106
mw2207 1H IN A 10.193.2.107
mw2208 1H IN A 10.193.2.108
mw2209 1H IN A 10.193.2.109
mw2210 1H IN A 10.193.2.110
mw2211 1H IN A 10.193.2.111
mw2212 1H IN A 10.193.2.112
mw2213 1H IN A 10.193.2.113
mw2214 1H IN A 10.193.2.114
mw2215 1H IN A 10.193.2.115

RobH reassigned this task from RobH to Papaul.Jan 14 2015, 10:42 PM

Also, once these are racked, Papaul can setup the asset tag mgmt address entries (good practice!)

RobH mentioned this in Unknown Object (Diffusion Commit).Jan 14 2015, 10:45 PM
Papaul added a comment.Jan 30 2015, 6:49 PM

Racked the 30 first mw servers

Restricted Application added a project: acl*sre-team. · View Herald TranscriptJan 30 2015, 6:49 PM
Papaul added a comment.Feb 6 2015, 8:23 PM

all 80 mw's servers are racked

faidon raised the priority of this task from Medium to High.Feb 11 2015, 9:50 AM
faidon subscribed.

So, what's left to be done here?

Papaul added a comment.Feb 11 2015, 3:45 PM

what left:
update racktable
wiried mgt & data network
wired power
setup mgt settings

RobH mentioned this in T89368: rack/wire/initial setup of db2043-db2070.Feb 12 2015, 7:03 PM
Papaul added a comment.Feb 13 2015, 3:53 PM

mgt and data network wiring complete

RobH mentioned this in rODNS62c11c939810: setting mw2135-mw2215 mgmt entries.Feb 18 2015, 4:33 PM
Papaul added a comment.Feb 20 2015, 5:10 PM

The last mw server is mw2214 and not mw2215.

RobH closed subtask T86807: rack and initial configuration of wtp2001-2020 as Resolved.Feb 20 2015, 8:16 PM
Papaul reassigned this task from Papaul to RobH.Feb 27 2015, 6:42 PM

rack table update
physical label in place
mgmt settings and BIOS settings complete
Test complete

mw2135 10.193.2.35 ge-4/0/27 B4
mw2136 10.193.2.36 ge-4/0/28 B4
mw2137 10.193.2.37 ge-4/0/29 B4
mw2138 10.193.2.38 ge-4/0/30 B4
mw2139 10.193.2.39 ge-4/0/31 B4
mw2140 10.193.2.40 ge-4/0/32 B4
mw2141 10.193.2.41 ge-4/0/33 B4
mw2142 10.193.2.42 ge-4/0/34 B4
mw2143 10.193.2.43 ge-4/0/35 B4
mw2144 10.193.2.44 ge-4/0/36 B4
mw2145 10.193.2.45 ge-4/0/37 B4
mw2146 10.193.2.46 ge-4/0/38 B4
mw2147 10.193.2.47 ge-4/0/39 B4
mw2148 10.193.2.48 ge-3/0/1 C3
mw2149 10.193.2.49 ge-3/0/2 C3
mw2150 10.193.2.50 ge-3/0/3 C3
mw2151 10.193.2.51 ge-3/0/4 C3
mw2152 10.193.2.52 ge-3/0/5 C3
mw2153 10.193.2.53 ge-3/0/6 C3
mw2154 10.193.2.54 ge-3/0/7 C3
mw2155 10.193.2.55 ge-3/0/8 C3
mw2156 10.193.2.56 ge-3/0/9 C3
mw2157 10.193.2.57 ge-3/0/10 C3
mw2158 10.193.2.58 ge-3/0/11 C3
mw2159 10.193.2.59 ge-3/0/12 C3
mw2160 10.193.2.60 ge-3/0/13 C3
mw2161 10.193.2.61 ge-3/0/14 C3
mw2162 10.193.2.62 ge-3/0/15 C3
mw2163 10.193.2.63 ge-3/0/16 C3
mw2164 10.193.2.64 ge-3/0/17 C3
mw2165 10.193.2.65 ge-3/0/18 C3
mw2166 10.193.2.66 ge-3/0/19 C3
mw2167 10.193.2.67 ge-3/0/20 C3
mw2168 10.193.2.68 ge-3/0/21 C3
mw2169 10.193.2.69 ge-3/0/22 C3
mw2170 10.193.2.70 ge-3/0/23 C3
mw2171 10.193.2.71 ge-3/0/24 C3
mw2172 10.193.2.72 ge-3/0/25 C3
mw2173 10.193.2.73 ge-3/0/26 C3
mw2174 10.193.2.74 ge-3/0/27 C3
mw2175 10.193.2.75 ge-3/0/28 C3
mw2176 10.193.2.76 ge-3/0/29 C3
mw2177 10.193.2.77 ge-3/0/30 C3
mw2178 10.193.2.78 ge-3/0/31 C3
mw2179 10.193.2.79 ge-3/0/32 C3
mw2180 10.193.2.80 ge-3/0/33 C3
mw2181 10.193.2.81 ge-3/0/34 C3
mw2182 10.193.2.82 ge-3/0/35 C3
mw2183 10.193.2.83 ge-3/0/36 C3
mw2184 10.193.2.84 ge-3/0/37 C3
mw2185 10.193.2.85 ge-3/0/38 C3
mw2186 10.193.2.86 ge-3/0/39 C3
mw2187 10.193.2.87 ge-4/0/11 C4
mw2188 10.193.2.88 ge-4/0/12 C4
mw2189 10.193.2.89 ge-4/0/13 C4
mw2190 10.193.2.90 ge-4/0/14 C4
mw2191 10.193.2.91 ge-4/0/15 C4
mw2192 10.193.2.92 ge-4/0/16 C4
mw2193 10.193.2.93 ge-4/0/17 C4
mw2194 10.193.2.94 ge-4/0/18 C4
mw2195 10.193.2.95 ge-4/0/19 C4
mw2196 10.193.2.96 ge-4/0/20 C4
mw2197 10.193.2.97 ge-4/0/21 C4
mw2198 10.193.2.98 ge-4/0/22 C4
mw2199 10.193.2.99 ge-4/0/23 C4
mw2200 10.193.2.100 ge-4/0/24 C4
mw2201 10.193.2.101 ge-4/0/25 C4
mw2202 10.193.2.102 ge-4/0/26 C4
mw2203 10.193.2.103 ge-4/0/27 C4
mw2204 10.193.2.104 ge-4/0/28 C4
mw2205 10.193.2.105 ge-4/0/29 C4
mw2206 10.193.2.106 ge-4/0/30 C4
mw2207 10.193.2.107 ge-4/0/31 C4
mw2208 10.193.2.108 ge-4/0/32 C4
mw2209 10.193.2.109 ge-4/0/33 C4
mw2210 10.193.2.110 ge-4/0/34 C4
mw2211 10.193.2.111 ge-4/0/35 C4
mw2212 10.193.2.112 ge-4/0/36 C4
mw2213 10.193.2.113 ge-4/0/37 C4
mw2214 10.193.2.114 ge-4/0/38 C4

Joe added a comment.Mar 2 2015, 9:25 AM

I still need the following things:

  • Verify console redirection after boot is enabled
  • Verify hyperthreading is active
  • Insert mac addresses in the dhcp files so that we can install them expeditely.
RobH removed RobH as the assignee of this task.Mar 2 2015, 9:41 PM
RobH added a subscriber: mark.

This isn't technically waiting on me. Items we need to move forward:

@Joe: You asked for console redirection to be enabled AFTER post, which differs from what @mark states (to keep it off). Could you guys meet up on this and decide what the standard will be going forward?

@Papaul: Can you confirm you ensured hyperthreading is enabled on all these systems?

Anyone can add the MAC adddresses to lease file for installation. Since these are jessie, and that isn't default, it'll have to list that specifically.

RobH renamed this task from rack mw2135 through mw2215 to setup and deploy mw2135 through mw2215.Mar 2 2015, 9:42 PM
RobH raised the priority of this task from High to Needs Triage.
RobH removed a project: ops-codfw.
RobH set Security to None.
RobH added a project: ops-codfw.
Papaul added a comment.Mar 2 2015, 10:31 PM

@Rob: yes i confirm that hyperthreading is enable on all 80 servers. Plus the other 20 servers.

RobH assigned this task to Joe.Mar 9 2015, 5:33 PM

This is currently stalled with the question of enabling redirection after post in bios.

Presently, @mark has stated that all hosts should have this disabled. It has come up multiple times, and his view has been stated as such, but it may be different now. @Joe is going to check with @mark about this, and once they are in sync on moving forward, these installations can continue.

Once task is updated with result of discussion, kicking it back to unassigned *should* result in the clinic duty person noticing this in the unassigned ops tasks.

Papaul added a comment.Mar 9 2015, 8:46 PM

I update the ttys1 config file with the 80 mw servers NIC MAC. it is in review now, waiting to be merge.

Thanks

Joe added a comment.Mar 11 2015, 4:03 PM

Spoke with mark: we can enable console redirection.

Joe removed Joe as the assignee of this task.Mar 11 2015, 4:03 PM
Papaul added a comment.Mar 11 2015, 5:16 PM

ok will start changing those settings on all the mw servers

Papaul added a comment.Mar 12 2015, 8:18 PM

@Joe
Redirection after boot for mw2135-mw2214 changed from disable to enable. Please let me know if there is anything else. i will start working on mw2001-mw2134 tomorrow.
Thanks

RobH mentioned this in T92815: Codfw mediawiki appservers from any rows but row A can't communicate with the dhcp server.Mar 16 2015, 5:17 PM
fgiunchedi assigned this task to Papaul.Mar 30 2015, 3:45 PM
fgiunchedi subscribed.

moving to @Papaul, what's the status on this?

fgiunchedi triaged this task as High priority.Mar 30 2015, 3:46 PM
Papaul added a comment.Mar 30 2015, 3:47 PM

@fgiunchedi it is complete on my side

fgiunchedi added a comment.Mar 30 2015, 3:52 PM

@Joe @RobH is this complete?

Papaul added a comment.Apr 8 2015, 3:11 PM

@Joe and RobH can I resolve this task?

RobH closed this task as Resolved.Apr 8 2015, 3:19 PM

They all ping online. So the installation part of this is done. So all the onsite work is done.

Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL