Want to build a warm spare of Gerrit for failover purposes.
Specs should be similar to eqiad machine (cobalt). Usual specs: 32+gb ram, ~500gb ssd (raid10 iirc, large /srv), HT enabled. Public IP, runs jessie.
Description
Description
Details
Details
| Subject | Repo | Branch | Lines +/- | |
|---|---|---|---|---|
| add gerrit2001.mgmt for WMF6408.mgmt | operations/dns | master | +1 -0 |
| Status | Subtype | Assigned | Task | ||
|---|---|---|---|---|---|
| Resolved | Joe | T154658 Prepare and improve the datacenter switchover procedure | |||
| Resolved | LSobanski | T156937 Provide cross-dc redundancy (active-active or active-passive) to all important misc services | |||
| Resolved | • demon | T148186 Build warm slave for Gerrit in Dallas | |||
| Resolved | RobH | T148187 Requesting 1 spare misc box for Gerrit in codfw | |||
| Unknown Object (Task) | |||||
| Resolved | • demon | T152525 setup/install gerrit2001/WMF6408 | |||
| Resolved | Papaul | T152527 update the label and racktables entry for gerrit2001/WMF6408 & install SSDs | |||
| Resolved | faidon | T156957 asw-d-codfw public1-vlan addition review (blocks gerrit2001) |
Event Timeline
Comment Actions
+1 to keep ing the warm standby server
cobalt is wmf4725, an R430
maybe WMF6469 could be used from the spares?
Comment Actions
So we don't have any spare pool systems that house SSDs. We don't keep as many spares, since they end up not being to the proper specification for many use cases.
I have some systems that are:
- Dual Intel® Xeon® Processor E5-2623, 32GB RAM, 4 * 4TB SATA
- This uses LFF disks, so cannot be retro-fitted for this request.
- Dual Intel® Xeon® Processor E5-2640, 64GB RAM, 2 * 1TB SATA
- This uses SFF disks, so additional Intel SSDs can be purchased from Dell and added. Intel S3610 is 400GB or 800GB. Request is for 500GB, so I'll request dual 800GB.
- This system was purchased on 2016-03-24, and is still under warranty. The SSDs to add should come from Dell if we want them to be included in the warranty.
There will be a budget allocation details on a linked sub-task for the SSD pricing. I'll also include the spare pool systems pricing details there.
Comment Actions
WMF6469 cannot be used, as its an LFF chassis, and we need an SFF chassis for SSD use.
Potentially WMF6408 can be used, as long as we add SSDs. I'll detail out the costs in a sub-task.
Comment Actions
@demon can we stick with 400GBytes disk ? Not sure there is a point in buying 800 GBytes disk if we have 400G ones already available.
Comment Actions
Yeah, 400 will be fine--we currently use about 30gb. I dunno why I said 500, that's more than enough and anything in the TB+ range is just being wasteful (cobalt has ~7TB which is absurd, but was a last-minute allocation because lead was dying).
Comment Actions
Chatted with Chad in IRC.
Basically means the 800GB quote (on sub task) may be overkill, and I'll get a quote for dual 400GB.
Comment Actions
The server allocation of WMF6408 was approved by @mark on sub-task T150885, that sub-task also includes the ordering of dual 400GB SSDs to add into this system. These SSDs will come from Dell with the drive trays, so they can be additional to the HDD already installed, rather than replace them.
Comment Actions
Change 325596 had a related patch set uploaded (by Dzahn):
add gerrit2001.mgmt for WMF6408.mgmt
Comment Actions
Change 325596 abandoned by Dzahn:
add gerrit2001.mgmt for WMF6408.mgmt
Reason:
it was already done by Rob now in https://gerrit.wikimedia.org/r/#/c/325860/1