Page MenuHomePhabricator

determine networking for ganeti2001-2006
Closed, ResolvedPublic

Description

Mark (or Alex if he knows),

Ganeti2001-2006 show delivered today. We need to get them racked, but I am not quite certain on the networking requirements, and thus if there is a row requirement.

I would assume these will have both public and private interfaces, since we'll have both types of VMs. I wasn't sure if these would go into their own vlan, and if we have a row restriction. Since its a cluster, I would ideally spread them out with 2 in each row (A/B/C). I cannot make that call though, I need @mark's input.

Event Timeline

RobH assigned this task to mark.
RobH raised the priority of this task from to High.
RobH updated the task description. (Show Details)
RobH added projects: acl*sre-team, netops.
RobH added subscribers: RobH, Cmjohnson, Aklapper and 2 others.

I chatted with Mark who suggested I chat with Alex about this. I'm assigning this to Alex so he can update the task if he likes (otherwise I'll chat with him my AM his PM tomorrow.)

Hello,

We got unfortunately a row restriction at this point as with the current networking setup we can not have VMs span rows. That might not be the case in the future either because we end up changing parts of our networking setup or cause we end up doing switching in the HP hardware nodes themselves or tunneling or some other clever idea. The hardware boxes themselves will have private IPs, but we will be able to provide VMs with either private IPs or public ones from that row with no problem.

Seems like all rows have adequate space both IP wise as well as Unit wise. Splitting up the boxes in 3 Racks seems like a good compromise at this point. So 2 boxes per Rack. Walking through our racks I think promising combinations are:

CODFW Row A: A1U35-A1U36, A5U35-A5U36 and A8U35-A5U36
If we don't care to have the boxes at so uniform positions, nice places also are:
A1U18-A1U19, A5U27-A5U28, A8U18-A8U19

CODFW Row B: B1U21-22, B5U32-33, B8U21-22

CODFW Row C: C1U21-22, C5U21-22, C8U21-22

Any of those combinations or permutations of those seems fine to me. Of course take these proposals with a grain of salt, I am not physically present in the DC to verify they are valid positions and @Papaul is probably the best person to recommend where to put those boxes in.

Network configuration wise, ports should be trunk with the native vlan being the private vlan for the row

@RobH, @Papaul after the boxes are racked and plugged in etc, ping me so I can help with the switch configu

I think the best place to put those server will be Rack in position 5

A5U27 A5U28
B5U15 B5U32
C5U21 C5U27

@Rob what do you think?

@Papaul,

Your proposed layout is directly in contradiction with @akosiaris statement that they have to all remain in the same row. If we didn't have that restriction, your choices are what I would have picked. (So I really like we are on the same page there.)

As such, lets use most of his row B proposal and rack them in the following locations (I had to modify some since he didnt leave space for the power cables under the switches):

Also before placing these, ensure you have power ports available in each rack. If there is a shortage, let me know and we can adjust this plan.

ganeti2001 : b1-codfw/u37
ganeti2002 : b1-codfw/u38
ganeti2003 : b5-codfw/u15
ganeti2004 : b5-codfw/u32
ganeti2005 : b8-codfw/u1
ganeti2006 : b8-codfw/u2

I'm going to move this info on to the blocked racking ticket, and resolve this ticket.