Page MenuHomePhabricator

Hadoop Node expansion for end of FY
Closed, DeclinedPublic

Description

Last summer in T100442, we expanded the Hadoop cluster. Analytics reserved some FY2015 hardware budget for future expansion. The future is now!

We'd like to spend the remainder of our budget on Hadoop nodes. These nodes will be used for regular Hadoop expansion, as well as to help support productionization of realtime streaming analytics jobs, using YARN based streaming frameworks like Spark Streaming.

T124945 and T124947 will come out of Analytics FY2015 HW budget first. Once those are quoted, we can allocate the remaining funds to buy a few more Hadoop nodes.

We can order nodes with the same capacity as we did last summer:

Dell PowerEdge R720

  • 12 core EW-2620 @ 2.00GHz
  • 64G RAM
  • 12 x 4TB 3.5 HDDs
  • 2 x 2.5 small HDDs (in chassis?) for / partition

Note that this expansion is explicitly for this FY. Next FY will come with more hardware requests. :)

Event Timeline

Ottomata raised the priority of this task from to Medium.
Ottomata updated the task description. (Show Details)
Ottomata added subscribers: Ottomata, Nuria, JAllemandou and 2 others.
Restricted Application added a subscriber: Aklapper. · View Herald Transcript
mark lowered the priority of this task from Medium to Low.Feb 1 2016, 4:16 PM
mark added a subscriber: mark.

Hold on this, we may be using the remainder budget for other things.

RobH added a subscriber: RobH.

@Ottomata: I'm going to assign this to you until you know if you are using the budget for this or other things. If it remains valid, and you still need quotes generated, please assign it to me.

Thanks!

The other analytics hardware requests are currently in pending approval will take up the most of the analytics remainder budget for this FY. Closing this task.