Page MenuHomePhabricator

Hardware for session storage service
Closed, ResolvedPublic

Description

Hardware will be needed for the session storage service. Current estimations put request rates (per-datcenter) at ~30k reads/sec, ~100 writes/sec, and total data set size at ~3G (uncompressed). This isn't much of a workload, and since we need a minimum of 3 servers per data-center (6 total) to make local quorums possible, I suspect that nearly anything will do.

CPU8-16 cores
Memory64-128G
SSD(least expensive)

(6 machines total)

On the use of ranges: Though the purpose of this cluster is isolation, it may make sense to utilize it for other things in the future (authentication has been discussed). I suspect any such workload will likewise be trivial, but if it doesn't change cost by much, then perhaps it is better to overspec a little now?

Event Timeline

Eevans triaged this task as Medium priority.Oct 2 2018, 7:34 PM
Eevans moved this task from Backlog to In-Progress on the User-Eevans board.
Eevans added a subscriber: CCicalese_WMF.
Eevans updated the task description. (Show Details)
Eevans added a subscriber: Joe.

So, I'm a bit unclear on SSD requirements. It seems like a mixed use SSD will work, but uncertain about overall capacity?

Is 3GB the overall requirement? "total data set size at ~3G (uncompressed)" If so, then our dual CPU misc spec would work for this (we'll have to update it as we have not purchased any in the past few months, and we don't have 6 of them spare.) The dual CPU spec just uses dual 120GB SSDs, dual 4 core CPUs, and 128GB RAM.

Also does this have a site preference, codfw or eqiad?

So, I'm a bit unclear on SSD requirements. It seems like a mixed use SSD will work, but uncertain about overall capacity?

What does "mixed use SSD" mean? As for capacity, sorry for the imprecision, I think it's because I assumed our storage requirements would be way below the smallest SSD options...

Is 3GB the overall requirement? "total data set size at ~3G (uncompressed)" If so, then our dual CPU misc spec would work for this (we'll have to update it as we have not purchased any in the past few months, and we don't have 6 of them spare.) The dual CPU spec just uses dual 120GB SSDs, dual 4 core CPUs, and 128GB RAM.

OK, so 3GB is the estimate we came up with for sessions, yeah. We might one day end up putting authentication on this cluster as well, and I have no idea what that is, but for the sake of argument let's just double the sessions figure and say 6GB. That'd be 9GB total. So, if we wanted to pad this a scooch, include a little wiggle room, we could add a zero and call it 90GB, which seems like it ought to fit nicely on a machine with dual 120GB SSDs. ;)

TL;DR That spec seems like it would work great!

Also does this have a site preference, codfw or eqiad?

3 machines in codfw, 3 machines in eqiad

So, I'm a bit unclear on SSD requirements. It seems like a mixed use SSD will work, but uncertain about overall capacity?

Is 3GB the overall requirement? "total data set size at ~3G (uncompressed)" If so, then our dual CPU misc spec would work for this (we'll have to update it as we have not purchased any in the past few months, and we don't have 6 of them spare.) The dual CPU spec just uses dual 120GB SSDs, dual 4 core CPUs, and 128GB RAM.

I was incorrect, it is 64GB ram, but that is also within the original request.

Since pricing is private data, I've created sub-task(s) for the quotation and ordering. (Once we get the quote proofed for codfw, we'll just replicate it for eqiad.)

RobH mentioned this in Unknown Object (Task).Nov 2 2018, 9:06 PM
Papaul closed subtask Unknown Object (Task) as Resolved.Nov 26 2018, 8:25 PM
Cmjohnson closed subtask Unknown Object (Task) as Resolved.Dec 7 2018, 7:08 PM