Page MenuHomePhabricator

Labs team reliability goal for Q1 2015/16
Closed, ResolvedPublic

Description

Tracking task for Labs team reliability goal for Q1 2015/16.

  1. Meet or exceed 99.5% uptime for each Labs infrastructure service
  2. Remove all Labs support host SPOFs, using redundancy or hot spares
  3. Finish NFS migration to RAID10 storage, and implement NFS sharding
  4. Audit Labs projects on NFS dependencies and support migration to alternatives where appropriate

Related Objects

StatusSubtypeAssignedTask
Resolvedyuvipanda
ResolvedAndrew
Duplicatecoren
Resolvedjcrespo
Resolvedyuvipanda
ResolvedAndrew
ResolvedAndrew
ResolvedRobH
Resolvedjcrespo
DeclinedNone
Resolved chasemp
OpenNone
DuplicateNone
ResolvedAndrew
DuplicateNone
Resolvedyuvipanda
DeclinedNone
ResolvedKrinkle
Resolvedyuvipanda
Resolvedyuvipanda
Resolvedyuvipanda
Resolvedyuvipanda
Resolvedyuvipanda
Resolvedyuvipanda
Resolvedyuvipanda
Resolvedyuvipanda
Resolvedyuvipanda
Resolvedyuvipanda
Resolvedyuvipanda
Resolvedhashar
Resolvedhashar
Resolvedyuvipanda
Resolvedyuvipanda
OpenNone
Declinedyuvipanda
Resolvedyuvipanda
ResolvedNone
Resolvedyuvipanda
ResolvedAndrew
Resolvedyuvipanda
Resolvedyuvipanda
Resolvedyuvipanda
ResolvedAndrew
Resolvedyuvipanda
Resolvedyuvipanda
Resolvedyuvipanda
Resolvedyuvipanda
Resolvedyuvipanda
Resolvedyuvipanda
Resolvedyuvipanda
ResolvedNegative24
Resolvedyuvipanda
Resolvedyuvipanda
Resolvedyuvipanda
Resolvedyuvipanda
Resolvedyuvipanda
Resolvedyuvipanda
Resolvedhashar
Resolvedhashar
Resolvedyuvipanda
Resolvedyuvipanda
Resolvedyuvipanda
Resolvedyuvipanda
Resolvedyuvipanda
DeclinedNone
Resolvedyuvipanda
Resolvedyuvipanda
Resolvedyuvipanda
Resolvedyuvipanda
Resolvedyuvipanda
Resolvedyuvipanda
Resolvedyuvipanda
Resolvedyuvipanda
Resolvedyuvipanda
Resolvedyuvipanda
Resolvedcoren
Resolvedyuvipanda
Resolvedyuvipanda
Resolved jkroll
ResolvedKrinkle
DeclinedAndrew
ResolvedBstorm
ResolvedAndrew
ResolvedAndrew
ResolvedAndrew
ResolvedAndrew
ResolvedKrenair
ResolvedAndrew
ResolvedBstorm
ResolvedAndrew
ResolvedNone
ResolvedAndrew
Resolvedjsn.sherman
ResolvedAndrew
ResolvedAndrew
ResolvedAndrew
ResolvedAndrew
ResolvedSmalyshev
ResolvedAndrew
ResolvedAndrew
OpenNone
ResolvedAndrew
ResolvedAndrew
ResolvedAndrew
ResolvedAndrew
ResolvedRobH
ResolvedCmjohnson
ResolvedCmjohnson
ResolvedAndrew
ResolvedAndrew
ResolvedAndrew
ResolvedAndrew
ResolvedAndrew
Resolvedcoren
InvalidNone
Resolvedcoren
Resolvedcoren
Declinedcoren
ResolvedNone
ResolvedNone
Resolvedcoren
Resolvedcoren
Declinedyuvipanda
Resolvedcoren
Resolvedcoren
Resolvedcoren
ResolvedCmjohnson
Resolved chasemp
Resolved chasemp
Resolvedcoren
Resolvedcoren
Resolvedmark
ResolvedCmjohnson
Resolvedcoren
Resolvedcoren
Resolvedcoren
Resolvedfaidon
Declinedfaidon
Resolvedcoren
ResolvedAndrew
Resolvedyuvipanda
ResolvedAndrew
ResolvedAndrew
ResolvedAndrew
DeclinedAndrew
ResolvedAndrew
ResolvedAndrew
Declinedyuvipanda
ResolvedAndrew
ResolvedAndrew
ResolvedNone
ResolvedAndrew
Declinedcoren
Resolvedjcrespo

Event Timeline

yuvipanda raised the priority of this task from to Needs Triage.
yuvipanda updated the task description. (Show Details)
yuvipanda added a project: Cloud-Services.
yuvipanda added a subscriber: yuvipanda.

Not sure about the NFS sharding one - @mark / @coren is that just the tools / others / maps being on different arrays? Or is there more to that? :)

@yuvipanda: It's keeping the filesystem reasonably small (and operations on them more parallelizable) by spliting along project lines, yes. So right now we've spun off tools and maps with everything else together, but making sure that we locate outliers and split them as an ongoing thing is part of this conceptually.

chasemp set Security to None.
yuvipanda claimed this task.

I guess?