Page MenuHomePhabricator

beta swift labs instances requirements
Closed, ResolvedPublic

Description

hi,
I'm looking into disk requirements for having swift in beta, ATM deployment-upload:/data/project/upload7 is ~73GB. I'd like to replicate data at least 2x in beta or ideally 3x, provisioning 3x xlarge instances seems unnecessary wasteful in terms of cpu/mem I think. What's the easiest way to get medium/large instances with additional (e.g 80-100G) local disk? I'm fine with provisioning xlarge instances of course if cpu/mem waste isn't a big concern

Related Objects

View Standalone Graph
This task is connected to more than 200 other tasks. Only direct parents and subtasks are shown here. Use View Standalone Graph to show more of the graph.

Event Timeline

fgiunchedi raised the priority of this task from to Normal.
fgiunchedi updated the task description. (Show Details)
fgiunchedi added a project: Cloud-Services.
fgiunchedi added a subscriber: fgiunchedi.
Restricted Application added a subscriber: Aklapper. · View Herald TranscriptJan 13 2016, 3:40 PM

We can probably make you special instances that have more disk and less CPU/RAM, but it's probably also ok to use xlarge since instance CPUs aren't really used when they aren't used.

hashar added a subscriber: hashar.Jan 13 2016, 7:48 PM

/data/project/upload7 hasn't been cleaned up in ages.

  • InstantCommons is enabled and thus lot of files are copied from production commons. We can probably nuke a lot of them
  • We can probably nuke math, temp, thumb subdirectories

thanks @hashar ! I'd like to have some wiggle room just in case

anyways I don't seem to be able to add large/xlarge instances to deployment-prep ATM, quotas have been hit perhaps?

@chasemp @yuvipanda @Andrew I'm assuming there's enough capacity to bump the limit and how to do that?

I just bumped up instance count limit for you guys! And \o/ to seeing this
happen, maybe we can finally get rid of NFS from deployment-prep!

{{done}}, required a #cores and memory bump too (following https://wikitech.wikimedia.org/wiki/OpenStack#Managing_project_quotas)

fgiunchedi closed this task as Resolved.Jan 20 2016, 2:11 PM
fgiunchedi claimed this task.