Page MenuHomePhabricator

Improve limit range management in webservice for Kubernetes
Closed, ResolvedPublic

Description

Currently, setting a limit range in webservice manually using the mechanism described here, will set a higher limit with the same low "request". This results in a situation where the scheduler for Kubernetes will schedule the service as though it is expected to consume the "request" amount and oversubscribe the rest. To use the "Burstable" qosClass best for containers, we should set the request value to one that is proportional to the limit. This will prevent the wild oversubscription rates seen in the old cluster (often over 600%).

Details

Related Gerrit Patches:
operations/software/tools-webservice : masterk8s-resources: resources must be converted to str from Decimal
operations/software/tools-webservice : masterkubernetes: resource requests should be proportional to limits

Event Timeline

Bstorm triaged this task as Medium priority.Tue, Feb 4, 9:21 PM
Bstorm created this task.
Restricted Application added a subscriber: Aklapper. · View Herald TranscriptTue, Feb 4, 9:21 PM
Bstorm added a subscriber: bd808.Tue, Feb 4, 9:24 PM

Change 570734 had a related patch set uploaded (by Bstorm; owner: Bstorm):
[operations/software/tools-webservice@master] kubernetes: resource requests should be proportional to limits

https://gerrit.wikimedia.org/r/570734

Change 570734 merged by jenkins-bot:
[operations/software/tools-webservice@master] kubernetes: resource requests should be proportional to limits

https://gerrit.wikimedia.org/r/570734

Mentioned in SAL (#wikimedia-cloud) [2020-02-07T21:09:19Z] <bstorm_> upgraded toollabs-webservice package for stretch toolsbeta to 0.59 T244293 T244289 T234617 T156626

Change 570974 had a related patch set uploaded (by Bstorm; owner: Bstorm):
[operations/software/tools-webservice@master] k8s-resources: resources must be converted to str from Decimal

https://gerrit.wikimedia.org/r/570974

Change 570974 merged by jenkins-bot:
[operations/software/tools-webservice@master] k8s-resources: resources must be converted to str from Decimal

https://gerrit.wikimedia.org/r/570974

Mentioned in SAL (#wikimedia-cloud) [2020-02-10T21:18:57Z] <bstorm_> upgraded toollabs-webservice package for stretch toolsbeta to 0.62 T244293 T244289 T234617 T156626

Mentioned in SAL (#wikimedia-cloud) [2020-02-10T21:25:10Z] <bstorm_> upgraded toollabs-webservice package for tools to 0.62 T244293 T244289 T234617 T156626

Bstorm closed this task as Resolved.Thu, Feb 13, 8:02 PM