Page MenuHomePhabricator

add more statsdlb instances for more throughput
Closed, ResolvedPublic

Description

graphite1001 has cpu to spare, and we're currently running only one statsdlb process which often spikes to using one core at 100%, with SO_REUSEADDR already in statsdlb we should be able to have multiple processes all receiving incoming udp traffic and share the load

Details

Related Gerrit Patches:
operations/puppet : productionAdd a new statsd_proxy module and replace statsdlb
operations/software/statsdlb : masteruse SO_REUSEPORT in code, not SO_REUSEADDR
operations/software/statsdlb : masterset SO_REUSEADDR before bind()

Event Timeline

fgiunchedi claimed this task.
fgiunchedi raised the priority of this task from to Medium.
fgiunchedi updated the task description. (Show Details)
fgiunchedi added projects: Operations, Graphite.
fgiunchedi added subscribers: ori, fgiunchedi.
Restricted Application added a subscriber: Aklapper. · View Herald TranscriptFeb 10 2016, 11:59 AM

Change 273920 had a related patch set uploaded (by Filippo Giunchedi):
set SO_REUSEADDR before bind()

https://gerrit.wikimedia.org/r/273920

Change 273920 merged by Ori.livneh:
set SO_REUSEADDR before bind()

https://gerrit.wikimedia.org/r/273920

Change 282356 had a related patch set uploaded (by Faidon Liambotis):
Add a new statsd_proxy module and replace statsdlb

https://gerrit.wikimedia.org/r/282356

Change 296920 had a related patch set uploaded (by Filippo Giunchedi):
use SO_REUSEPORT in code, not SO_REUSEADDR

https://gerrit.wikimedia.org/r/296920

Change 296920 merged by Filippo Giunchedi:
use SO_REUSEPORT in code, not SO_REUSEADDR

https://gerrit.wikimedia.org/r/296920

Change 282356 merged by Filippo Giunchedi:
Add a new statsd_proxy module and replace statsdlb

https://gerrit.wikimedia.org/r/282356

fgiunchedi closed this task as Resolved.Jul 28 2016, 12:21 PM

Resolving this since it essentially happened by replacing statsdlb with statsd_proxy, followup on T101141