Page MenuHomePhabricator
Create Task
Maniphest T90437

Alert when conntrack table is full on labnet1001
Closed, ResolvedPublic
Actions

Description

Since it basically breaks DNS and potentially other things.

Details

SubjectRepoBranchLines +/-
Labs: monitor and alert labnet1001 for conntrackoperations/puppetproduction+13 -0
More fix to conntrack collectoroperations/puppetproduction+1 -1
Tweaks to the conntrack collector:operations/puppetproduction+5 -5
Labs: *correctly* collect conntrack statsoperations/puppetproduction+2 -1
Labs: collect conntrack stats for labsnet1001operations/puppetproduction+1 -0
Conntrack collector for diamondoperations/puppetproduction+64 -0
Customize query in gerrit

Related Objects
Search...

Event Timeline

yuvipanda created this task.Feb 23 2015, 2:09 PM
yuvipanda assigned this task to coren.
yuvipanda raised the priority of this task from to High.
yuvipanda updated the task description. (Show Details)
yuvipanda added projects: Cloud-Services, Cloud-VPS.
yuvipanda added subscribers: gerritbot, hashar, akosiaris and 15 others.
gerritbot added a comment.Mar 30 2015, 3:10 PM

Change 192335 had a related patch set uploaded (by coren):
Conntrack collector for diamond

https://gerrit.wikimedia.org/r/192335

gerritbot added a project: Patch-For-Review.Mar 30 2015, 3:10 PM
hashar unsubscribed.Mar 30 2015, 3:11 PM
gerritbot added a comment.Mar 30 2015, 5:32 PM

Change 192335 merged by coren:
Conntrack collector for diamond

https://gerrit.wikimedia.org/r/192335

coren mentioned this in rOPUP00edaa7c1b07: Conntrack collector for diamond.Mar 30 2015, 5:33 PM
gerritbot added a comment.Mar 30 2015, 5:41 PM

Change 200619 had a related patch set uploaded (by coren):
Labs: collect conntrack stats for labsnet1001

https://gerrit.wikimedia.org/r/200619

coren added a project: Labs-Q4-Sprint-1.Mar 30 2015, 6:28 PM
coren set Security to None.
coren moved this task from Backlog to Code Review / Blocked on the Labs-Q4-Sprint-1 board.Mar 30 2015, 6:30 PM
gerritbot added a comment.Mar 30 2015, 8:10 PM

Change 200619 merged by coren:
Labs: collect conntrack stats for labsnet1001

https://gerrit.wikimedia.org/r/200619

coren mentioned this in rOPUP030ab5a8c19b: Labs: collect conntrack stats for labsnet1001.Mar 30 2015, 8:10 PM
gerritbot added a comment.Mar 30 2015, 8:14 PM

Change 200722 had a related patch set uploaded (by coren):
Labs: *correctly* collect conntrack stats

https://gerrit.wikimedia.org/r/200722

gerritbot added a comment.Mar 30 2015, 8:21 PM

Change 200722 merged by coren:
Labs: *correctly* collect conntrack stats

https://gerrit.wikimedia.org/r/200722

coren mentioned this in rOPUP2aa65c32751b: Labs: *correctly* collect conntrack stats.Mar 30 2015, 8:22 PM
yuvipanda added a comment.Apr 1 2015, 12:22 AM

Cool! :) Now this just needs an alert.

coren added a comment.Apr 1 2015, 2:19 AM

Not quite, I can't seem to find the putatively collected metrics in graphite.

gerritbot added a comment.Apr 1 2015, 1:46 PM

Change 201188 had a related patch set uploaded (by coren):
Tweaks to the conntrack collector:

https://gerrit.wikimedia.org/r/201188

gerritbot added a comment.Apr 1 2015, 1:50 PM

Change 201188 merged by coren:
Tweaks to the conntrack collector:

https://gerrit.wikimedia.org/r/201188

coren mentioned this in rOPUP326480631ea7: Tweaks to the conntrack collector:.Apr 1 2015, 1:50 PM
gerritbot added a comment.Apr 1 2015, 1:59 PM

Change 201190 had a related patch set uploaded (by coren):
More fix to conntrack collector

https://gerrit.wikimedia.org/r/201190

gerritbot added a comment.Apr 1 2015, 2:07 PM

Change 201190 merged by coren:
More fix to conntrack collector

https://gerrit.wikimedia.org/r/201190

coren mentioned this in rOPUP9bac9dab203f: More fix to conntrack collector.Apr 1 2015, 2:07 PM
gerritbot added a comment.Apr 1 2015, 3:21 PM

Change 201203 had a related patch set uploaded (by coren):
Labs: monitor and alert labnet1001 for conntrack

https://gerrit.wikimedia.org/r/201203

gerritbot added a comment.Apr 1 2015, 7:52 PM

Change 201203 merged by coren:
Labs: monitor and alert labnet1001 for conntrack

https://gerrit.wikimedia.org/r/201203

coren mentioned this in rOPUPf70443cd1a05: Labs: monitor and alert labnet1001 for conntrack.Apr 1 2015, 7:52 PM
coren moved this task from Code Review / Blocked to Done on the Labs-Q4-Sprint-1 board.Apr 1 2015, 7:54 PM
coren closed this task as Resolved.Apr 1 2015, 8:10 PM
coren removed a project: Patch-For-Review.
Liuxinyu970226 unsubscribed.Apr 2 2015, 1:10 AM
yuvipanda mentioned this in T101980: Icinga alert for labnet1001 for conntrack saturation graphite check.Jun 10 2015, 1:27 PM
• Phabricator_maintenance removed a subscriber: yuvipanda.Jun 7 2017, 6:54 PM
Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL