Page MenuHomePhabricator

Tracking and Reducing cron-spam to root@
Open, MediumPublic

Description

Cronspam is annoying, but it carries (sometimes) very good information. This phab task should track the efforts to reduce the current level of cronspam from root@ and to keep it under control from now on.

The final goal must be to improve our docs/best-practices/etc.. alongside with the patches that we'll send, otherwise there is no point of proceeding with work.

Some questions:

  1. Do we really value cron-alerts in Wikimedia?
  2. What is an acceptable level of cron-spam?
  3. How do we improve our monitoring/alarming to avoid relying on people reading cron spam emails?

Details

ProjectBranchLines +/-Subject
operations/puppetproduction+1 -1
operations/puppetproduction+1 -1
operations/puppetproduction+12 -10
operations/puppetproduction+1 -1
operations/puppetproduction+1 -0
operations/puppetproduction+1 -0
operations/puppetproduction+1 -0
operations/puppetproduction+1 -1
operations/puppetproduction+2 -2
operations/puppetproduction+4 -5
operations/puppetproduction+3 -2
operations/puppetproduction+35 -1
operations/puppetproduction+11 -1
operations/puppetproduction+2 -3
operations/puppetproduction+1 -1
operations/puppetproduction+2 -2
operations/puppetproduction+1 -1
operations/puppetproduction+1 -0
operations/puppetproduction+1 -1
operations/puppetproduction+0 -20
operations/puppetproduction+20 -1
operations/puppetproduction+1 -0
operations/puppetproduction+1 -0
operations/puppetproduction+1 -1
Show related patches Customize query in gerrit

Related Objects

StatusSubtypeAssignedTask
OpenNone
Resolvedelukey
Resolvedelukey
Resolvedfaidon
OpenNone
Resolvedfaidon
Resolvedherron
Resolvedherron
ResolvedAndrew
Resolvedfgiunchedi
DeclinedNone
OpenNone
Resolvedjcrespo
ResolvedNone
Resolvedelukey
ResolvedNone
ResolvedDzahn
Resolvedema
ResolvedMoritzMuehlenhoff
ResolvedPRODUCTION ERRORCatrope
ResolvedNone
Resolvedelukey
DuplicateNone
ResolvedNone
ResolvedNone
ResolvedDzahn
Resolvedfaidon
DuplicateNone
Resolvedfgiunchedi
DeclinedNone
OpenNone
OpenNone
ResolvedNone
Resolvedelukey
OpenNone
ResolvedNone
Resolvedfgiunchedi
OpenNone
ResolvedBBlack
Resolvedfgiunchedi
DuplicateNone
Resolvedelukey
Declinedfaidon
ResolvedMoritzMuehlenhoff
Resolvedfgiunchedi
Resolvedcolewhite
ResolvedPRODUCTION ERRORjcrespo
Resolved Gilles
Resolved Gilles
Resolvedfgiunchedi
ResolvedNone
DuplicateNone
Resolved chasemp
Resolvedjijiki
ResolvedJoe
ResolvedAndrew
Resolvedjcrespo
Resolvedmmodell
ResolvedNone
Declinedaaron
ResolvedMarostegui
Resolvedjbond
ResolvedGTirloni
Resolvedelukey
ResolvedMoritzMuehlenhoff
Resolvedjbond
Resolvedfgiunchedi
ResolvedVolans
ResolvedArielGlenn
Resolvedaaron
OpenNone
Resolveddpifke
DuplicateNone
Resolvedcolewhite
Resolved chasemp
OpenNone

Event Timeline

There are a very large number of changes, so older changes are hidden. Show Older Changes

Change 336218 merged by Dzahn:
Silence apt rsync repo activities

https://gerrit.wikimedia.org/r/336218

Change 343276 had a related patch set uploaded (by Elukey):
[operations/puppet] Add delay compress to upstart's logrotate

https://gerrit.wikimedia.org/r/343276

Change 343276 merged by Elukey:
[operations/puppet] Add delay compress to upstart's logrotate

https://gerrit.wikimedia.org/r/343276

Change 353014 had a related patch set uploaded (by Elukey; owner: Elukey):
[operations/puppet@production] Fix logrotate config for analytics1003 to avoid cronspam

https://gerrit.wikimedia.org/r/353014

Change 353014 merged by Elukey:
[operations/puppet@production] Fix logrotate config for analytics1003 to avoid cronspam

https://gerrit.wikimedia.org/r/353014

Change 369608 had a related patch set uploaded (by Elukey; owner: Elukey):
[operations/puppet@production] statistics::discovery: fix daily logrotate

https://gerrit.wikimedia.org/r/369608

Change 369608 merged by Elukey:
[operations/puppet@production] statistics::discovery: fix daily logrotate

https://gerrit.wikimedia.org/r/369608

Change 370170 had a related patch set uploaded (by Elukey; owner: Elukey):
[operations/puppet@production] modules::geowiki::private_data: fix rsync for data-private-bare

https://gerrit.wikimedia.org/r/370170

Change 370170 merged by Elukey:
[operations/puppet@production] modules::geowiki::private_data: fix rsync for data-private-bare

https://gerrit.wikimedia.org/r/370170

EddieGP renamed this task from Tracking and Reducing cron-spam from root@ to Tracking and Reducing cron-spam to root@ .Apr 17 2018, 3:34 PM
ayounsi removed a subscriber: ayounsi.Apr 19 2018, 9:04 PM

Change 428947 had a related patch set uploaded (by Filippo Giunchedi; owner: Filippo Giunchedi):
[operations/puppet@production] profile: install SMART checks after 'raid' fact is available.

https://gerrit.wikimedia.org/r/428947

chasemp closed subtask Restricted Task as Resolved.Apr 27 2018, 1:51 PM

Change 438140 had a related patch set uploaded (by Elukey; owner: Elukey):
[operations/puppet@production] profile::analytics::refinery::job::sqoop_mw: avoid root cronspam

https://gerrit.wikimedia.org/r/438140

Change 438140 merged by Elukey:
[operations/puppet@production] profile::analytics::refinery::job::sqoop_mw: avoid root cronspam

https://gerrit.wikimedia.org/r/438140

Change 543866 had a related patch set uploaded (by Jcrespo; owner: Jcrespo):
[operations/puppet@production] Redirect stderr to /dev/null to prevent cronspam

https://gerrit.wikimedia.org/r/543866

Change 543866 merged by Elukey:
[operations/puppet@production] swap: Redirect stderr to /dev/null to prevent cronspam

https://gerrit.wikimedia.org/r/543866

Change 428947 abandoned by Filippo Giunchedi:
[operations/puppet@production] profile: install SMART checks after 'raid' fact is available.

Reason:
Not an issue

https://gerrit.wikimedia.org/r/428947