Page MenuHomePhabricator
Create Task
Maniphest T202429

[EL sanitization] Make cron send alert emails if job fails before calling refine
Closed, ResolvedPublic5 Estimated Story Points
Actions

Details

ProjectBranchLines +/-Subject
operations/puppetproduction+1 -1Switch on RefineMonitor for Analytics EventLoggingSanitization
operations/puppetproduction+12 -14Adjust params for Analytics data_purge EventLoggingSanitization job
analytics/refinery/sourcemaster+142 -0Add EventLoggingSanitizationMonitor.scala
operations/puppetproduction+1 -1Correct escape chars of EL sanitization in analytics data_purge.pp
analytics/refinery/sourcemaster+5 -25Upgrade profig lib to 2.3.3 after bug fix upstream
operations/puppetproduction+1 -1Add RefineMonitor to EventLoggingSanitization analytics refinery job
operations/puppetproduction+21 -8Send an alert email when EventLoggingSanitization job fails
operations/puppet/cdhmaster+1 -1Change spark log4j config to output logs to stdout
Customize query in gerrit

Related Objects
Search...

Event Timeline

mforns triaged this task as Medium priority.Aug 21 2018, 4:50 PM
mforns created this task.
mforns moved this task from Next Up to In Progress on the Analytics-Kanban board.
gerritbot added a subscriber: gerritbot.Aug 21 2018, 4:57 PM

Change 454318 had a related patch set uploaded (by Mforns; owner: Mforns):
[operations/puppet/cdh@master] Change spark log4j config to output logs to stdout

https://gerrit.wikimedia.org/r/454318

gerritbot added a project: Patch-For-Review.Aug 21 2018, 4:57 PM
gerritbot added a comment.Aug 21 2018, 7:47 PM

Change 454318 abandoned by Mforns:
Change spark log4j config to output logs to stdout

Reason:
Discussed this with the team and we decided to go another path.

https://gerrit.wikimedia.org/r/454318

gerritbot added a comment.Aug 22 2018, 2:55 PM

Change 454562 had a related patch set uploaded (by Mforns; owner: Mforns):
[operations/puppet@production] Send an alert email when EventLoggingSanitization job fails

https://gerrit.wikimedia.org/r/454562

mforns renamed this task from [EL sanitization] Modify spark log4j params to output to stdout instead of stderr to [EL sanitization] Make cron send alert emails if job fails before calling refine.Aug 22 2018, 2:57 PM
mforns moved this task from In Progress to In Code Review on the Analytics-Kanban board.Aug 22 2018, 3:09 PM
Milimetric raised the priority of this task from Medium to High.Aug 23 2018, 4:05 PM
Milimetric moved this task from Incoming to Operational Excellence on the Analytics board.
mforns moved this task from In Code Review to In Progress on the Analytics-Kanban board.Nov 20 2018, 4:05 PM
gerritbot added a comment.Nov 21 2018, 10:51 PM

Change 475231 had a related patch set uploaded (by Mforns; owner: Mforns):
[operations/puppet@production] Add RefineMonitor to EventLoggingSanitization analytics refinery job

https://gerrit.wikimedia.org/r/475231

mforns moved this task from In Progress to In Code Review on the Analytics-Kanban board.Nov 21 2018, 10:52 PM
gerritbot added a comment.Nov 22 2018, 10:58 AM

Change 454562 abandoned by Mforns:
Send an alert email when EventLoggingSanitization job fails

Reason:
This is invalid after refactor. And is taken care by the new patch: https://gerrit.wikimedia.org/r/#/c/operations/puppet/ /475231/

https://gerrit.wikimedia.org/r/454562

gerritbot added a comment.Nov 22 2018, 11:23 AM

Change 475231 merged by Elukey:
[operations/puppet@production] Add RefineMonitor to EventLoggingSanitization analytics refinery job

https://gerrit.wikimedia.org/r/475231

mforns added a subscriber: JAllemandou.Nov 23 2018, 12:37 PM

Yesterday @JAllemandou and I discovered a bug in profig, the library that ConfigHelper uses to parse property files.
I created an issue on their github repo: https://github.com/outr/profig/issues/24

gerritbot added a comment.Nov 28 2018, 3:43 PM

Change 476290 had a related patch set uploaded (by Mforns; owner: Mforns):
[analytics/refinery/source@master] Upgrade profig lib to 2.3.3 after bug fix upstream

https://gerrit.wikimedia.org/r/476290

gerritbot added a comment.Nov 29 2018, 11:37 AM

Change 476290 merged by jenkins-bot:
[analytics/refinery/source@master] Upgrade profig lib to 2.3.3 after bug fix upstream

https://gerrit.wikimedia.org/r/476290

gerritbot added a comment.Nov 30 2018, 4:19 PM

Change 476886 had a related patch set uploaded (by Mforns; owner: Mforns):
[operations/puppet@production] Correct escape chars of EL sanitization in analytics data_purge.pp

https://gerrit.wikimedia.org/r/476886

gerritbot added a comment.Dec 3 2018, 7:37 AM

Change 476886 merged by Elukey:
[operations/puppet@production] Correct escape chars of EL sanitization in analytics data_purge.pp

https://gerrit.wikimedia.org/r/476886

gerritbot added a comment.Dec 7 2018, 12:30 AM

Change 478126 had a related patch set uploaded (by Mforns; owner: Mforns):
[analytics/refinery/source@master] Add EventLoggingSanitizationMonitor.scala

https://gerrit.wikimedia.org/r/478126

gerritbot added a comment.Dec 7 2018, 12:45 AM

Change 478129 had a related patch set uploaded (by Mforns; owner: Mforns):
[operations/puppet@production] Adjust params for Analytics data_purge EventLoggingSanitization job

https://gerrit.wikimedia.org/r/478129

gerritbot added a comment.Dec 10 2018, 9:48 PM

Change 478126 merged by Mforns:
[analytics/refinery/source@master] Add EventLoggingSanitizationMonitor.scala

https://gerrit.wikimedia.org/r/478126

Nuria moved this task from In Code Review to Ready to Deploy on the Analytics-Kanban board.Dec 12 2018, 12:32 AM
gerritbot added a comment.Jan 2 2019, 2:56 PM

Change 478129 merged by Ottomata:
[operations/puppet@production] Adjust params for Analytics data_purge EventLoggingSanitization job

https://gerrit.wikimedia.org/r/478129

mforns moved this task from Ready to Deploy to Done on the Analytics-Kanban board.Jan 7 2019, 7:03 PM
gerritbot added a comment.Jan 8 2019, 3:50 PM

Change 482826 had a related patch set uploaded (by Mforns; owner: Mforns):
[operations/puppet@production] Switch on RefineMonitor for Analytics EventLoggingSanitization

https://gerrit.wikimedia.org/r/482826

gerritbot added a comment.Jan 8 2019, 4:19 PM

Change 482826 merged by Elukey:
[operations/puppet@production] Switch on RefineMonitor for Analytics EventLoggingSanitization

https://gerrit.wikimedia.org/r/482826

Nuria closed this task as Resolved.Feb 14 2019, 5:10 AM
Content licensed under Creative Commons Attribution-ShareAlike 3.0 (CC-BY-SA) unless otherwise noted; code licensed under GNU General Public License (GPL) or other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL