Page MenuHomePhabricator

Automatically log fatals/exceptions into Phabricator with stack traces
Open, LowPublic

Description

It'd be great if fatals and exceptions were automagically logged into BZ with stack traces.

Obviously just logging every occurrence straight into BZ would be a mess.

There was talk of a logstash dedupe tool that might help allievate this problem...


Version: wmf-deployment
Severity: enhancement
See also: T85239

Details

Reference
bz68820

Event Timeline

bzimport raised the priority of this task from to Low.Nov 22 2014, 3:33 AM
bzimport set Reference to bz68820.
bzimport added a subscriber: Unknown Object (MLST).
Reedy created this task.Jul 29 2014, 8:10 PM
Reedy added a comment.Jul 29 2014, 8:11 PM

Dropping priority. It'd be nice to have, but it really isn't urgent

greg added a comment.Jul 29 2014, 9:01 PM

Obligatory "make sure we don't expose sensitive data" comment.

greg added a comment.Jul 29 2014, 9:49 PM

Related: https://github.com/thurloat/sentry-jira

It lets you create JIRA issues from Sentry items/whatever they're called.

No Bugzilla plugin yet.

But there is a Phabricator plugin: https://github.com/getsentry/sentry-phabricator :) :)

So, that would allow manual task creation, not automatic. Maybe good enough for a first step.

bd808 added a comment.Jul 30 2014, 2:45 AM

Testing instance (un-puppeted POC) at https://sentry-beta.wmflabs.org. The phabricator plugin is installed. We need to 1) get some data in there, 2) setup a phabricator user to post bugz, 3) configure sentry to use the user.

For the "no private data" part, maybe we should setup the project that the bugs are posted to as private somehow and let a human triage them?

greg added a comment.Jul 30 2014, 5:23 AM

(In reply to Bryan Davis from comment #6)

For the "no private data" part, maybe we should setup the project that the
bugs are posted to as private somehow and let a human triage them?

That's what I was thinking, yeah. We can reuse what Mukunda did for the Security project, but no spam the Security project.

Tgr added a subscriber: Tgr.Dec 14 2014, 9:41 PM
Tgr updated the task description. (Show Details)Jan 6 2015, 10:45 PM
Tgr set Security to None.
mmodell added a comment.EditedJan 18 2018, 12:40 PM

FWIW, Kibana X-Pack includes machine learning features which can be used to dedupe logs and identify outliers. If we implemented these features that might go a long way towards identifying which errors are unique and which ones should be automatically entered into Maniphest tasks.

More info: https://www.elastic.co/guide/en/kibana/5.5/xpack-ml.html

@mmodell it seems to me with Phatality deployed to production we can resolve this task ?

Phatality isn't fully automatic so I don't know if that addresses what @Reedy had in mind here or not.

Tgr added a comment.Sep 30 2019, 3:49 PM

An ideal tool would tell you whether a bug report for that stack trace exists already.

@Tgr: indeed, I want to add that functionality to phatality for sure. I've designed it so that will be possible, it just needs a bit more work to expose it into kibana's ui.