Page MenuHomePhabricator

Wikipedia Accessibility, check false positives and false negatives of traffic alarms
Open, MediumPublic

Description

Examples False positives: Siria and Etiopia keep on alarming but do those alarms represent a true event or rather the city entropy timeseries is not solid enough for us to alarm on on those two countries?

False negatives:

See event on iran not picked up: https://office.wikimedia.org/wiki/Analytics/MonitoringWikipediaAccessibilityAroundTheWorld#Events_that_were_not_detected_and_should_have_been

Event Timeline

Nuria created this task.Feb 13 2020, 4:18 PM
Restricted Application added a project: Operations. · View Herald TranscriptFeb 13 2020, 4:18 PM
Restricted Application added a subscriber: Aklapper. · View Herald Transcript
Nuria added a comment.Feb 13 2020, 4:24 PM

We can also change the alarm to hourly and see events caught. Now, this might mean a super large number of false positives so we need to evaluate the balance between recall and precision.

Nuria updated the task description. (Show Details)Feb 14 2020, 1:44 AM
jbond triaged this task as Medium priority.Feb 14 2020, 1:14 PM
Nuria moved this task from Incoming to Data Quality on the Analytics board.Feb 17 2020, 5:03 PM