Page MenuHomePhabricator
Create Task
Maniphest T117617

Search Satisfaction metric dropped by 38.4%
Closed, ResolvedPublic3 Estimated Story Points
Actions

Description

Looking at the 7day scale for http://searchdata.wmflabs.org/metrics/ i'm seeing a 38.4% drop in user satisfaction. Our threshold passing has gone to 0 while our click through has remained the same.

Any idea what's going on?

Details

SubjectRepoBranchLines +/-
Reset default tables for user satisfaction metricswikimedia/discovery/goldenmaster+7 -3
Customize query in gerrit

Related Objects

Event Timeline

• Tfinc created this task.Nov 3 2015, 10:59 PM
• Tfinc raised the priority of this task from to Needs Triage.
• Tfinc updated the task description. (Show Details)
• Tfinc added a project: Discovery-ARCHIVED.
• Tfinc subscribed.
Restricted Application added subscribers: StudiesWorld, Aklapper. · View Herald TranscriptNov 3 2015, 10:59 PM
• Tfinc moved this task from Needs triage to Analysis on the Discovery-ARCHIVED board.Nov 3 2015, 10:59 PM
Ironholds subscribed.Nov 5 2015, 7:39 PM

I'll investigate.

Ironholds claimed this task.Nov 5 2015, 7:39 PM
Ironholds edited projects, added Discovery-Analysis (Current work); removed Discovery-ARCHIVED.
Ironholds set Security to None.
Ironholds moved this task from Backlog to In progress on the Discovery-Analysis (Current work) board.
Ironholds edited a custom field.
Ironholds added a comment.Nov 5 2015, 7:51 PM

It looks like the answer is that there aren't any events in the table it stores as the default, and that's because when Erik fixed the broken schema he switched tables (to avoid caching issues) and assumed we'd know he'd need to, and we assumed if he didn't tell us the table had switched it'd changed the same, and *whoops*. Fixing and backfilling now.

Ironholds edited a custom field.Nov 5 2015, 7:51 PM
• Deskana subscribed.Nov 5 2015, 7:56 PM

This is related to T116319.

Ironholds added a comment.Nov 5 2015, 7:57 PM

Backfilling is now complete, and I am submitting a patch to reset the defaults.

gerritbot subscribed.Nov 5 2015, 7:57 PM

Change 251323 had a related patch set uploaded (by OliverKeyes):
Reset default tables for user satisfaction metrics

https://gerrit.wikimedia.org/r/251323

gerritbot added a project: Patch-For-Review.Nov 5 2015, 7:57 PM
Ironholds moved this task from In progress to Needs review on the Discovery-Analysis (Current work) board.Nov 5 2015, 8:07 PM
gerritbot added a comment.Nov 5 2015, 8:31 PM

Change 251323 merged by Bearloga:
Reset default tables for user satisfaction metrics

https://gerrit.wikimedia.org/r/251323

Ironholds moved this task from Needs review to Done on the Discovery-Analysis (Current work) board.Nov 5 2015, 8:49 PM
• Tfinc changed the task status from Open to Stalled.Nov 20 2015, 8:23 PM

Data remains unchanged. Re-opening.

Ironholds moved this task from Done to In progress on the Discovery-Analysis (Current work) board.Nov 23 2015, 2:49 PM
Ironholds added a subscriber: mpopov.Nov 23 2015, 3:45 PM

Bug fixed, need @mpopov to kick the machine.

Ironholds moved this task from In progress to Needs review on the Discovery-Analysis (Current work) board.Nov 23 2015, 3:46 PM
mpopov moved this task from Needs review to Done on the Discovery-Analysis (Current work) board.Nov 23 2015, 9:28 PM
• Deskana closed this task as Resolved.Nov 26 2015, 12:00 AM
• Deskana moved this task from Done to Resolved on the Discovery-Analysis (Current work) board.
Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL