Page MenuHomePhabricator
Create Task
Maniphest T140928

Find out if mention notifications are used
Closed, ResolvedPublic5 Estimated Story Points
Actions

Description

Task: Soon there will be two new opt-in features for notifications: Receiving a notification whenever you successfully sent mentions and receiving a notification whenever your mentions could not be sent due to errors. We want to find out if they are actually used.

Please

  • Track how often people enable the two options
  • Track how often people disable the option again
  • Show it both in a graph on a grafana board

Background: This task is based on a wish that received 21 points (#9) in the German Community Wishlist[1]. Originally, the wish was to receive an information about the sent messages. To help people use mentions in a way that they are sent, we have also included notifications about mention failures, which add the reasons for the failure as well.

[1] Link to wish (in German): https://de.wikipedia.org/wiki/Wikipedia:Umfragen/Technische_W%C3%BCnsche_2015/Topw%C3%BCnsche#Bei_Speichern_Hinweis_.C3.BCber_abgegebene_Benachrichtigungen_.5BUmfrage_2015.5D
in English: https://meta.wikimedia.org/wiki/WMDE_Technical_Wishes#Notifications_about_failed_mentions

Details

ProjectBranchLines +/-Subject
analytics/wmde/scriptsproduction+1 -0Add echo statusNotifications script to 03 daily cron
analytics/wmde/scriptsmaster+1 -0Add echo statusNotifications script to 03 daily cron
analytics/wmde/scriptsproduction+138 -0+Script to track echo mention status usage
analytics/wmde/scriptsmaster+138 -0+Script to track echo mention status usage
Customize query in gerrit

Related Objects

Event Timeline

Lea_WMDE created this task.Jul 20 2016, 6:44 PM
Restricted Application added subscribers: Zppix, Aklapper. · View Herald TranscriptJul 20 2016, 6:44 PM
Addshore added a subscriber: Addshore.Jul 21 2016, 9:49 PM

For point 1 we will need a script to check record the number of users with the user preferences enabled.
For point 2 we will need a similar script with a days historic record of who had the mention preferences enabled that can then be cross checked with the state 24 hours later.

This is vaguely similar to the recent beta features tracking.

Addshore moved this task from Incoming to ToDo on the WMDE-Analytics-Engineering board.Jul 23 2016, 2:11 PM
Addshore added a project: User-Addshore.
Addshore moved this task from Unsorted 💣 to Next on the User-Addshore board.Jul 25 2016, 5:43 PM
Addshore claimed this task.Jul 31 2016, 5:49 PM
Addshore moved this task from Proposed to Doing on the TCB-Team-Sprint-2016-07-14 board.
Addshore moved this task from Next to Back Burner 🏛️ on the User-Addshore board.
Addshore moved this task from ToDo to Doing on the WMDE-Analytics-Engineering board.
gerritbot added a subscriber: gerritbot.Jul 31 2016, 6:08 PM

Change 302125 had a related patch set uploaded (by Addshore):
Script to track echo mention status usage

https://gerrit.wikimedia.org/r/302125

Addshore mentioned this in rADESd3c8befa597b: +Script to track echo mention status usage.Jul 31 2016, 6:09 PM
Addshore mentioned this in rADES22bce78f70c8: +Script to track echo mention status usage.
gerritbot added a comment.Jul 31 2016, 6:10 PM

Change 302126 had a related patch set uploaded (by Addshore):
Add echo statusNotifications script to 03 daily cron

https://gerrit.wikimedia.org/r/302126

gerritbot added a comment.Jul 31 2016, 6:11 PM

Change 302127 had a related patch set uploaded (by Addshore):
Script to track echo mention status usage

https://gerrit.wikimedia.org/r/302127

gerritbot added a comment.Jul 31 2016, 6:11 PM

Change 302128 had a related patch set uploaded (by Addshore):
Add echo statusNotifications script to 03 daily cron

https://gerrit.wikimedia.org/r/302128

Addshore mentioned this in rADES46f69aae67f0: +Script to track echo mention status usage.Jul 31 2016, 6:11 PM
Addshore mentioned this in rADESb086dfd409ef: Add echo statusNotifications script to 03 daily cron.
Addshore mentioned this in rADES7f3908fc622e: Add echo statusNotifications script to 03 daily cron.
Addshore moved this task from Back Burner 🏛️ to Active 🚁 on the User-Addshore board.Jul 31 2016, 6:44 PM
Addshore set the point value for this task to 5.
Addshore moved this task from Doing to Done on the TCB-Team-Sprint-2016-07-14 board.

Moved to done on the taskboard as the task is done for this sprint (although nothing is yet merged or running (as the features are not deployed)

gerritbot added a comment.Aug 1 2016, 5:11 PM

Change 302125 merged by jenkins-bot:
Script to track echo mention status usage

https://gerrit.wikimedia.org/r/302125

gerritbot added a comment.Aug 1 2016, 5:11 PM

Change 302127 merged by jenkins-bot:
Script to track echo mention status usage

https://gerrit.wikimedia.org/r/302127

Addshore moved this task from Active 🚁 to Closing ✔️ on the User-Addshore board.Aug 2 2016, 9:43 AM
Restricted Application added a project: Collaboration-Team-Triage. · View Herald TranscriptAug 2 2016, 9:43 AM
Addshore mentioned this in rADES81ce7891639f: Add echo statusNotifications script to 03 daily cron.Aug 2 2016, 2:00 PM
Addshore mentioned this in rADESaedd1dd76592: Add echo statusNotifications script to 03 daily cron.Aug 2 2016, 2:03 PM
Addshore mentioned this in rADES1a9fcbe26aee: Add echo statusNotifications script to 03 daily cron.
Addshore mentioned this in rADES19cdfc91fbd1: Add echo statusNotifications script to 03 daily cron.
Addshore added a comment.Aug 11 2016, 9:02 AM

Final patches should be merged once the feature is enabled on a production wiki

Lea_WMDE mentioned this in T143100: Deploy mention success + failure notifications on de-wiki.Aug 16 2016, 1:47 PM
gerritbot added a comment.Aug 19 2016, 8:48 AM

Change 302126 merged by jenkins-bot:
Add echo statusNotifications script to 03 daily cron

https://gerrit.wikimedia.org/r/302126

gerritbot added a comment.Aug 19 2016, 8:48 AM

Change 302128 merged by jenkins-bot:
Add echo statusNotifications script to 03 daily cron

https://gerrit.wikimedia.org/r/302128

Addshore added a comment.Aug 19 2016, 8:51 AM

Just pending a dashboard in the coming days now!

Addshore moved this task from Closing ✔️ to Next on the User-Addshore board.Aug 19 2016, 8:52 AM
Addshore added a comment.Aug 19 2016, 9:10 AM

Started @ https://grafana.wikimedia.org/dashboard/db/echo-mention-status-notifications

Lea_WMDE added a comment.Aug 19 2016, 9:45 AM

@Addshore would it be possible to have a seperate graph that shows the same for test?

Addshore mentioned this in rADESd9e3b8ed8176: Add echo statusNotifications script to 03 daily cron.Aug 19 2016, 9:49 AM
Addshore mentioned this in rADESae9d45e687ee: Add echo statusNotifications script to 03 daily cron.
Addshore added a comment.EditedAug 19 2016, 10:06 AM
In T140928#2567003, @Lea_WMDE wrote:

@Addshore would it be possible to have a seperate graph that shows the same for test?

Hmm, in theory it would be possible, however the graph currently on that dashboard shows the global users, ie, if they enable it on multiple sites it is only counted once)
I could remove the test sites from this number? (And I could do the same for the revslider data)?

Addshore moved this task from Next to Back Burner 🏛️ on the User-Addshore board.Aug 21 2016, 11:14 AM
Lea_WMDE mentioned this in T144181: Enable mention notifications on meta and mediawiki.org.Aug 29 2016, 4:08 PM
Addshore added a subscriber: Lea_Lacroix_WMDE.EditedSep 5 2016, 7:14 AM

@Lea_WMDE it would be great to get your opinion on the above comment! :)
Either we keep it as it is or I split out the test sites for these metrics and the revisionslider ones etc.! :)

Addshore removed a subscriber: Lea_Lacroix_WMDE.Sep 5 2016, 11:43 AM
Addshore closed this task as Resolved.Sep 9 2016, 10:13 AM
Addshore moved this task from Back Burner 🏛️ to Closing ✔️ on the User-Addshore board.Sep 20 2016, 4:30 PM
Addshore moved this task from Doing to Done on the WMDE-Analytics-Engineering board.Sep 23 2016, 1:47 PM
Content licensed under Creative Commons Attribution-ShareAlike 3.0 (CC-BY-SA) unless otherwise noted; code licensed under GNU General Public License (GPL) or other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL