User story & summary:
As the Product Manager of the team that maintains Thanks, I want to better understand Thanks usage, so we can make data-informed decisions about any feature improvements in the future.
As a Wikimedian, I want to understand how Thanks is used, because that might help clarify is there is an issue with the current confirmation UX.
Background & research:
This task is important because some editors, especially newcomers, find the current Thanks confirmation confusing. Some even think that Thanks is sent privately after the initial click on Thanks. It's currently difficult to understand how widespread this confusion is, and adding instrumentation should provide at least some general data to help decide if additional effort to improve Thanks is needed.
- Can we find out how many thanks are not being completed on desktop? That is, the user clicks on a thank button, but does not click on the confirmation button.
- Does the level of non-completion differ by user experience level (perhaps total number of edits, or perhaps total number of completed thanks)?
- The ultimate question is whether the confirmation step is likely to be preventing misclicks/unwanted thanks, or if it is mostly stopping wanted thanks. If it stops very few wanted thanks, then it might make sense to duplicate this confirmation step on mobile.
See Also:
T63737: Thank notification on mobile should support click to undo
T73360: Instrument click through tracking on Thank, and confirm steps
T51087: Specify which edit was thanked in Special:Log/thanks, both for private and public records' sake, if configured to do so
T324134: Communication: connecting Thanks to a specific edit
T333027: Growth design: finalize designs for thanks confirmation UX
Instrumentation Details:
Thanks instrumentation should help answer the following questions:
- Where does Thanks originate?
- Device: Mobile vs. Desktop vs. Apps
- Page: Revision history, Diff, Watchlist, Recent changes, Contributions,
- After Thanks is clicked, how often is does the following happen:
- user does nothing further (Thanks is not sent)
- user clicks "Cancel" (Thanks is not sent)
- user confirms and sends Thanks ("Thank" is clicked again after the "Publicly send thanks?" prompt).
- How much does the above differ based on a "Thanker's" experience level?
- TBD: should we use the same tenure buckets as used elsewhere (Turnilo) or should we use edit count buckets?
Acceptance Criteria:
Given I'm reviewing Thanks data,
When I want to evaluate how Thanks is used for a specific project,
Then I have the data I need to understand:
- the origin of thanks (device & page)
- how often Thanks is confirmed, cancelled, or abandoned
- how this differs by the Thanker's experience level