Page MenuHomePhabricator
Create Task
Maniphest T131366

Measure impact of HoverCards on Central Notice interaction
Closed, ResolvedPublic
Actions

Description

As an economist, I want to understand the effect, if any, of user interaction with Central Notice when HoverCards is enabled for general reader usage.

Acceptance criteria

  • Central Notice instrumentation is modified to capture the notion that HoverCards is in force for the given user, such that it can be factored into efficacy calculations when trialing solutions.
  • An actual test is conducted to measure the impact, if any, of user interaction with Central Notice when HoverCards is enabled for general reader usage.
  • The impact is shared with the appropriate audience.

Related Objects
Search...

StatusSubtypeAssignedTask
 ResolvedDerecksonT68374 Enable Hovercards on se.wikimedia.org (Swedish chapter wiki)
 ResolvedJdlrobsonT70860 [GOAL] Graduate Page Previews feature (Popups extension) out of Beta Feature
 ResolvedovasilevaT131366 Measure impact of HoverCards on Central Notice interaction
 ResolvedNoneT133406 investigate any fr-tech work associated with hovercard test
InvalidNoneT141775 Initiate Hovercards A/B Test 3 with Central Notice: October 2016
 ResolvedCKoerner_WMFT143170 Start discussion with Italian community about running a/b test for hovercards in October
 ResolvedJdlrobsonT132602 [GOAL] Roll Hovercards out on smaller wikipedia project
 ResolvedputnikT115817 Template "lang" badly processed
 Resolved• JhernandezT135020 Spike (3h): How to do proper sentence detection for TextExtracts
 Resolved• JhernandezT135824 Replace hovercards usage of exsentences with exchars and exintro (like iOS native app)
 Resolved• MoushiraT132603 Get community buy-in on smaller wiki for graduating hovercards out of beta
 ResolvedphuedxT136713 Increase ON percentage for Hovercards A/B test 1
 Resolveddr0ptp4ktT134778 Run Hovercards A/B test 1
 Resolved• JhernandezT132604 Prepare HoverCards for A/B test on smaller wikipedia project
 ResolvedJdlrobsonT129177 Security review of Hovercards before beta->default conversion
 ResolvedPcoombeT134291 Create banners for HoverCards A/B test
 ResolvedAndyRussGT134286 CentralNotice: test registration
 ResolvedNoneT131315 Update event logging used for Hovercards
 Resolveddr0ptp4ktT135425 Prepare Hovercards for A/B test
 Resolved• TbayerT139319 Analyze results of Hovercards A/B test - Hungarian
 Resolved• JhernandezT141922 [ 8 hours ] Spike: Analyze Hovercards and general instrumentation code for potential sources of unexpected data outcomes

Event Timeline

dr0ptp4kt created this task.Mar 31 2016, 4:05 PM
Restricted Application added a subscriber: Aklapper. · View Herald TranscriptMar 31 2016, 4:05 PM
dr0ptp4kt mentioned this in T131373: Measure impact of mobile web link preview on Central Notice interaction.Mar 31 2016, 4:38 PM
dr0ptp4kt added a parent task: T70860: [GOAL] Graduate Page Previews feature (Popups extension) out of Beta Feature.Mar 31 2016, 4:41 PM
dr0ptp4kt triaged this task as Medium priority.Mar 31 2016, 5:08 PM
• Tbayer subscribed.Mar 31 2016, 5:59 PM
Pcoombe subscribed.Mar 31 2016, 6:00 PM
AndyRussG added a project: MediaWiki-extensions-CentralNotice.Apr 7 2016, 8:32 PM
AndyRussG added a subscriber: MediaWiki-extensions-CentralNotice.
AndyRussG removed a subscriber: MediaWiki-extensions-CentralNotice.
dr0ptp4kt added a subscriber: • JKatzWMF.Apr 11 2016, 3:13 AM
• DStrine moved this task from Triage to Sprint +2 on the Fundraising-Backlog board.Apr 11 2016, 8:21 PM
• JKatzWMF added a subtask: T132604: Prepare HoverCards for A/B test on smaller wikipedia project.Apr 14 2016, 7:19 PM
dr0ptp4kt added a project: Reading-Web-Sprint-72-Ninety-nine-problems-but-Nirzar-aint-one.Apr 21 2016, 7:12 PM
• DStrine mentioned this in T133406: investigate any fr-tech work associated with hovercard test .Apr 22 2016, 4:49 PM
• DStrine added a subtask: T133406: investigate any fr-tech work associated with hovercard test .Apr 22 2016, 5:10 PM
dr0ptp4kt updated the task description. (Show Details)Apr 22 2016, 8:27 PM
dr0ptp4kt updated the task description. (Show Details)
MBinder_WMF added a project: Web-Team-Backlog.Apr 27 2016, 5:10 PM
MBinder_WMF moved this task from Incoming to 2016-17 Q2 on the Web-Team-Backlog board.Apr 27 2016, 5:14 PM
• DStrine closed subtask T133406: investigate any fr-tech work associated with hovercard test as Resolved.May 3 2016, 5:36 PM
dr0ptp4kt added a comment.May 9 2016, 3:33 PM

This task should be updated with the variable name exposed by Hovercards that indicates whether HoverCards is on (T132604: Prepare HoverCards for A/B test on smaller wikipedia project).

dr0ptp4kt edited projects, added Reading-Web-Sprint-73-One-day-we'll-finish-the-EventLogging-card; removed Reading-Web-Sprint-72-Ninety-nine-problems-but-Nirzar-aint-one.May 9 2016, 3:36 PM
dr0ptp4kt moved this task from Needs Analysis to Tracking on the Reading-Web-Sprint-73-One-day-we'll-finish-the-EventLogging-card board.
• jrobell subscribed.May 11 2016, 10:14 AM
dr0ptp4kt moved this task from 2016-17 Q2 to 2015-16 Q4 on the Web-Team-Backlog board.May 23 2016, 7:36 PM
dr0ptp4kt edited projects, added Reading-Web-Sprint-74-Page-views-page-views-PAGE-VIEWS; removed Reading-Web-Sprint-73-One-day-we'll-finish-the-EventLogging-card.May 23 2016, 8:28 PM
dr0ptp4kt moved this task from 2015-16 Q4 to 2016-17 Q2 on the Web-Team-Backlog board.May 23 2016, 8:32 PM
dr0ptp4kt added a subscriber: • DStrine.May 23 2016, 8:42 PM

@DStrine, would you please confirm whether this is the task for the Fundraising Tech side?

If you have a separate task for that, I can put that into Tracking in the appropriate sprint for Reading Web. The question came up in an email and I realized I better just ask!

• Jhernandez closed subtask T132604: Prepare HoverCards for A/B test on smaller wikipedia project as Resolved.May 24 2016, 10:19 AM
awight added a subtask: T134286: CentralNotice: test registration.May 26 2016, 9:03 PM
Jdlrobson moved this task from Needs Analysis to Tracking on the Reading-Web-Sprint-74-Page-views-page-views-PAGE-VIEWS board.Jun 1 2016, 4:38 PM
dr0ptp4kt moved this task from 2016-17 Q2 to 2015-16 Q4 on the Web-Team-Backlog board.Jun 6 2016, 5:10 PM
Pcoombe closed subtask T134286: CentralNotice: test registration as Resolved.Jun 14 2016, 9:24 PM
Pcoombe added a subtask: T134291: Create banners for HoverCards A/B test.Jun 15 2016, 10:23 AM

This test is underway now on Hungarian Wikipedia. I'll share results with you when we have some.

• jhobs added a project: Reading-Web-Sprint-76-Retrosprekfast.Jun 30 2016, 8:10 PM
dr0ptp4kt moved this task from 2015-16 Q4 to 2016-17 Q2 on the Web-Team-Backlog board.Jun 30 2016, 8:10 PM
dr0ptp4kt moved this task from Needs Analysis to Tracking on the Reading-Web-Sprint-76-Retrosprekfast board.Jul 1 2016, 5:51 PM
• Tbayer mentioned this in T139319: Analyze results of Hovercards A/B test - Hungarian.Jul 4 2016, 11:50 PM
MBinder_WMF moved this task from 2016-17 Q2 to 2015-16 Q4 on the Web-Team-Backlog board.Jul 5 2016, 4:42 PM
MBinder_WMF moved this task from 2015-16 Q4 to 2016-17 Q1 on the Web-Team-Backlog board.Jul 7 2016, 8:11 PM
• DStrine moved this task from Sprint +2 to Blocked or not fr-tech on the Fundraising-Backlog board.Jul 14 2016, 9:17 PM
dr0ptp4kt moved this task from 2016-17 Q1 to 2014-15 Q4 on the Web-Team-Backlog board.Jul 18 2016, 4:05 PM
dr0ptp4kt added a subtask: T136746: Initiate Hovercards A/B Test 2: ru and it.Aug 1 2016, 3:26 PM
dr0ptp4kt edited subtasks, added: T141775: Initiate Hovercards A/B Test 3 with Central Notice: October 2016; removed: T136746: Initiate Hovercards A/B Test 2: ru and it.
Pcoombe added a comment.Aug 23 2016, 5:04 PM

Results from the first test are here: https://www.mediawiki.org/wiki/Extension:Popups/Fundraising_test_1

• JKatzWMF added a subscriber: ovasileva.Aug 23 2016, 11:46 PM

@Pcoombe This is perfect. Thanks! @ovasileva check out above ^^

ovasileva added a comment.Aug 24 2016, 12:03 PM

Whoo, thank you, @Pcoombe! I agree - we should test on other wikipedias and compare, but so far so good

MBinder_WMF edited projects, added Page-Previews (2016-17-Q2-Goal); removed Page-Previews.Sep 1 2016, 8:15 PM
• Tbayer mentioned this in T144603: Estimate how much of the Hovercards-caused pageview decrease comes from reduced usage of the back button .Sep 2 2016, 2:43 PM
ovasileva closed subtask T141775: Initiate Hovercards A/B Test 3 with Central Notice: October 2016 as Invalid.Sep 6 2016, 7:55 PM
ovasileva moved this task from Backlog to Tracking on the Page-Previews (2016-17-Q2-Goal) board.Dec 19 2016, 8:12 PM
MBinder_WMF edited projects, added Page-Previews (2016-17-Q3-Goal); removed Page-Previews (2016-17-Q2-Goal).Jan 5 2017, 7:35 PM
MBinder_WMF moved this task from Backlog to Tracking on the Page-Previews (2016-17-Q3-Goal) board.Jan 5 2017, 7:48 PM
ovasileva closed this task as Resolved.Feb 15 2017, 11:29 AM
ovasileva claimed this task.

results of 2nd fundraising tests are published and show no negative effects. @Pcoombe - resolving this.

• Phabricator_maintenance moved this task from 2014-15 Q4 to 2016-17 Q3 on the Web-Team-Backlog board.Mar 6 2018, 11:39 PM
Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL