Page MenuHomePhabricator
Create Task
Maniphest T379707

[Hypothesis] [3.1.8] Content Discovery: Build Feature Additional Article Recommendations (Search A/B test and Article-recommendations A/B test)
Closed, ResolvedPublic
Actions

Description

Hypothesis ID and Asana Link

3.1.8

Hypothesis Text

(Q2-Q3, web) If we build one feature which provides additional article-level recommendations, we will see an increase in clickthrough rate of 10% over existing recommendation options and a significant increase in external referrals for users who actively interact with the new feature.

Dependencies on other teams

ML, Research

Link to project page or other community space

https://www.mediawiki.org/wiki/Reading/Web/Content_Discovery_Experiments

Related Objects
Search...

StatusSubtypeAssignedTask
 ResolvedJdrewniakT379707 [Hypothesis] [3.1.8] Content Discovery: Build Feature Additional Article Recommendations (Search A/B test and Article-recommendations A/B test)
 ResolvedJdrewniakT378094 [Epic] A/B test search suggestions on mobile
 ResolvedovasilevaT378095 [Spike] Do people use the search within page button
 ResolvedovasilevaT378109 Mobile search A/B test instrumentation - technical enablers
 ResolvedJdrewniakT378103 Search recommendations A/B test: Write recommendations instrumentation spec
 ResolvedSpikeovasilevaT378101 [Spike] Decide where recommendations code should live
 ResolvedovasilevaT378106 Decide on communication strategy for A/B test
 ResolvedovasilevaT378100 [Spike] Functional + Design comparison of Typeahead search vs Mobile Search
 ResolvedovasilevaT378115 Implement A/B test bucketing for mobile search recommendation
 ResolvedSpikeNBaca-WMFT380630 [Spike] Investigate Stable User Identification for Logged-Out A/B Testing
 ResolvedJdlrobson-WMFT380926 Configure new streams for the mobile search A/B test
ResolvedjwangT387150 Data QA for instrumentation of empty search recommendation AB test
 ResolvedJScherer-WMFT378117 Search A/B test: Add MoreLike-based article suggestions when activating search bar in mobile
 ResolvedSpikeovasilevaT378118 [Spike] Check with Search Platform about traffic impact of recommendations A/B test
 ResolvedovasilevaT380596 Help with Legal and Security Review for New Mixin in Session Metrics Framework
 ResolvedJdlrobson-WMFT381604 Wire up new sessionLength instrumentation in search recommendations
 DeclinedbwangT381616 Update Wikimedia Events to send experiment field to product_metrics schema
 ResolvedJdlrobson-WMFT383266 Refine and document instrumentation spec and process with Jennifer
 ResolvedJdlrobson-WMFT382083 Modify how we bucket users to be based on localStorage rather than sessionStorage
 ResolvedJdlrobson-WMFT383422 Implement experimental sessionLength instrument for use in Search Recommendations A/B test
 ResolvedJdlrobson-WMFT383358 Finish wiring up search recommendations A/B test click tracking
 ResolvedJdlrobson-WMFT383611 Create new click tracking instrumentation for search recomm A/B test
 ResolvedJdlrobson-WMFT382080 Search recommendation clicks should trigger events
 ResolvedNoneT385309 Verify search recommendations A/B test click tracking is working as expected
 ResolvedJdlrobson-WMFT383936 Implement search activity id for Empty Search A/B test click tracking
 OpenDesignJScherer-WMFT381345 [DESIGN] Auto-highlight the first recommendation in the empty state of search
 ResolvedJdlrobson-WMFT384019 Initial Empty Search A/B test Deployment
 ResolvedbwangT386142 Analysis of the deployment plan for the Empty Search A/B test
 ResolvedSToyofuku-WMFT386735 Show empty search recommendation event is missing funnel data
 ResolvedbwangT386495 Fix session tick mixin relating to when events fire
 ResolvedBUG REPORTovasilevaT386849 Deploy empty search AB test to all wikis
 ResolvedEdtadrosT387400 SessionTick instrument should use sessionStorage instead of localStorage
 ResolvedjwangT389326 Analyze results of search suggestions A/B test

Event Timeline

NBaca-WMF created this task.Nov 13 2024, 6:24 AM
Restricted Application added a subscriber: Aklapper. · View Herald TranscriptNov 13 2024, 6:24 AM
NBaca-WMF added a subtask: T378094: [Epic] A/B test search suggestions on mobile.Nov 13 2024, 6:25 AM
NBaca-WMF moved this task from Now to Q2 FY24-25 on the Web-Team (Web-Product-Roadmap) board.Nov 13 2024, 6:33 AM
NBaca-WMF added a project: FY2024-25 KR 3.1 Content Discovery.
NBaca-WMF edited projects, added Web-Team-Roadmap; removed Web-Team (Web-Product-Roadmap).Nov 13 2024, 7:05 AM
NBaca-WMF moved this task from Now to Q2 FY24-25 on the Web-Team-Roadmap board.
Ottomata subscribed.Nov 22 2024, 10:33 AM
NBaca-WMF added a subtask: T382083: Modify how we bucket users to be based on localStorage rather than sessionStorage.Jan 11 2025, 3:55 PM
NBaca-WMF added a subtask: T383266: Refine and document instrumentation spec and process with Jennifer.
NBaca-WMF added a subtask: T383422: Implement experimental sessionLength instrument for use in Search Recommendations A/B test.
ovasileva renamed this task from [Hypothesis] [3.1.8] Content Discovery: Article-Level Recommendations to [Hypothesis] [3.1.8] Content Discovery: Build Feature Additional Article Recommendations (Search A/B test and Article-recommendations A/B test).Jan 13 2025, 11:23 AM
ovasileva removed a subtask: T383266: Refine and document instrumentation spec and process with Jennifer.
Volker_E subscribed.Jan 21 2025, 6:11 PM
Jdlrobson-WMF merged a task: T301812: Add empty state (aka presults) to search to help people discover more knowledge.Jan 23 2025, 6:04 AM
Jdlrobson-WMF added subscribers: • alexhollender_WMF, Jdlrobson, CCiufo-WMF and 8 others.
SToyofuku-WMF changed the status of subtask T382083: Modify how we bucket users to be based on localStorage rather than sessionStorage from In Progress to Stalled.Jan 24 2025, 5:31 PM
Jdlrobson-WMF closed subtask T383422: Implement experimental sessionLength instrument for use in Search Recommendations A/B test as Resolved.Jan 24 2025, 10:18 PM
Jdlrobson changed the status of subtask T382083: Modify how we bucket users to be based on localStorage rather than sessionStorage from Stalled to Open.Jan 25 2025, 1:09 AM
Jdlrobson changed the status of subtask T382083: Modify how we bucket users to be based on localStorage rather than sessionStorage from Open to In Progress.
Jdlrobson-WMF closed subtask T382083: Modify how we bucket users to be based on localStorage rather than sessionStorage as Resolved.Jan 31 2025, 10:39 PM
ovasileva moved this task from Q2 FY24-25 to Now on the Web-Team-Roadmap board.Feb 25 2025, 9:25 AM
ovasileva mentioned this in T392101: [Hypothesis] WE3.1.17 Search suggestions scaling.Apr 16 2025, 2:24 PM
Jdrewniak closed subtask T378094: [Epic] A/B test search suggestions on mobile as Resolved.Aug 15 2025, 4:28 PM
Jdrewniak closed this task as Resolved.Aug 15 2025, 4:31 PM
Jdrewniak claimed this task.
Jdrewniak subscribed.

This work was completed in Q2 2024 and is described in Asana as WE3.1.8

Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL · Credits