[EPIC] Experiment: Display article recommendations in more prominent locations
Closed, DeclinedPublicDesign
Actions

Assigned To

None

Authored By

	JScherer-WMF
	Jul 16 2024, 8:31 PM

Description

Background

This epic will center around designing and running experiment around testing recommendations within the empty state of search. In parallel, we will test recommendations in the sidebar of the desktop experience. It will contain all tickets related to the investigation and running of these tests. The epic will be completed once the experiment is done and next steps are determined for the ideas experimented on.

User story

As a reader on Wikipedia for intrinsic learning, I want to satisfy my curiosity by navigating to recommended articles.

Requirements

An experiment is run that allows us to test the hypothesis: "People who open the search bar and see the recommendations will have more internal referrals for that page that people who do not open the search bar"
- Other variables will also be measured depending on the experiment chosen

Potential metrics of interest:

internal referrals
time to query abandonment
clickthrough rate
session depth (time x number of articles, i.e. does this promote rabbit hole rea

This task was created by Version 1.2.0 of the Web team task template using phabulous

Related Objects
Search...

Status	Subtype	Assigned	Task
Declined	Design	None	T370209 [EPIC] Experiment: Display article recommendations in more prominent locations
Resolved	Design	ovasileva	T370521 [EPIC] Test UI of recommendations in the empty state of search and compare to other locations
Resolved	Design	Jdrewniak	T371230 [Spike 1 day] Identify delivery mechanism of experiment pt 1
Resolved	Design	ovasileva	T371231 [Design] Create design for empty state of search experiment
Resolved	Spike	ovasileva	T371236 Identify metrics for search UI recommendations experiment
Resolved	Design	Jdrewniak	T372638 Build empty state of search experiment
Resolved	Design	Jdrewniak	T371294 [Spike 2 days] Identify delivery mechanism pt 2
Resolved		Jdlrobson	T371286 Setup Repo for recommendation experimentation
Resolved	Design	bwang	T372780 Instrument empty state of search experiment
Resolved		ovasileva	T372867 Determine participant recruitment mechanism for UI experiment
Resolved		JScherer-WMF	T373584 Build second recommendation experiment within browser extension
Resolved		ovasileva	T373983 Design terms of use message for browser extension sidebar experiment
Duplicate		None	T377400 Build terms of use message for browser extension sidebar experiment
Resolved		ovasileva	T374171 Deploy Recommendation Experiment (Second Experiment) in Chrome Extension
Resolved	Design	jwang	T374965 Analyze empty state of search experiment
Open	Design	JScherer-WMF	T381345 [DESIGN] Auto-highlight the first recommendation in the empty state of search
Declined	Spike	None	T370523 [EPIC] Run UI-less experiment comparing API recommendation quality
Resolved		JScherer-WMF	T370211 [Design] Generate a recommendation list from multiple APIs for the empty state of search for user testing (UI-less)
Resolved	Spike	ovasileva	T371235 Design structure for UI-less experiment comparing API recommendation quality
Resolved	Spike	JScherer-WMF	T373717 Run Userlytics study on UI and non-ui experiment protocols for WE3.1.
Resolved	Spike	NBaca-WMF	T369853 [Spike 2 days] Recommended Content APIs
Resolved	Spike	ovasileva	T371238 Report on baseline metrics for recommendations experiments (UI and non-UI experiment)
Resolved	Spike	NBaca-WMF	T371287 [Spike 1 day] Investigate List Building APIs
Resolved	Spike	ovasileva	T373793 Get privacy policy for UI-less experiment
Declined		ovasileva	T373851 Enable UI and non-UI experiments (enable quicksurveys and launch browser extension)
Resolved		Jdlrobson	T373039 Set up quicksurveys for UI and non-UI experiments
Resolved		Jdlrobson	T373623 Upload experimental chrome extension to Chrome store
Resolved		ovasileva	T374670 Analyze the results of the non-ui surveys
Resolved		ovasileva	T374669 {GOAL] Run the non-ui survey with new recommendations
Resolved		ovasileva	T379240 Generate API list for recommended content
Resolved		ovasileva	T379241 Set up quicksurveys for non-UI experiment pt 2
Resolved		ovasileva	T376817 Analyze results of article recommendation experiment
Resolved		ovasileva	T374743 Disable quick surveys for experiments
Resolved	Design	ovasileva	T381337 [DESIGN] Iterate on sidebar recommendations designs
Resolved	Design	dchen	T381339 [RESEARCH] Learn how casual readers feel about algorithmically recommended Wikipedia articles

Event Timeline

JScherer-WMF created this task.Jul 16 2024, 8:31 PM

Restricted Application added a subscriber: Aklapper. · View Herald TranscriptJul 16 2024, 8:31 PM

JScherer-WMF updated the task description. (Show Details)Jul 16 2024, 8:35 PM

JScherer-WMF mentioned this in T370211: [Design] Generate a recommendation list from multiple APIs for the empty state of search for user testing (UI-less).

preliminary designs

ovasileva renamed this task from Display article recommendations in the empty state of search to [EPIC] Experiment: Display article recommendations in the empty state of search.Jul 18 2024, 4:12 PM

ovasileva added a project: Epic.

ovasileva removed JScherer-WMF as the assignee of this task.Jul 19 2024, 12:59 PM

ovasileva triaged this task as High priority.

ovasileva updated the task description. (Show Details)

ovasileva added a subtask: T369853: [Spike 2 days] Recommended Content APIs.Jul 19 2024, 1:06 PM

Jdlrobson moved this task from Incoming to Epics/Goals on the Web-Team-Backlog-Archived board.Jul 26 2024, 1:51 AM

ovasileva removed a subtask: T369853: [Spike 2 days] Recommended Content APIs.Jul 29 2024, 10:29 AM

ovasileva added a subtask: T370523: [EPIC] Run UI-less experiment comparing API recommendation quality.

dr0ptp4kt subscribed.Aug 20 2024, 8:02 PM

ovasileva added a subtask: T373039: Set up quicksurveys for UI and non-UI experiments.Aug 21 2024, 4:36 PM

ovasileva renamed this task from [EPIC] Experiment: Display article recommendations in the empty state of search to [EPIC] Experiment: Display article recommendations in more prominent locations.Aug 29 2024, 10:03 AM

ovasileva added a subtask: T373584: Build second recommendation experiment within browser extension.

ovasileva removed a subtask: T373039: Set up quicksurveys for UI and non-UI experiments.Sep 3 2024, 9:34 AM

ovasileva mentioned this in T374171: Deploy Recommendation Experiment (Second Experiment) in Chrome Extension.Sep 16 2024, 9:29 AM

ovasileva removed a subtask: T373584: Build second recommendation experiment within browser extension.Sep 17 2024, 11:11 AM

Jdrewniak mentioned this in T376817: Analyze results of article recommendation experiment.Oct 9 2024, 3:35 PM

ovasileva added a subtask: T376817: Analyze results of article recommendation experiment.Oct 10 2024, 2:40 PM

ovasileva moved this task from Backlog to Recommendations - article on the FY2024-25 KR 3.1 Content Discovery board.Oct 10 2024, 9:08 PM

ovasileva added a subtask: T374743: Disable quick surveys for experiments.Nov 7 2024, 9:04 AM

Jdlrobson moved this task from Epics/Goals to Groomed on the Web-Team-Backlog-Archived board.Nov 13 2024, 11:16 PM

Jdlrobson edited projects, added Web-Team; removed Web-Team-Backlog-Archived.Nov 13 2024, 11:35 PM

Jdlrobson moved this task from Incoming to Freezer on the Web-Team board.Nov 13 2024, 11:45 PM

NBaca-WMF moved this task from Freezer to FY2024-25 Q2 Sprint 4 (Nov 13 - Nov 26, 2024) on the Web-Team board.Nov 18 2024, 4:00 PM