Page MenuHomePhabricator
Create Task
Maniphest T311531

Add an Image: experiment analysis
Closed, ResolvedPublic
Actions

Description

Similarly as we've done previously for Add a Link in T286816, we're interested in understanding the effect of Add an Image. In the experiment the treatment group (40% of new registrations) got Add an Image as their default task. Another 40% of registrations got Add a Link, while the remaining 20% were in the control group and did not get the Growth features.

Like we did for Add a Link, we'll focus on our KPIs:

  • Activation
  • Retention
  • Productivity
  • Revert rate

Additional parts might be added based on questions coming out of the leading indicators (T296364) or the funnel analyses (T300683 and T306845).

Related Objects
Search...

Event Timeline

nettrom_WMF created this task.Jun 28 2022, 4:39 PM
mpopov triaged this task as Medium priority.Jun 28 2022, 5:10 PM
mpopov moved this task from Triage to Upcoming Quarter on the Product-Analytics board.
kostajh moved this task from Inbox to Upcoming Work on the Growth-Team board.Jun 30 2022, 1:23 PM

Seems like this doesn't go into our current sprint, but @nettrom_WMF please move it if I'm wrong about that. Thanks!

nettrom_WMF moved this task from Upcoming Quarter to Current Quarter on the Product-Analytics board.Jul 6 2022, 3:37 PM
CBogen moved this task from To Do to Growth: Add an Image on the Image-Suggestions board.Jul 7 2022, 6:36 PM
nettrom_WMF moved this task from Current Quarter to Upcoming Quarter on the Product-Analytics board.Jul 19 2022, 5:00 PM
nettrom_WMF moved this task from Upcoming Quarter to Current Quarter on the Product-Analytics board.Oct 4 2022, 8:00 AM
nettrom_WMF edited projects, added Product-Analytics (Kanban); removed Product-Analytics.Oct 10 2022, 4:26 PM

Moving this into the Product Analytics Kanban board as we'll be looking to start this soon.

nettrom_WMF edited projects, added Growth-Team (Sprint 0 (Growth Team)); removed Growth-Team.Oct 10 2022, 4:26 PM
nettrom_WMF moved this task from Incoming to Ready for Development on the Growth-Team (Sprint 0 (Growth Team)) board.
KStoller-WMF mentioned this in T322592: [EPIC] Deploy "add an image" to all Wikipedias.Nov 7 2022, 11:32 PM
KStoller-WMF mentioned this in T323686: End imagerecommendation experiment.Nov 24 2022, 11:39 PM
nettrom_WMF edited projects, added Product-Analytics, Growth-Team; removed Growth-Team (Sprint 0 (Growth Team)), Product-Analytics (Kanban).Dec 13 2022, 6:07 PM

Moving this off the PA kanban and Growth sprint boards for now, we'll pick this up again in Q3.

nettrom_WMF moved this task from Current Quarter to Upcoming Quarter on the Product-Analytics board.Dec 13 2022, 6:07 PM
nettrom_WMF moved this task from Upcoming Quarter to Current Quarter on the Product-Analytics board.Jan 10 2023, 7:11 PM
KStoller-WMF added a subscriber: CBogen.Mar 15 2023, 11:41 PM

@CBogen - Just FYI, this task has been put on hold a few times due to higher priorities (Newcomer Pilot Experiment analysis, Positive Reinforcement analysis, etc.) but please let me know if there is a deadline (or specific data needed) for SDAW reporting reasons. Thanks!

CBogen added a comment.Mar 16 2023, 12:56 PM
In T311531#8700532, @KStoller-WMF wrote:

@CBogen - Just FYI, this task has been put on hold a few times due to higher priorities (Newcomer Pilot Experiment analysis, Positive Reinforcement analysis, etc.) but please let me know if there is a deadline (or specific data needed) for SDAW reporting reasons. Thanks!

@KStoller-WMF, thanks for asking! This information would be really helpful for reporting for SDAW. Do you think we could have it by August 1st so that we can include it in the grant report due on Sept 1?

KStoller-WMF set Due Date to Aug 1 2023, 7:00 AM.Mar 16 2023, 6:09 PM
KStoller-WMF mentioned this in T332344: Section-Level Images: leading indicators.Mar 16 2023, 6:30 PM
KStoller-WMF mentioned this in T329276: Section-level images: create experiment variant and related tooling for opting in/out.May 8 2023, 6:56 PM
KStoller-WMF removed Due Date.Sep 7 2023, 9:53 PM
DannyS712 moved this task from Upcoming Work to Inbox on the Growth-Team board.Oct 24 2023, 2:46 AM
DannyS712 subscribed.

Move out of hidden column

KStoller-WMF moved this task from Inbox to Backlog on the Growth-Team board.Oct 25 2023, 6:38 PM
KStoller-WMF moved this task from Backlog to Up Next on the Growth-Team board.Dec 12 2023, 4:36 AM
nettrom_WMF edited projects, added Product-Analytics (Kanban), Growth-Team (Sprint 5 (Growth Team)); removed Growth-Team, Product-Analytics.Dec 12 2023, 8:00 PM
KStoller-WMF edited projects, added Growth-Team (Sprint 6 (Growth Team)); removed Growth-Team (Sprint 5 (Growth Team)), Product-Analytics (Kanban), Image-Suggestions, Growth-Structured-Tasks.Jan 9 2024, 5:40 PM
Urbanecm_WMF added projects: Product-Analytics (Kanban), Image-Suggestions, Growth-Structured-Tasks.Jan 10 2024, 3:01 PM
nettrom_WMF moved this task from Next 2 weeks to Doing on the Product-Analytics (Kanban) board.Feb 5 2024, 7:17 PM
KStoller-WMF edited projects, added Growth-Team (Sprint 7 (Growth Team)); removed Growth-Team (Sprint 6 (Growth Team)).Feb 6 2024, 12:47 AM
KStoller-WMF moved this task from Incoming to Doing on the Growth-Team (Sprint 7 (Growth Team)) board.Feb 8 2024, 12:13 AM
KStoller-WMF edited projects, added Growth-Team (Sprint 8 (Growth Team)); removed Growth-Team (Sprint 7 (Growth Team)).Feb 19 2024, 11:54 PM
KStoller-WMF moved this task from Incoming to Doing on the Growth-Team (Sprint 8 (Growth Team)) board.Feb 20 2024, 4:01 PM
KStoller-WMF edited projects, added Growth-Team (Sprint 9 (Growth Team)); removed Growth-Team (Sprint 8 (Growth Team)).Mar 5 2024, 4:20 PM
nettrom_WMF moved this task from Incoming to Doing on the Growth-Team (Sprint 9 (Growth Team)) board.Mar 5 2024, 10:04 PM
KStoller-WMF added a comment.Mar 9 2024, 12:28 AM

Just a note that we can consider this resolved once we add a summary here:
https://www.mediawiki.org/wiki/Growth/Personalized_first_day/Structured_tasks/Add_an_image

@nettrom_WMF let me know if you prefer I write up the summary. Thanks!

KStoller-WMF edited projects, added Growth-Team (Sprint 10 (Growth Team)); removed Growth-Team (Sprint 9 (Growth Team)).Mar 19 2024, 2:47 PM
KStoller-WMF moved this task from Incoming to Doing on the Growth-Team (Sprint 10 (Growth Team)) board.
KStoller-WMF moved this task from Sprint 10 (Growth Team) to Sprint 11 (Growth Team) on the Growth-Team board.Apr 2 2024, 4:46 PM
KStoller-WMF edited projects, added Growth-Team (Sprint 11 (Growth Team)); removed Growth-Team (Sprint 10 (Growth Team)).
KStoller-WMF moved this task from Incoming to Doing on the Growth-Team (Sprint 11 (Growth Team)) board.
nettrom_WMF added a comment.Apr 15 2024, 3:11 PM

The report from the analysis is now on-wiki: https://www.mediawiki.org/wiki/Growth/Personalized_first_day/Structured_tasks/Add_an_image/Experiment_analysis,_March_2024

I'll wrap up this task by reviewing the related notebooks and push them to GitLab.

KStoller-WMF moved this task from Sprint 11 (Growth Team) to Sprint 12 (Growth Team) on the Growth-Team board.Apr 16 2024, 4:37 PM
KStoller-WMF edited projects, added Growth-Team (Sprint 12 (Growth Team)); removed Growth-Team (Sprint 11 (Growth Team)).
KStoller-WMF edited projects, added Growth-Team (Sprint 13 (Growth Team)); removed Growth-Team (Sprint 12 (Growth Team)).Apr 30 2024, 5:31 PM
nettrom_WMF closed this task as Resolved.Mon, May 13, 9:12 PM

I've reviewed the notebooks so they're in line with the Data Publication guidelines and submitted the publication form. The notebooks are now available on GitLab: https://gitlab.wikimedia.org/nettrom/2021-Growth-structured-tasks

Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL