Maniphest T409739

ImageBrowsing: launch the A/B test on English Wikipedia
Closed, ResolvedPublic2 Estimated Story Points
Actions

Description

Launch A/B test for image browsing on English Wikipedia on Monday, November 17

Before launch

Ensure green light from @JScherer-WMF
Ensure green light from @EBlackorby-WMF, @SherryYang-WMF, and @ovasileva
Check patches merged after Mon Nov 10 that need to be backported & backport

Acceptance criteria

Configure a new experiment on MPIC - https://mpic.wikimedia.org/experiment/image-browsing-enwiki

NOTE: configure & turn on at least 24 hours before the start date, see docs

Add the experiment name in ReaderExperiments here and here
Add the experiment name in WikimediaEvents here
Turn on the experiment

Steps to relaunch/Rollback plan

Same as T408105: ImageBrowsing: launch the A/B test on first set of wikis.

Details

Related Changes in Gerrit:

Subject	Author	Repo	Branch	Lines +/-
xLab: add tier 2 experiment to ImageBrowsing	Marco Fossati	mediawiki/extensions/WikimediaEvents	wmf/1.46.0-wmf.2	+15 -5
ImageBrowsing: add tier 2 experiment	Marco Fossati	mediawiki/extensions/ReaderExperiments	wmf/1.46.0-wmf.2	+54 -23
xLab: add tier 2 experiment to ImageBrowsing	Marco Fossati	mediawiki/extensions/WikimediaEvents	master	+15 -5
ImageBrowsing: add tier 2 experiment	Marco Fossati	mediawiki/extensions/ReaderExperiments	master	+54 -23

Customize query in gerrit

Related Objects

Mentioned Here: T408105: ImageBrowsing: launch the A/B test on first set of wikis

Event Timeline

ovasileva created this task.Nov 10 2025, 3:08 PM

Restricted Application added a subscriber: Aklapper. · View Herald TranscriptNov 10 2025, 3:08 PM

ovasileva triaged this task as High priority.Nov 10 2025, 3:09 PM

ovasileva moved this task from Incoming/Inbox to Needs Refinement on the Reader Growth Team board.

mfossati updated the task description. (Show Details)Nov 12 2025, 11:04 AM

mfossati changed the task status from Open to In Progress.Nov 12 2025, 11:10 AM

mfossati claimed this task.

mfossati updated the task description. (Show Details)

HSwan-WMF set the point value for this task to 2.Nov 12 2025, 5:13 PM

HSwan-WMF moved this task from Needs Refinement to Sprint 4 (Nov 12 - Nov 25) Q2 25/26) on the Reader Growth Team board.

HSwan-WMF edited projects, added: Reader Growth Team (Sprint 4 (Nov 12 - Nov 25) Q2 25/26)); removed: Reader Growth Team.

mfossati moved this task from Committed to Doing on the Reader Growth Team (Sprint 4 (Nov 12 - Nov 25) Q2 25/26)) board.Nov 12 2025, 5:18 PM

Change #1204653 had a related patch set uploaded (by Marco Fossati; author: Marco Fossati):

[mediawiki/extensions/ReaderExperiments@master] ImageBrowsing: add tier 2 experiment

https://gerrit.wikimedia.org/r/1204653

gerritbot added a project: Patch-For-Review.Nov 12 2025, 7:10 PM

Change #1204659 had a related patch set uploaded (by Marco Fossati; author: Marco Fossati):

[mediawiki/extensions/WikimediaEvents@master] xLab: add tier 2 experiment to ImageBrowsing

https://gerrit.wikimedia.org/r/1204659

Change #1204653 merged by jenkins-bot:

[mediawiki/extensions/ReaderExperiments@master] ImageBrowsing: add tier 2 experiment

https://gerrit.wikimedia.org/r/1204653

ReleaseTaggerBot added a project: MW-1.46-notes (1.46.0-wmf.3; 2025-11-19).Nov 12 2025, 8:00 PM

Change #1204659 merged by jenkins-bot:

[mediawiki/extensions/WikimediaEvents@master] xLab: add tier 2 experiment to ImageBrowsing

https://gerrit.wikimedia.org/r/1204659

Maintenance_bot removed a project: Patch-For-Review.Nov 12 2025, 8:30 PM

Change #1204821 had a related patch set uploaded (by Marco Fossati; author: Marco Fossati):

[mediawiki/extensions/ReaderExperiments@wmf/1.46.0-wmf.2] ImageBrowsing: add tier 2 experiment

https://gerrit.wikimedia.org/r/1204821

Change #1204822 had a related patch set uploaded (by Marco Fossati; author: Marco Fossati):

[mediawiki/extensions/WikimediaEvents@wmf/1.46.0-wmf.2] xLab: add tier 2 experiment to ImageBrowsing

https://gerrit.wikimedia.org/r/1204822

Change #1204821 merged by jenkins-bot:

[mediawiki/extensions/ReaderExperiments@wmf/1.46.0-wmf.2] ImageBrowsing: add tier 2 experiment

https://gerrit.wikimedia.org/r/1204821

Change #1204822 merged by jenkins-bot:

[mediawiki/extensions/WikimediaEvents@wmf/1.46.0-wmf.2] xLab: add tier 2 experiment to ImageBrowsing

https://gerrit.wikimedia.org/r/1204822

Mentioned in SAL (#wikimedia-operations) [2025-11-13T14:17:27Z] <mfossati@deploy2002> Started scap sync-world: Backport for [[gerrit:1204821|ImageBrowsing: add tier 2 experiment (T409739)]], [[gerrit:1204822|xLab: add tier 2 experiment to ImageBrowsing (T409739)]]

Mentioned in SAL (#wikimedia-operations) [2025-11-13T14:19:53Z] <mfossati@deploy2002> mfossati: Backport for [[gerrit:1204821|ImageBrowsing: add tier 2 experiment (T409739)]], [[gerrit:1204822|xLab: add tier 2 experiment to ImageBrowsing (T409739)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there.

Maintenance_bot removed a project: Patch-For-Review.Nov 13 2025, 2:31 PM

Mentioned in SAL (#wikimedia-operations) [2025-11-13T14:33:37Z] <mfossati@deploy2002> Finished scap sync-world: Backport for [[gerrit:1204821|ImageBrowsing: add tier 2 experiment (T409739)]], [[gerrit:1204822|xLab: add tier 2 experiment to ImageBrowsing (T409739)]] (duration: 16m 11s)

ReleaseTaggerBot edited projects, added: MW-1.46-notes (1.46.0-wmf.2; 2025-11-12); removed: MW-1.46-notes (1.46.0-wmf.3; 2025-11-19).Nov 13 2025, 3:00 PM

mfossati updated the task description. (Show Details)Nov 13 2025, 4:46 PM

mfossati updated the task description. (Show Details)Nov 13 2025, 6:08 PM

Moving to QA: the experiment will start on November 17. I'll let it settle in a little bit, then double-check that Kafka events are being produced correctly.

The experiment has started, events are flowing in: kafkacat -C -b kafka-jumbo1016.eqiad.wmnet:9092 -t eqiad.mediawiki.product_metrics.readerexperiments_imagebrowsing -o -1000 | jq 'select(.experiment.enrolled == "image-browsing-enwiki")'

Aklapper added projects: MediaWiki-extensions-WikimediaEvents, ReaderExperiments.Nov 18 2025, 9:07 PM

Kafka events QA

I've checked a sample of the most recent 10M events via kafkacat -C -b kafka-jumbo1016.eqiad.wmnet:9092 -t eqiad.mediawiki.product_metrics.readerexperiments_imagebrowsing -o -10000000 -e | jq -c 'select(.experiment.enrolled == "image-browsing-enwiki")' > tier2_imagebrowsing_10M_sample.jsonl:

action='image_carousel_load' action_source='init' ✅
action='image_carousel_load' action_source='close' ✅
action='click' action_subtype='view_image' action_source='image_carousel action_context='image1' ✅
action='click' action_subtype='view_image' action_source='image_carousel' ✅
action='click' action_subtype='view_image' action_source='visual_table_of_contents' ✅
action='click' action_subtype='full_image' action_source='detail_view' ✅
action='click' action_subtype='share' action_source='detail_view' ✅
action='click' action_subtype='commons' action_source='detail_view' ✅
action='click' action_subtype='download' action_source='detail_view' ✅
action='click' action_subtype='more' action_source='detail_view' ✅
action='click' action_subtype='view_in_article' action_source='visual_table_of_contents' ✅
action='click' action_subtype='caption_link' action_source='detail_view' ✅
action='click' action_subtype='caption_link' action_source='visual_table_of_contents' ✅
action='page-visited ✅

All Kafka events look good!

mfossati closed this task as Resolved.Nov 24 2025, 10:40 AM

matthiasmullie added a project: ReaderExperiments-ImageBrowsing.Jan 6 2026, 1:24 PM

Restricted Application edited projects, added: Reader Growth Team; removed: Reader Growth Team (Sprint 4 (Nov 12 - Nov 25) Q2 25/26)). · View Herald TranscriptJan 6 2026, 1:24 PM

Aklapper edited projects, added: Reader Growth Team (Sprint 4 (Nov 12 - Nov 25) Q2 25/26)); removed: Reader Growth Team.Jan 6 2026, 1:57 PM

ImageBrowsing: launch the A/B test on English WikipediaClosed, ResolvedPublic2 Estimated Story PointsActions