Page MenuHomePhabricator

ImageBrowsing: launch the A/B test on first set of wikis
Closed, ResolvedPublic3 Estimated Story Points

Description

We agreed on the following steps to launch the ImageBrowsing A/B test.

Before launch

Acceptance criteria

Steps to relaunch (AKA rollback plan)

  • configure a new experiment on MPIC
NOTE: configure & turn on at least 24 hours before the start date, see docs
  • update the experiment name in ReaderExperiments here and here
  • update the experiment name in WikimediaEvents here

References

Event Timeline

ovasileva updated the task description. (Show Details)
ovasileva added subscribers: EBlackorby-WMF, ovasileva.
egardner set the point value for this task to 3.Oct 23 2025, 4:59 PM
egardner moved this task from Needs Refinement to Ready on the Reader Growth Team board.
ovasileva renamed this task from ImageBrowsing: launch the A/B test to ImageBrowsing: launch the A/B test on first set of wikis.Oct 27 2025, 8:00 AM
mfossati changed the task status from Open to In Progress.Oct 29 2025, 3:43 PM

The train was blocked until yesterday and is now unblocked, see T405681: 1.45.0-wmf.25 deployment blockers.
I’ve verified the backported patches in production as per ticket's description and they all look good.

Kafka events QA

I've checked a sample of the most recent 100k events via kafkacat -C -b kafka-jumbo1016.eqiad.wmnet:9092 -t eqiad.mediawiki.product_metrics.readerexperiments_imagebrowsing -o -100000 -e:

  • action='image_carousel_load' action_source='init' ✅
  • action='image_carousel_load' action_source='close' ✅
  • action='click' action_subtype='view_image' action_source='image_carousel action_context='image1' ✅
  • action='click' action_subtype='view_image' action_source='image_carousel' ✅
  • action='click' action_subtype='view_image' action_source='visual_table_of_contents' ✅
  • action='click' action_subtype='full_image' action_source='detail_view' ✅
  • action='click' action_subtype='share' action_source='detail_view' ✅
  • action='click' action_subtype='commons' action_source='detail_view' ✅
  • action='click' action_subtype='download' action_source='detail_view' ✅
  • action='click' action_subtype='more' action_source='detail_view' ✅
  • action='click' action_subtype='view_in_article' action_source='visual_table_of_contents' ✅
  • action='click' action_subtype='caption_link' action_source='detail_view' ✅
  • action='click' action_subtype='caption_link' action_source='visual_table_of_contents' ✅
  • action='page-visited ✅

Everything looks good to me, we can sign this off as soon as T408104 & T406013 are done.

I'm gonna close this one, as engineering work is done. If anything comes up with T406013: Configure analytics dashboards for ImageBrowsing's A/B test, I'll file a new ticket.