Page MenuHomePhabricator

Setup tracking for CentralNotice banners experiment for WE2.1.1
Closed, ResolvedPublic4 Estimated Story Points

Description

WE 2.1.1 for FY25-26: If we invite native speakers of small wikis through a CentralNotice banner on a high-traffic Wikipedia in their region to contribute to SuggestedEdits and other Growth features, we can assess whether this approach attracts new native speakers and if they use these editing tools to improve vital content.

From @srishakatux

  • the experiment will target both logged-in and logged-out users.
  • CN banner will lead them to the Newcomer homepage.
  • If they are not logged in, they'll be directed to the login page.
  • If they have an account and are logged in, they'll land directly on the Newcomer homepage.
  • If they don't have an account they will redirected to create an account

and then ... other steps will continue

We need to setup following data trackings:

  1. We need to track who created the account using the banners:
  1. We need to track the clicks on the banners:
    • Add provenance parameter wprov to banner URLs.
    • Documentation about wprov https://wikitech.wikimedia.org/wiki/Provenance
    • the parameters can be followings or something similar
      • cbeer - CentralNotice banner experiment event registration
      • cbeca - CentralNotice banner experiment create account
      • cbent - CentralNotice banner experiment newcomer tool
  1. We need to track who lands on Newcomer Homepage and use the growth feature:
    • This could be done in referer_route field in event.homepagevisit stream
    • It can be fy25-we211-banner1 for scenario A and fy25-we211-banner2 for scenario B. Or something similar.

Related Objects

Event Timeline

Nikerabbit raised the priority of this task from Medium to High.Jul 10 2025, 6:43 AM
Nikerabbit edited projects, added: LPL Essential (2025 Jul-Oct); removed: LPL Hypothesis.

Just to make sure you are aware of this: https://meta.wikimedia.org/wiki/CentralNotice/Usage_guidelines have been updated half a year ago by CN Admins & WMF, not only requiring community approval even for most WMF CN campaigns but also setting landing page requirements – I don't think redirecting to the login / registration page fulfills the landing page requirements.

@Johannnes89 Hi! Thanks for flagging this. To clarify, this experiment aims to target both registered and non-registered users. Planned iterations in upcoming quarters include additional features, such as using Event Registration as a landing page for the call to action and integrating Content Translation, if the experiment proves successful. In the first stage, we want to test whether the banner helps attract new contributors from big wikis to small wikis and whether new users interact with the banner. I have added this information to the request as well.

Would linking to the Newcomer homepage for now meet the landing page requirement, or would we need to set up a more targeted landing page even for the first iteration?

@Johannnes89 We have made slight changes to the plan and request here. Considering your feedback into account and more discussions with team, we now plan to use Event Registration feature (available via CampaignEvents) as a landing page for the call to action in the Central Notice banner for ~5 wikis and Newcomer homepage (available via GrowthExperiments) for remaining ~5 wikis. This will help us compare the results of the two call-to-action approaches. Will this satisfy the CN requirements?

@Johannnes89 We have made slight changes to the plan and request here. Considering your feedback into account and more discussions with team, we now plan to use Event Registration feature (available via CampaignEvents) as a landing page for the call to action in the Central Notice banner for ~5 wikis and Newcomer homepage (available via GrowthExperiments) for remaining ~5 wikis. This will help us compare the results of the two call-to-action approaches. Will this satisfy the CN requirements?

Thanks! Event Registration is always fine. I can live with comparing it to Special:Homepage for registered users.
I don't think using Special.Hompage as a "landing page" for unregistered users (who are then redirected to Special:UserLogin) is a good idea -> no explanation why ther'e suddenly asked to log in given they've been able to read (and edit?) without an account until they clicked on the banner + they need to figure out themselves to use the "join wikipedia" button to create an account if they don't have one. But I don't want to just impose my opinion, I'm curious what other CN admins like @Ciell or @DerHexer think (let's probably continue this onwiki)?

I agree with Johannnes89. That doesn't seem to be a landing page that is valid per the CentralNotice usage guidelines. — What about adding a temporary section to the landing page where more information about the process and call to action (if technically feasible)?

Looking at the example banners that are shared in the CN request on meta, some of the examples explicitly state 'sign up for an account' and 'create your account', while the others say 'enter newcomer tool' and 'get started'. As long as the former banners would target the anons, I don't see a problem with the anon being directed to go through Special:UserLogin before entering the experiment (the wording proposed for the banner is imho clear enough).

@Ciell @DerHexer @Johannnes89 Thanks all for your comments! I have added a comment in response to your suggestion here https://meta.wikimedia.org/wiki/CentralNotice/Request/WMF_Language_Onboarding_and_Development_Experiment#Discussion. Let's continue the discussion on the wiki page. Thanks!

Nikerabbit set the point value for this task to 4.Jul 28 2025, 8:39 AM

@Nikerabbit @abi_ I've added the banner variations that will be used for the experiment in T391045#11071277, including a link to the editable source of the banner on Meta-Wiki, information on the wikis involved in the experiment, and the message and call to action/links that will be displayed on six wikis. Is this information sufficient to proceed for setting up tracking? In some cases, we don't have the links yet, especially for the event registration CTA, as communities will be creating them in the coming weeks. @cchen, do you have anything to add? cc @UOzurumba

cchen renamed this task from Setup tracking for users who create accounts through CentralNotice banners for WE2.1.1 to Setup tracking for CentralNotice banners experiment for WE2.1.1.Aug 11 2025, 10:21 PM
cchen updated the task description. (Show Details)
hueitan moved this task from Incoming to In progress on the LPL Analytics board.
hueitan moved this task from In progress to Incoming on the LPL Analytics board.
hueitan moved this task from Ready for dev to In Progress on the LPL Essential (2025 Jul-Oct) board.

Thanks @srishakatux, the link T391045#11071277 is important, and every single case will have different wprov and link given, here're the scenarios we know so far

Scenario 1 / Banner A: T402496: Tracking code for Scenarios 1 for WE2.1.1
Scenario 2 / Banner B: T402497: Tracking code for Scenarios 2 for WE2.1.1
Scenario 3 / Banner C: T402498: Tracking code for Scenarios 3 for WE2.1.1

we don't have the links yet, especially for the event registration CTA, as communities will be creating them in the coming weeks.

Please do update us when the link is ready so that we know where to insert the link for tracking.

hueitan changed the task status from Open to In Progress.Sep 1 2025, 8:43 AM
hueitan changed the status of subtask T402497: Tracking code for Scenarios 2 for WE2.1.1 from Open to In Progress.
hueitan changed the status of subtask T402498: Tracking code for Scenarios 3 for WE2.1.1 from Open to In Progress.