@EdErhart-WMF -- before we start this analysis, could you please add a comment with this information:

• The exact dates of the campaign.
• The exact dates of when any of the treatment/control ratios were changed, or if the campaign ramped up or down over time.

And could you look over the task description and note whether there is anything you think we need that you don’t see? Thank you!

Hey folks,

The campaign ran from 3 May to 31 May. I'm not sure of the exact times on those days where things were switched on/off.

I believe we changed the ratio from 90/10 treatment/control to 70/30 on 18 May, which I'll confirm ASAP, but the rest remained consistent.

This is ready for @nettrom_WMF to work on.

The first pass off this analysis is now complete. We've gathered data from the Spanish Wikipedia from May 3–31 for the two campaigns social-latam-2022-A and social-latam-2022-B. In this analysis we focus on actions taken on the mobile platform. For more details about the data gathering methodology and why desktop platform actions are disregarded, see the notes below.

We get the following table of data from the mobile platform for these two campaigns:

The difference in registration rate between the campaigns is not significant (X^2 = 3.358, df = 1, p = 0.067). The number of constructive activations is too low to draw any conclusions about a difference in activation rate, and so we're not even going to try.

Methodological notes:

• For views of the Special:CreateAccount page (Spanish: Especial:Crear una cuenta) we limit the data to views with agent_type = "user". Or in other words, we disregard all views labelled as "spider" in the webrequest dataset.
• We have some views and registrations on the desktop platform in the dataset, but these are a fraction of the mobile traffic and result in too few registrations to draw any meaningful conclusions. Given the low volume of traffic they do not make an impact on the conclusions drawn from analyzing only the mobile platform. It's because of these reasons that we choose to disregard the desktop platform in the analysis.
• Account registrations are identified using the ServerSideAccountCreation schema for registrations done through the campaign, with known test accounts, autocreated accounts, and API accounts (which are typically app accounts) removed.
• We verify account registration timestamps using MediaWiki's database and restrict the analysis to accounts registered while the campaign was running.
• Constructive activation is defined as having made at least one edit within 24 hours of registration, with that edit not getting reverted within 48 hours of being made.