Page MenuHomePhabricator

Something going on with Banner Status Codes in Brazil campaign?
Open, MediumPublic

Description

Hey colleagues, could someone check out this Banner Status Code issue I'm seeing in Brazil? I'll cc @Pcoombe but I can't tell if this is a banner code thing or deeper in CentralNotice.

Our Brazil banner campaign started Tuesday, March 19 @ 16 UTC. In looking at data so far, I notice that we've logged a suspiciously high number of Banner Status Code 2.1, banner_canceled due to close, described here:

On a previous pageview within a specified time period, the user clicked on the close button of a banner in a campaign with the same category, as indicated by a cookie in the user's browser.

Here's my Turnilo link: Of 11.9 million banner requests so far, 1.7 million of them were code 2.1!

I added in a split by banner and campaign to try to find one obvious issue (Turnilo link #2), and they all appear to be coming from our English Brazil campaigns (C2324_enBR_m_FR and C2324_enBR_dsk_FR), but have a Banner value of null.

Insight would be appreciated!

Event Timeline

I've looked at Turnilo a bit more and there definitely seems to be something strange going on. For the English Brazil campaigns only the number of Close statuses (code 2.1) is even higher than the number of banner_shown statuses (6). This is also right from the start of the campaign.

For Portuguese Brazil campaigns on the other hand there only seem to be banner_shown statuses

Not seeing anything obviously wrong with the campaigns/banners setup

AKanji-WMF triaged this task as Medium priority.Mar 25 2024, 8:02 PM
AKanji-WMF moved this task from Triage to DRI Backlog on the Fundraising-Backlog board.

Hey @Cstone, thanks for working on this; we are definitely observing a year over year drop in impression counts in our Brazil campaign. I don't *think* that has much to do directly with this status code issue, it'd just be great to rule out that this status code issue is inadvertently blocking valid banners.

The time sensitivity here is that we're only due to be live in Brazil for a few more weeks, so if we want to make any adjustment, would be good to surface that soon. LMK if we can help!

@spatton what is the amount of 2.1s you do expect to see?