Page MenuHomePhabricator
Create Task
Maniphest T291285

Double-check language switching instrumentation
Closed, ResolvedPublic5 Estimated Story Points
Actions

Assigned To
ovasileva
Authored By
ovasileva
Sep 17 2021, 5:32 PM
Tags
Referenced Files
F34690569: Screen Shot 2021-10-15 at 4.04.32 PM.png
Oct 15 2021, 11:09 PM
F34679464: Screen Shot 2021-10-08 at 2.40.03 PM.png
Oct 8 2021, 9:43 PM
F34679548: Screen Shot 2021-10-08 at 3.28.34 PM.png
Oct 8 2021, 9:43 PM
F34679468: Screen Shot 2021-10-08 at 2.41.08 PM.png
Oct 8 2021, 9:43 PM
F34679534: Screen Shot 2021-10-08 at 3.14.03 PM.png
Oct 8 2021, 9:43 PM
Subscribers
Aklapper
cjming
Huji
Jdlrobson
jwang
ovasileva
phuedx
revi

Description

Background

In parallel to beginning to iterate on the language button based on the results from T289200: Analyze behavior change on logged-out users before/after turn-on new language switch, we would also like to double-check our instrumentation to confirm that events are being logged as expected

Acceptance criteria

  • Review language instrument and ensure events are logged correctly for both clicks to the sidebar as well as the new language button
  • Review SQL queries and check the expectations around the things they are testing match the code

Details

SubjectRepoBranchLines +/-
Update ULS compact language link log trigger idmediawiki/extensions/WikimediaEventsmaster+2 -2
Customize query in gerrit

Related Objects
Search...

Event Timeline

ovasileva triaged this task as High priority.Sep 17 2021, 5:32 PM
ovasileva created this task.
ovasileva added a subscriber: phuedx.Sep 17 2021, 5:35 PM
LGoto assigned this task to cjming.Sep 20 2021, 5:38 PM
Jdlrobson removed cjming as the assignee of this task.Sep 20 2021, 5:38 PM
Jdlrobson updated the task description. (Show Details)
Jdlrobson moved this task from Needs Analysis to Upcoming on the Web-Team-Backlog (Kanbanana-FY-2021-22) board.
Jdlrobson added a subscriber: cjming.
jwang added a comment.Sep 21 2021, 12:28 AM

@Jdlrobson here are the queries I used to pull data. Please review whether the queries matches with the schema code. If there is any mismatch, we can schedule a meeting next week to discuss if your time allowed.

Query for clicks on language links after clicking new button

query_language_clicks_new <- 
"
-- sessions where new lang button was selected
WITH new_button AS (
SELECT
    MIN(TO_DATE(dt)) as button_date,
    event.web_session_id as session_id,
    event.context as open_context,
    wiki as wiki
FROM event.universallanguageselector
WHERE
    year = 2021 and month in (6,7,8) 
    AND (CONCAT(year,LPAD(month,2,'0'),LPAD(day,2,'0')) between '20210622' and '20210831')
    AND wiki in ('frwiktionary', 'hewiki', 'ptwikiversity', 'frwiki', 
    'euwiki', 'fawiki', 'ptwiki', 'kowiki', 'trwiki', 'srwiki', 'bnwiki', 'dewikivoyage', 'vecwiki')
    AND useragent.is_bot = false
-- only anonymous users
    AND event.isanon = true
    AND event.action = 'compact-language-links-open'
    AND event.context = 'header'
    AND event.skinVersion = 'latest'
GROUP BY 
    event.web_session_id,
    event.context,
    event.isanon,
    wiki
),

lang_switches AS (
  SELECT
    TO_DATE(dt) as switch_date,
    event.web_session_id as session_id,
    event.context as switch_context,
    wiki as wiki
FROM event.universallanguageselector
WHERE
    year = 2021 and month in (6,7,8) 
    AND (CONCAT(year,LPAD(month,2,'0'),LPAD(day,2,'0')) between '20210622' and '20210831')
    AND wiki in ('frwiktionary', 'hewiki', 'ptwikiversity', 'frwiki', 
    'euwiki', 'fawiki', 'ptwiki', 'kowiki', 'trwiki', 'srwiki', 'bnwiki', 'dewikivoyage', 'vecwiki')
    AND useragent.is_bot = false
-- only anonymous users
    AND event.isanon =true
    AND event.action = 'language-change'
    AND event.context='content-language-switcher'
    AND event.skinVersion = 'latest'
)

SELECT
    new_button.button_date,
    lang_switches.switch_date,
    new_button.session_id,
    new_button.wiki,
    new_button.open_context,
-- sessions with lang switch that occured after button clicks
    IF(lang_switches.session_id IS NOT NULL AND switch_date >= button_date, 1, 0) AS language_switch,
    lang_switches.switch_context
FROM new_button
LEFT JOIN lang_switches ON
    new_button.session_id = lang_switches.session_id AND
    new_button.wiki = lang_switches.wiki 
"

Query for clicks on language links on the sidebar.

query_old_language_link <- 
"
SELECT
    TO_DATE(dt) AS `date`,
    wiki,
    event.web_session_id,
    event.usereditbucket,
    event.timetochangelanguage,
    event.interfacelanguage,
    event.contentlanguage,
    event.selectedinterfacelanguage,
    Count(*) AS n_events
FROM event.universallanguageselector
WHERE
    year = 2021 and month in (6,7,8) 
    AND (CONCAT(year,LPAD(month,2,'0'),LPAD(day,2,'0')) between '20210601' and '20210628')
    AND event.context = 'languages-list' and event.action = 'language-change' 
    AND event.skinVersion = 'latest' 
    AND wiki in ('frwiktionary', 'hewiki', 'ptwikiversity', 'frwiki', 
    'euwiki', 'fawiki', 'ptwiki', 'kowiki', 'trwiki', 'srwiki', 'bnwiki', 'dewikivoyage', 'vecwiki')
    AND useragent.is_bot = false 
-- only anonymous users
    AND event.isanon =true
GROUP BY
    TO_DATE(dt),
    wiki,
    event.web_session_id,
    event.usereditbucket,
    event.timetochangelanguage,
    event.interfacelanguage,
    event.contentlanguage,
    event.selectedinterfacelanguage
"

Query for clicks on language links after N-More window shows

query_n_more_lang_switch <- 
"
-- sessions where N-more lang button was selected
WITH button AS (
SELECT
    MIN(TO_DATE(dt)) as button_date,
    event.web_session_id as session_id,
    event.context as open_context,
    wiki as wiki
FROM event.universallanguageselector
WHERE
    year = 2021 and month in (6,7,8) 
    AND (CONCAT(year,LPAD(month,2,'0'),LPAD(day,2,'0')) between '20210601' and '20210628')
    AND wiki in ('frwiktionary', 'hewiki', 'ptwikiversity', 'frwiki', 
    'euwiki', 'fawiki', 'ptwiki', 'kowiki', 'trwiki', 'srwiki', 'bnwiki', 'dewikivoyage', 'vecwiki')
    AND useragent.is_bot = false
-- only anonymous users
    AND event.isanon =true
    AND event.action = 'compact-language-links-open'
    AND event.context = 'other'
    AND event.skinVersion = 'latest'
GROUP BY 
    event.web_session_id,
    event.context,
    wiki
),

lang_switches AS (
  SELECT
    TO_DATE(dt) as switch_date,
    event.web_session_id as session_id,
    event.isanon,
    event.context as switch_context,
    wiki as wiki
FROM event.universallanguageselector
WHERE
    year = 2021 and month in (6,7,8) 
    AND (CONCAT(year,LPAD(month,2,'0'),LPAD(day,2,'0')) between '20210601' and '20210628')
    AND wiki in ('frwiktionary', 'hewiki', 'ptwikiversity', 'frwiki', 
    'euwiki', 'fawiki', 'ptwiki', 'kowiki', 'trwiki', 'srwiki', 'bnwiki', 'dewikivoyage', 'vecwiki')
    AND useragent.is_bot = false
-- only anonymous users
    AND event.isanon =true
    AND event.action = 'language-change'
    AND event.context='content-language-switcher'
    AND event.skinVersion = 'latest'
)

SELECT
    button.button_date,
    lang_switches.switch_date,
    button.session_id,
    button.wiki,
    button.open_context,
-- sessions with lang switch that occured after button clicks
    IF(lang_switches.session_id IS NOT NULL AND switch_date >= button_date , 1, 0) AS language_switch,
    lang_switches.switch_context
FROM button
LEFT JOIN lang_switches ON
    button.session_id = lang_switches.session_id AND
    button.wiki = lang_switches.wiki
"
LGoto moved this task from Incoming to Language Switching on the Desktop Improvements (Vector 2022) board.Sep 21 2021, 5:27 PM
LGoto set the point value for this task to 5.Sep 21 2021, 5:33 PM
LGoto moved this task from Upcoming to Ready for Development on the Web-Team-Backlog (Kanbanana-FY-2021-22) board.
Aklapper renamed this task from Double-check language switching intrumentation to Double-check language switching instrumentation.Sep 28 2021, 4:28 PM
cjming claimed this task.Sep 30 2021, 1:51 AM
cjming moved this task from Ready for Development to Doing on the Web-Team-Backlog (Kanbanana-FY-2021-22) board.
cjming added a comment.Oct 7 2021, 11:13 PM

Posted below are the event stream logs from my local eventlogging server to see what event data is captured for logged-in (even/odd user ids) and anonymous users clicking on either the language button in the header or a language link in the sidebar.

Missing data is due to running things locally (i.e. selectedInterfaceLanguage). I followed the QA steps in T280825.

Some observations between @jwang's queries and the event log json I'm seeing locally:

  • 1st query query_language_clicks_new:
    • In the case of the language button in header (when event.action = 'compact-language-links-open'), event.context is logged as "other" while in the query event.context = 'header'.
      • Does the new_button query need to be updated with the condition AND event.context = 'other'? Fwiw, button in query_n_more_lang_switch looks correct.
    • lang_switches select lgtm
  • 2nd query query_old_language_link seems accurate.
  • 3rd query query_n_more_lang_switch seems good too.

I'll keep digging but this is what I've encountered so far.

Logged in, even user id, clicked language in header button (default)
event: {
  "event": {
    "version": 3,
    "token": "",
    "contentLanguage": "en",
    "interfaceLanguage": "en",
    "web_session_id": "5e8644cdbfa039eda26f",
    "isAnon": false,
    "skin": "vector",
    "skinVersion": "latest",
    "action": "compact-language-links-open",
    "context": "other",
    "userEditBucket": "0 edits"
  },
  "schema": "UniversalLanguageSelector",
  "webHost": "localhost",
  "wiki": "my_wiki",
  "$schema": "/analytics/legacy/universallanguageselector/1.4.0",
  "client_dt": "2021-10-07T19:34:07.313Z",
  "meta": {
    "stream": "eventlogging_UniversalLanguageSelector",
    "domain": "localhost",
    "id": "1381b4ef-4442-4a81-b984-540e4325b52c",
    "dt": "2021-10-07T19:34:08.589Z",
    "request_id": "8a318130-27a5-11ec-a93e-8936a01f4b42"
  },
  "dt": "2021-10-07T19:34:08.589Z",
  "http": {
    "request_headers": {
      "user-agent": "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/94.0.4606.54 Safari/537.36"
    }
  }
}
Logged in, even user id, clicked language in header button (default) and clicked language link (user preference set to use compact language list)
event: {
  "event": {
    "version": 3,
    "token": "",
    "contentLanguage": "en",
    "interfaceLanguage": "en",
    "web_session_id": "0560fbfbf12184203f65",
    "isAnon": false,
    "skin": "vector",
    "skinVersion": "latest",
    "action": "language-change",
    "context": "content-language-switcher",
    "selectedInterfaceLanguage": "mg",
    "timeToChangeLanguage": 24846.300048828125,
    "userEditBucket": "0 edits"
  },
  "schema": "UniversalLanguageSelector",
  "webHost": "localhost",
  "wiki": "my_wiki",
  "$schema": "/analytics/legacy/universallanguageselector/1.4.0",
  "client_dt": "2021-10-07T22:49:18.637Z",
  "meta": {
    "stream": "eventlogging_UniversalLanguageSelector",
    "domain": "localhost",
    "id": "1c1c5bcd-82dd-4272-a9e8-1d1ed4c825f4",
    "dt": "2021-10-07T22:49:19.035Z",
    "request_id": "ce5231a0-27c0-11ec-911c-8ff49b5ee1ee"
  },
  "dt": "2021-10-07T22:49:19.035Z",
  "http": {
    "request_headers": {
      "user-agent": "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/94.0.4606.54 Safari/537.36"
    }
  }
}
Logged in, even user id, clicked on language in sidebar (using query param ?languageinheader=0)
event: {
  "event": {
    "version": 3,
    "token": "",
    "contentLanguage": "en",
    "interfaceLanguage": "en",
    "web_session_id": "5e8644cdbfa039eda26f",
    "isAnon": false,
    "skin": "vector",
    "skinVersion": "latest",
    "action": "language-change",
    "context": "languages-list",
    "selectedInterfaceLanguage": "",
    "timeToChangeLanguage": 45491.10009765625,
    "userEditBucket": "0 edits"
  },
  "schema": "UniversalLanguageSelector",
  "webHost": "localhost",
  "wiki": "my_wiki",
  "$schema": "/analytics/legacy/universallanguageselector/1.4.0",
  "client_dt": "2021-10-07T19:36:35.740Z",
  "meta": {
    "stream": "eventlogging_UniversalLanguageSelector",
    "domain": "localhost",
    "id": "530aad71-a613-4805-bc2e-ffa6a53a26fa",
    "dt": "2021-10-07T19:36:36.749Z",
    "request_id": "e2a95cc0-27a5-11ec-a93e-8936a01f4b42"
  },
  "dt": "2021-10-07T19:36:36.749Z",
  "http": {
    "request_headers": {
      "user-agent": "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/94.0.4606.54 Safari/537.36"
    }
  }
}
Logged in, odd user id, clicked on language in header (using query param ?languageinheader=1)
event: {
  "event": {
    "version": 3,
    "token": "",
    "contentLanguage": "en",
    "interfaceLanguage": "en",
    "web_session_id": "5e8644cdbfa039eda26f",
    "isAnon": false,
    "skin": "vector",
    "skinVersion": "latest",
    "action": "compact-language-links-open",
    "context": "other",
    "userEditBucket": "0 edits"
  },
  "schema": "UniversalLanguageSelector",
  "webHost": "localhost",
  "wiki": "my_wiki",
  "$schema": "/analytics/legacy/universallanguageselector/1.4.0",
  "client_dt": "2021-10-07T20:37:02.959Z",
  "meta": {
    "stream": "eventlogging_UniversalLanguageSelector",
    "domain": "localhost",
    "id": "6a170446-e337-44e3-918c-415a200709b9",
    "dt": "2021-10-07T20:37:03.966Z",
    "request_id": "54a6c0d0-27ae-11ec-a93e-8936a01f4b42"
  },
  "dt": "2021-10-07T20:37:03.966Z",
  "http": {
    "request_headers": {
      "user-agent": "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/94.0.4606.54 Safari/537.36"
    }
  }
}
Logged in, odd user id, clicked on language in sidebar (default)
event: {
  "event": {
    "version": 3,
    "token": "",
    "contentLanguage": "en",
    "interfaceLanguage": "en",
    "web_session_id": "5e8644cdbfa039eda26f",
    "isAnon": false,
    "skin": "vector",
    "skinVersion": "latest",
    "action": "language-change",
    "context": "languages-list",
    "selectedInterfaceLanguage": "",
    "timeToChangeLanguage": 5677.400146484375,
    "userEditBucket": "0 edits"
  },
  "schema": "UniversalLanguageSelector",
  "webHost": "localhost",
  "wiki": "my_wiki",
  "$schema": "/analytics/legacy/universallanguageselector/1.4.0",
  "client_dt": "2021-10-07T19:39:51.520Z",
  "meta": {
    "stream": "eventlogging_UniversalLanguageSelector",
    "domain": "localhost",
    "id": "b52f3fd7-bd9f-47d5-8bf1-1fa6f20e619a",
    "dt": "2021-10-07T19:39:52.524Z",
    "request_id": "575a41b0-27a6-11ec-a93e-8936a01f4b42"
  },
  "dt": "2021-10-07T19:39:52.524Z",
  "http": {
    "request_headers": {
      "user-agent": "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/94.0.4606.54 Safari/537.36"
    }
  }
}
Anonymous, clicked on language in sidebar
event: {
  "event": {
    "version": 3,
    "token": "",
    "contentLanguage": "en",
    "interfaceLanguage": "en",
    "web_session_id": "5e8644cdbfa039eda26f",
    "isAnon": true,
    "skin": "vector",
    "skinVersion": "latest",
    "action": "language-change",
    "context": "languages-list",
    "selectedInterfaceLanguage": "",
    "timeToChangeLanguage": 56165.60009765625
  },
  "schema": "UniversalLanguageSelector",
  "webHost": "localhost",
  "wiki": "my_wiki",
  "$schema": "/analytics/legacy/universallanguageselector/1.4.0",
  "client_dt": "2021-10-07T19:42:13.846Z",
  "meta": {
    "stream": "eventlogging_UniversalLanguageSelector",
    "domain": "localhost",
    "id": "4d274db5-5dd1-41a6-93be-517e1edd3d2c",
    "dt": "2021-10-07T19:42:14.852Z",
    "request_id": "ac2fc930-27a6-11ec-a93e-8936a01f4b42"
  },
  "dt": "2021-10-07T19:42:14.852Z",
  "http": {
    "request_headers": {
      "user-agent": "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/94.0.4606.54 Safari/537.36"
    }
  }
}
jwang added a comment.Oct 7 2021, 11:52 PM

Hi @cjming

According to the Instrumentation Spec, new button clicks are identified by event.context = 'header'. event.context = 'other' is the value for the old link clicks on the sidebar.

cjming added a comment.Oct 8 2021, 3:17 PM
In T291285#7411008, @jwang wrote:

According to the Instrumentation Spec, new button clicks are identified by event.context = 'header'. event.context = 'other' is the value for the old link clicks on the sidebar.

hi @jwang - looks like we need to investigate this more. You're right that the spec indicates event.context should be header for your queries on the new language button but my experience in testing what event data is actually getting logged repeatedly returns other when clicking on that link. I'll do some more digging to see how that value is set and report back.

gerritbot added a comment.Oct 8 2021, 9:40 PM

Change 728662 had a related patch set uploaded (by Clare Ming; author: Clare Ming):

[mediawiki/extensions/WikimediaEvents@master] Update ULS compact language link log trigger id

https://gerrit.wikimedia.org/r/728662

gerritbot added a project: Patch-For-Review.Oct 8 2021, 9:40 PM
cjming added a comment.EditedOct 8 2021, 9:43 PM

So I think what's happening here has to do with when the Use a compact language list is set in preferences. Clicking on that compact language link , regardless of whether it's in the header or in the sidebar, sends the context as other in eventlogging.

Compact language link in sidebar:

Screen Shot 2021-10-08 at 2.40.03 PM.png (1×4 px, 2 MB)

Compact language list in header:

Screen Shot 2021-10-08 at 2.41.08 PM.png (2×4 px, 1 MB)

Seems like the ULS js in WikimediaEvents isn't catching the right trigger:

function ulsCompactLanguageLinksOpen( $trigger ) {
	log( {
		action: 'compact-language-links-open',
		context: skin === 'vector' && $trigger.is( '#p-lang-btn-label' ) ? 'header' : 'other'
	} );
}

Note that the trigger for the log function is the id for the h3 label rather than the id of the input element which has an id of #p-lang-btn-checkbox. So context will always return as 'other' instead of 'header'.

Screen Shot 2021-10-08 at 3.14.03 PM.png (2×5 px, 2 MB)

When I replace the id so that

context: skin === 'vector' && $trigger.is( '#p-lang-btn-checkbox' ) ? 'header' : 'other'

event.context gets set correctly as 'header':

Screen Shot 2021-10-08 at 3.28.34 PM.png (1×5 px, 1 MB)

I submitted a patch for above change.

As for next steps, do we continue gathering data (assuming above change is approved) ?

cjming removed cjming as the assignee of this task.Oct 8 2021, 9:52 PM
cjming moved this task from Doing to Code Review on the Web-Team-Backlog (Kanbanana-FY-2021-22) board.
Jdlrobson added a comment.Oct 8 2021, 10:05 PM

Nice sleuthing @cjming ! If I'm understanding correctly, wouldn't this bug mean that there would be no context: header events?

It looks like we moved the mw-interlanguage-selector class from the button to the checkbox in https://gerrit.wikimedia.org/r/c/mediawiki/skins/Vector/+/713008/9/includes/SkinVector.php (merged September 3rd), and the A/B test finished on July 20th. Are there similar problems with the logging with the code prior to that change?

Did we look at the events in ui.dropdown-p-lang-btn DesktopClickTracking? Those should have been logged for all users at 20% sampling. We could look at the logged-in events there, to see if they support the hypothesis being built here (ie. is there more events to that button in DesktopClickTracking than click events in UniversalLanguageSelector).

gerritbot added a comment.Oct 8 2021, 10:24 PM

Change 728662 merged by jenkins-bot:

[mediawiki/extensions/WikimediaEvents@master] Update ULS compact language link log trigger id

https://gerrit.wikimedia.org/r/728662

ReleaseTaggerBot added a project: MW-1.38-notes (1.38.0-wmf.4; 2021-10-12).Oct 8 2021, 11:00 PM
Maintenance_bot removed a project: Patch-For-Review.Oct 8 2021, 11:10 PM
jwang mentioned this in T285755: Analyze results of A/B test for new language switching location.Oct 9 2021, 12:05 AM
cjming added a comment.Oct 12 2021, 4:27 PM
In T291285#7413807, @Jdlrobson wrote:

If I'm understanding correctly, wouldn't this bug mean that there would be no context: header events?

that's my understanding - per your comment since the time that the class change occurred (9/3)

It looks like we moved the mw-interlanguage-selector class from the button to the checkbox in https://gerrit.wikimedia.org/r/c/mediawiki/skins/Vector/+/713008/9/includes/SkinVector.php (merged September 3rd), and the A/B test finished on July 20th. Are there similar problems with the logging with the code prior to that change?

not sure - I'll keep digging to give you a definitive answer

Did we look at the events in ui.dropdown-p-lang-btn DesktopClickTracking? Those should have been logged for all users at 20% sampling. We could look at the logged-in events there, to see if they support the hypothesis being built here (ie. is there more events to that button in DesktopClickTracking than click events in UniversalLanguageSelector).

I didn't notice anything getting logged for that but I'll confirm

LGoto assigned this task to cjming.Oct 12 2021, 5:20 PM
LGoto moved this task from Code Review to Needs More Work on the Web-Team-Backlog (Kanbanana-FY-2021-22) board.
cjming added a comment.Oct 15 2021, 11:09 PM
In T291285#7413807, @Jdlrobson wrote:

Did we look at the events in ui.dropdown-p-lang-btn DesktopClickTracking? Those should have been logged for all users at 20% sampling. We could look at the logged-in events there, to see if they support the hypothesis being built here (ie. is there more events to that button in DesktopClickTracking than click events in UniversalLanguageSelector).

When I turned on DesktopWebUIActionsTracking locally, the only other event I see getting logged besides ULS would not have shown up in the queries:

Screen Shot 2021-10-15 at 4.04.32 PM.png (2×4 px, 2 MB)

Notably, no event is triggered by DesktopWebUIActionsTracking when I click on the compact language link button in the sidebar.

It looks like we moved the mw-interlanguage-selector class from the button to the checkbox in https://gerrit.wikimedia.org/r/c/mediawiki/skins/Vector/+/713008/9/includes/SkinVector.php (merged September 3rd), and the A/B test finished on July 20th. Are there similar problems with the logging with the code prior to that change?

I delved into the git history of the ULS js in WikimediaEvents. It seems like the context for the compact language link in the header was added in early June (merged 6/1, backported 6/8). This is well before the A/B test was deployed (6/22)

Also went through git history of SkinVector.php around that same time - I haven't come across a commit (though there are a lot of them and I very well could be overlooking something) that might account for any possible explanation of the unanticipated data results.

Not sure if there are other places to look. I can spend more time digging but it feels a bit like looking for a needle in a haystack. If there are no objections, I'm inclined to send this to sign off.

cjming removed cjming as the assignee of this task.Oct 15 2021, 11:10 PM
cjming moved this task from Needs More Work to Ready for Signoff on the Web-Team-Backlog (Kanbanana-FY-2021-22) board.
cjming updated the task description. (Show Details)Oct 15 2021, 11:17 PM
Jdlrobson assigned this task to ovasileva.Oct 19 2021, 5:06 PM

I agree with Clare's suggestion here. Does that work for you Olga?

ovasileva closed this task as Resolved.Oct 20 2021, 3:09 PM
In T291285#7441654, @Jdlrobson wrote:

I agree with Clare's suggestion here. Does that work for you Olga?

Sounds good to me. Thanks Clare! Resolving this.

jwang mentioned this in T294390: Analyze Language Switching Usage trend on anonymous users 3 months after new language button deployed.Oct 26 2021, 8:57 PM
Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL