Change Details

== Background We would like to monitor the metrics for the Vector 2022 skin post deployment on enwiki. == Acceptance criteria **Week of Jan 18** Observational analysis on the following before and after the deployment: - [DONE] Pageviews T327440#8542723 - [DONE] ~~Edit rates~~ Edits. ( Edit rates is not a well defined metric. Instead, we'd like to measure the number of edits, which is a core product metric). T327440#8542723 - [DONE] Account creation T327440#8542723 - [DONE] Opt-out rates T327440#8544894 - [DONE] Number of users (split by all, all editors, active editors) using each available skin T327953 - [DONE] Analyze number of users using each available skin on English Wikipedia who have recently edited T328088 - [DONE] Usage of fixed width toggle T327690 - [Under discussion] Usage of "Enable limited width mode" preference (A snapshot of how many users total have enabled limited width mode vs disabled) T327688 If possible: - [Explored] ~~Logins~~ Note: We don't have schema to log each login events. `user` table only logs the time when the user logged in and changed settings, not the time when the user visited in a logged-in mode. `event.CentralAuth` schema only logs auto loggins into the sister project. It does not log the readers who always stay on their local wikis, which is the majority of the user scenarios. - Content translation - [Done] Percentage of daily accounts created who turn off Vector 2022 (opt-outs from new accounts) Note: The opt-out events are logged in `mediawiki_skin_diff` schema, which only stores hashed user_id. We cannot join with the other schema to identify whether s/he is a new comer. Suggest to measure number of new comers who created account after deployment using each available skin on English Wikipedia. T328609 As for the daily trend, the `event.prefupdate` schema logs skin preference user selected with user_id, but does not log the initial skin preference. It can provide daily trends of how many newcomers who have updated skin preference and which skin they opted for, assuming they are opting out from vector2022 to other skins. T328609#8651077 - Percentage of daily account creations who have 0 edits after 24 hours **For first report** **General** - Pageviews - ~~Edit rates~~ Edits - Account creation - Opt-out - Content translation - Number of users (split by all, all editors, active editors) using each available skin - Logins - Percentage of daily accounts created who turn off Vector 2022 (opt-outs from new accounts) - Percentage of daily account creations who have 0 edits after 24 hours - Usage of fixed width toggle - Usage of "Enable limited width mode" preference - [DONE] Session length T328599 **Feature-specific** - [DONE] Search usage T328600 - [Blocked] ToC usage T329234 - [DONE] Scrolling to top of the page T329235 - Sidebar collapsing - Tools usage

== Background We would like to monitor the metrics for the Vector 2022 skin post deployment on enwiki. == Acceptance criteria **Week of Jan 18** Observational analysis on the following before and after the deployment: - [DONE] Pageviews T327440#8542723 - [DONE] ~~Edit rates~~ Edits. ( Edit rates is not a well defined metric. Instead, we'd like to measure the number of edits, which is a core product metric). T327440#8542723 - [DONE] Account creation T327440#8542723 - [DONE] Opt-out rates T327440#8544894 - [DONE] Number of users (split by all, all editors, active editors) using each available skin T327953 - [DONE] Analyze number of users using each available skin on English Wikipedia who have recently edited T328088 - [DONE] Usage of fixed width toggle T327690 - [Under discussion] Usage of "Enable limited width mode" preference (A snapshot of how many users total have enabled limited width mode vs disabled) T327688 If possible: - [Explored] ~~Logins~~ Note: We don't have schema to log each login events. `user` table only logs the time when the user logged in and changed settings, not the time when the user visited in a logged-in mode. `event.CentralAuth` schema only logs auto loggins into the sister project. It does not log the readers who always stay on their local wikis, which is the majority of the user scenarios. - Content translation - [Done] Percentage of daily accounts created who turn off Vector 2022 (opt-outs from new accounts) Note: The opt-out events are logged in `mediawiki_skin_diff` schema, which only stores hashed user_id. We cannot join with the other schema to identify whether s/he is a new comer. Suggest to measure number of new comers who created account after deployment using each available skin on English Wikipedia. T328609 As for the daily trend, the `event.prefupdate` schema logs skin preference user selected with user_id, but does not log the initial skin preference. It can provide daily trends of how many newcomers who have updated skin preference and which skin they opted for, assuming they are opting out from vector2022 to other skins. T328609#8651077 - Percentage of daily account creations who have 0 edits after 24 hours **For first report** **General** - Pageviews - ~~Edit rates~~ Edits - Account creation - Opt-out - Content translation - Number of users (split by all, all editors, active editors) using each available skin - Logins - Percentage of daily accounts created who turn off Vector 2022 (opt-outs from new accounts) - Percentage of daily account creations who have 0 edits after 24 hours - Usage of fixed width toggle - Usage of "Enable limited width mode" preference - [DONE] Session length T328599 **Feature-specific** - [DONE] Search usage T328600 - [DONE] ToC usage T329234 - [DONE] Scrolling to top of the page T329235 - Sidebar collapsing - Tools usage

== Background We would like to monitor the metrics for the Vector 2022 skin post deployment on enwiki. == Acceptance criteria **Week of Jan 18** Observational analysis on the following before and after the deployment: - [DONE] Pageviews T327440#8542723 - [DONE] ~~Edit rates~~ Edits. ( Edit rates is not a well defined metric. Instead, we'd like to measure the number of edits, which is a core product metric). T327440#8542723 - [DONE] Account creation T327440#8542723 - [DONE] Opt-out rates T327440#8544894 - [DONE] Number of users (split by all, all editors, active editors) using each available skin T327953 - [DONE] Analyze number of users using each available skin on English Wikipedia who have recently edited T328088 - [DONE] Usage of fixed width toggle T327690 - [Under discussion] Usage of "Enable limited width mode" preference (A snapshot of how many users total have enabled limited width mode vs disabled) T327688 If possible: - [Explored] ~~Logins~~ Note: We don't have schema to log each login events. `user` table only logs the time when the user logged in and changed settings, not the time when the user visited in a logged-in mode. `event.CentralAuth` schema only logs auto loggins into the sister project. It does not log the readers who always stay on their local wikis, which is the majority of the user scenarios. - Content translation - [Done] Percentage of daily accounts created who turn off Vector 2022 (opt-outs from new accounts) Note: The opt-out events are logged in `mediawiki_skin_diff` schema, which only stores hashed user_id. We cannot join with the other schema to identify whether s/he is a new comer. Suggest to measure number of new comers who created account after deployment using each available skin on English Wikipedia. T328609 As for the daily trend, the `event.prefupdate` schema logs skin preference user selected with user_id, but does not log the initial skin preference. It can provide daily trends of how many newcomers who have updated skin preference and which skin they opted for, assuming they are opting out from vector2022 to other skins. T328609#8651077 - Percentage of daily account creations who have 0 edits after 24 hours **For first report** **General** - Pageviews - ~~Edit rates~~ Edits - Account creation - Opt-out - Content translation - Number of users (split by all, all editors, active editors) using each available skin - Logins - Percentage of daily accounts created who turn off Vector 2022 (opt-outs from new accounts) - Percentage of daily account creations who have 0 edits after 24 hours - Usage of fixed width toggle - Usage of "Enable limited width mode" preference - [DONE] Session length T328599 **Feature-specific** - [DONE] Search usage T328600 - [Blocked- [DONE] ToC usage T329234 - [DONE] Scrolling to top of the page T329235 - Sidebar collapsing - Tools usage