Page MenuHomePhabricator

Analyze usage of "Enable limited width mode" preference
Closed, ResolvedPublic

Description

Goal

To analyze usage of "Enable limited width mode" preference as part of post-deployment analysis for Vector 2022 metrics on English Wikipedia. Provide a snapshot of how many users total have enabled limited width mode vs disabled.

Event Timeline

Hi @Jdlrobson, here are the data related vector-limited-width from user_properties table of enwiki. A couple of questions:

  1. what's the difference between vector-limited-width and vector-limited-width-local-exception ? Which should be included in analysis?
  2. vector-limited-width only have 0 as the value in the table. Is it expected? How to interpret it?
up_propertyup_valuecount(1)
vector-limited-width05425
vector-limited-width-local-exception0111
vector-limited-width-local-exception14
SELECT up_property, up_value, count(1)  
FROM user_properties 
WHERE up_property IN ('vector-limited-width',    'vector-limited-width-local-exception' ) 
GROUP BY up_property, up_value;
jwang triaged this task as High priority.Jan 31 2023, 6:10 PM
jwang moved this task from Next 2 weeks to Doing on the Product-Analytics (Kanban) board.

vector-limited-width =0 means user has disabled the limited width (they have opted out of the default behaviour)
local exception means user is using Special:GlobalPreference and has overriden the value specifically on this wiki.

Note we don't store vector-limited-width=1 since that is the default behaviour, so analysis here will only take into account people that have opted out, not stuck to the default experience (but presumably if we have a sense of number of active users this can be used to work out a percentage of users that opted out).

Note the preference can be updated in Special:Preferences or as a result of the toggle in the bottom right corner of the page so you should expect to see some correlation between the data here and the toggle being clicked.

@ovasileva, here is the snapshot of the usage of "Enable limited width mode" preference as of 2023-02-16. Let me if you need additional details.

Note:

  • 7540 users have disabled limit width at preference, counting for 0.0167% of total registered users (45030368) on English Wikipedia, as of 2023-02-16.
  • Some of the users recorded with empty up_value in the user_properties table. Need engineer's inputs on how to interpret them.
up_propertyup_valueCountsNote
vector-limited-width296Unknown property value
vector-limited-width07408Number of users who disabled limited-width
vector-limited-width-local-exception29Unknown property value
vector-limited-width-local-exception0132Number of users who disabled limited-width by global preference
vector-limited-width-local-exception18Number of users who enabled limited-width by global preference

@KSarabia-WMF, here is a remaining question from analysis. What the empty up_value fields in user_properties schema are representing for when you have time? Could you take a look when you have time?

@ovasileva, here is the snapshot of the usage of "Enable limited width mode" preference as of 2023-02-16. Let me if you need additional details.

Note:

  • 7540 users have disabled limit width at preference, counting for 0.0167% of total registered users (45030368) on English Wikipedia, as of 2023-02-16.
  • Some of the users recorded with empty up_value in the user_properties table. Need engineer's inputs on how to interpret them.
up_propertyup_valueCountsNote
vector-limited-width296❓Unknown property value
vector-limited-width07408Number of users who disabled limited-width
vector-limited-width-local-exception29❓Unknown property value
vector-limited-width-local-exception0132Number of users who disabled limited-width by global preference
vector-limited-width-local-exception18Number of users who enabled limited-width by global preference

Query to get above data:

% analytics-mysql enwiki # query on maridb

SELECT up_property, up_value, count(1)  AS counts
FROM user_properties 
WHERE up_property IN ('vector-limited-width',    'vector-limited-width-local-exception' ) 
GROUP BY up_property, up_value

@KSarabia-WMF has done some investigation(T340493). Marked this ticket as resolved.