How do we measure the success of multilingual features?
Given the overall goal is to 'improve the multilingual experience', success can be seen as satisfying the following:
1. Feed engagement from Multilingual users (who have more content to read)
- Existing engagement metrics:
- Increased daily average users (being able to access more content they find interesting)
- Longer average time spent in the Explore Feed
- Increase in interactions with feed content
- Usage of customizing the feed by language
2. Article reading engagement
- Do people spend more time reading or view more pages from different languages?
Ideally we would compare depth/session length from users with 1 vs those who have >1 language set in the app
3. Adoption and usage of multiple languages feature
Prior to the release of new multilingual features, ideally baseline usage of the app language switching should be measured, as well as general Android device multilingual usage. See T190092: Selected languages stats on Wikipedia Android app
- New metrics:
- Usage of adding/changing app languages from Search vs Settings
- For users who have >1 language added, what are the top languages and language combinations