Description

As part of our mission to improve the multilingual experience in Wikifunctions pages (T343376), we worked on a re-design of the new About Widget.

We will know that we've been successful by gathering qualitative and quantitative metrics before the new changes deployment and after the uptake period.

To-do

• Design a set of metrics, research experiments and/or requests for feedback to capture the necessary data.
• Depending on the metrics design output, this task might spark another one to implement the necessary event logging.

Design

https://www.notion.so/wikimediadesign/About-widget-metrics-84e3bbfafe6f4e3393b4b2435f15febf?pvs=4
https://miro.com/app/board/uXjVK0JN8ak=/

Qualitative metrics

to expand

Quantitative metrics

Metrics over inventory: Look at the current state of stored Objects at a given point in time

1. Completeness of multilingual information in stored Objects: How many multilingual items (e.g. name, description, aliases and input labels) are in total in every Object.
   • Avg multilingual items per Object
   • Avg multilingual items per Object type (e.g. Do Functions have more complete multilingual data than other types?)
2. Diversity of multilingual information in stored Objects: How many unique languages are represented in the multilingual information of Objects.
   • Avg languages per Object
   • Avg languages per Object type (e.g. Do Functions have more diverse multilingual representation than other types?)

Captured user interactions: Track user actions to understand how they interact with the UI

3. How many languages at a time are editors editing?
   • Number of multilingual items on Object creation
   • Number of unique languages on Object creation
   • Number of multilingual items on Object edit
   • Number of unique languages on Object edit
4. How are editors adding multilingual information: edit source vs. quick edit?
   • Number of edits from the edit page that include multilingual data edits
   • Number of edits from the view page (about widget quick edit flow)