Dashboard 2019-20 annual plan metrics for the Language team
Closed, ResolvedPublic
Actions

Assigned To

Authored By

	Pginer-WMF
	Jun 20 2019, 11:50 AM

Description

The Language team would like an auto-updating dashboard where they can easily track their key metrics related to ContentTranslation, the project that they're currently working on.

The current plan is to make a Jupyter notebook dashboard; the current version is available at https://analytics.wikimedia.org/published/notebooks/WMF-Language/key-metrics.html.

In particular, based on their 2019-20 annual plan (T225298), they would like to see the following metrics.

Related Objects
Search...

Status	Assigned	Task
Resolved	nshahquinn-wmf	T226171 Dashboard 2019-20 annual plan metrics for the Language team
Resolved	nshahquinn-wmf	T233022 Measure the number of translators in selected wikis
Resolved	Pginer-WMF	T226170 Measure newcomer retention after their first translation
Declined	KCVelaga_WMF	T287306 Create an ETL job to aggregate Content Translation metrics for dashboarding
Resolved	nshahquinn-wmf	T235341 Set up auto-publication of Language key metrics dashboard
Resolved	nshahquinn-wmf	T235342 Develop interactive visualizations for Language key metrics
Resolved	nshahquinn-wmf	T240747 Add Albanian as a target wiki on the Language key metrics dashboard
Resolved	nshahquinn-wmf	T246256 Evaluate dashboarding Language key metrics using Superset where possible
Resolved	nshahquinn-wmf	T247104 Make translation counts available in Superset
Resolved	nshahquinn-wmf	T226169 Measure the number of translations for selected small wikis
Resolved	nshahquinn-wmf	T233021 Measure the year-over-year change in published translations
Resolved	MNeisler	T250378 Expand Language key metrics dashboard to cover section translations

Event Timeline

Pginer-WMF created this task.Jun 20 2019, 11:50 AM

Pginer-WMF mentioned this in T225298: Language Annual Plan 2019-2020.Jun 20 2019, 1:37 PM

Hey @Pginer-WMF , I'll work with the team on getting this done and should have it assigned soon.

Sorry, realized this is for next FY; I'm still working with the team on figuring out the key contact people.

In T226171#5284362, @kzimmerman wrote:

Sorry, realized this is for next FY; I'm still working with the team on figuring out the key contact people.

Yes. This is in preparation for the next fiscal year (starting in 5 days). I wanted to capture the metrics before it starts since we found that having metrics early is helpful to establish a baseline and later identify the impact of the future changes.

Please, let us know when people and timelines are defined.

Thanks!

Pginer-WMF updated the task description. (Show Details)Aug 27 2019, 1:24 PM

Pginer-WMF updated the task description. (Show Details)Aug 27 2019, 1:39 PM

kzimmerman assigned this task to nshahquinn-wmf.Aug 27 2019, 7:01 PM

nshahquinn-wmf triaged this task as Medium priority.Aug 28 2019, 7:14 PM

nshahquinn-wmf added a project: Language-analytics.

nshahquinn-wmf moved this task from Triage to Next Up on the Product-Analytics board.

Pginer-WMF moved this task from Backlog to Priority Backlog on the Language-analytics board.Aug 29 2019, 10:17 AM

Pginer-WMF updated the task description. (Show Details)Sep 16 2019, 3:01 PM

Pginer-WMF updated the task description. (Show Details)Sep 16 2019, 3:03 PM

nshahquinn-wmf updated the task description. (Show Details)Sep 19 2019, 2:48 PM

nshahquinn-wmf added subtasks: T226169: Measure the number of translations for selected small wikis, T233021: Measure the year-over-year change in published translations, T233022: Measure the number of translators in selected wikis, T226170: Measure newcomer retention after their first translation.

nshahquinn-wmf moved this task from Next Up to Doing on the Product-Analytics board.Oct 3 2019, 3:29 PM

nshahquinn-wmf renamed this task from Measure 2019-20 annual plan metrics for the Language team to Dashboard 2019-20 annual plan metrics for the Language team.Oct 12 2019, 3:48 PM

nshahquinn-wmf updated the task description. (Show Details)Oct 12 2019, 4:35 PM

Pginer-WMF mentioned this in T234323: Adapt Content translation's editor to support section translation on desktop.Oct 15 2019, 11:43 AM

nshahquinn-wmf moved this task from Doing to Next Up on the Product-Analytics board.Oct 15 2019, 7:54 PM

• mmodell edited projects, added Product-Analytics (Kanban); removed Product-Analytics.Oct 16 2019, 5:53 PM

• mmodell edited projects, added Product-Analytics; removed Product-Analytics (Kanban).Oct 16 2019, 6:28 PM

• mmodell edited projects, added Product-Analytics (Kanban); removed Product-Analytics.Oct 16 2019, 6:33 PM

kzimmerman edited projects, added Product-Analytics, Epic; removed Product-Analytics (Kanban).Oct 29 2019, 6:23 PM

nshahquinn-wmf updated the task description. (Show Details)Oct 30 2019, 6:33 PM

nshahquinn-wmf edited projects, added Product-Analytics (Kanban); removed Product-Analytics.Nov 19 2019, 5:35 PM

The current draft dashboard is available at https://analytics.wikimedia.org/published/notebooks/WMF-Language/key-metrics.html (code at . Some notes:

The new/experienced user classification is incorrect, producing a false decline in translations by new users (T237788).
The dashboard currently needs to be manually updated and depends on the monthly mediawiki_history snapshots, so even if it were automatically updated it would only should new data once per month.