Page MenuHomePhabricator
Create Task
Maniphest T250378

Expand Language key metrics dashboard to cover section translations
Closed, ResolvedPublic
Actions

Description

The Language team is working on expanding ContentTranslation to support translating sections, both on desktop and mobile (T243495). When section translation is released, the team will want to track its adoption on their key metrics dashboard in Superset. They will add a revision tag so we will be able to see section translations in the edits_hourly dataset.

The section translation metrics should distinguish between:

  • translations that start a new page and those that add to an existing page
  • mobile translations and desktop translations
  • main namespace vs. others (i.e., sandbox)

Related Objects
Search...

Event Timeline

nshahquinn-wmf created this task.Apr 16 2020, 12:48 PM
nshahquinn-wmf updated the task description. (Show Details)
nshahquinn-wmf moved this task from Triage to Needs Investigation on the Product-Analytics board.Apr 16 2020, 12:53 PM

@Pginer-WMF, when might section translation be released? I imagine we want to do get this done around the same time.

nshahquinn-wmf triaged this task as Medium priority.Apr 16 2020, 12:54 PM
nshahquinn-wmf mentioned this in T233021: Measure the year-over-year change in published translations.
Pginer-WMF added a comment.Apr 17 2020, 12:09 PM
In T250378#6062322, @nshahquinn-wmf wrote:

@Pginer-WMF, when might section translation be released? I imagine we want to do get this done around the same time.

We are working on a proof-of-concept during this quarter. Even if it is not exposed to users, as soon as the one-section mode for Content Translation (T234323) is ready, we can have a few test translations tagged as "section-translation".

Having the graphs ready early would be good to track the impact of work from the beginning, but I imagine that makes more sense once there are at least a few test edits tagged as "section-translation".

nshahquinn-wmf moved this task from Needs Investigation to Current Quarter on the Product-Analytics board.Apr 19 2020, 3:53 PM
In T250378#6065411, @Pginer-WMF wrote:

We are working on a proof-of-concept during this quarter. Even if it is not exposed to users, as soon as the one-section mode for Content Translation (T234323) is ready, we can have a few test translations tagged as "section-translation".

Okay, we'll try for the current quarter!

nshahquinn-wmf mentioned this in T226169: Measure the number of translations for selected small wikis.Apr 19 2020, 4:26 PM
nshahquinn-wmf moved this task from Backlog to Priority Backlog on the Language-analytics board.Apr 19 2020, 4:28 PM
nshahquinn-wmf mentioned this in T226170: Measure newcomer retention after their first translation.
nshahquinn-wmf mentioned this in T233022: Measure the number of translators in selected wikis.
nshahquinn-wmf moved this task from Current Quarter to Upcoming Quarter on the Product-Analytics board.Jun 9 2020, 5:15 PM
LGoto moved this task from Upcoming Quarter to Current Quarter on the Product-Analytics board.Sep 21 2020, 4:23 PM
kzimmerman moved this task from Current Quarter to Upcoming Quarter on the Product-Analytics board.Dec 2 2020, 6:32 PM
kzimmerman subscribed.

Due to time left in the quarter & other priorities, moving to next quarter.

nshahquinn-wmf moved this task from Upcoming Quarter to Current Quarter on the Product-Analytics board.Jan 6 2021, 9:18 AM
nshahquinn-wmf moved this task from Current Quarter to Kanban on the Product-Analytics board.Jan 19 2021, 6:17 PM
nshahquinn-wmf edited projects, added Product-Analytics (Kanban); removed Product-Analytics.
nshahquinn-wmf moved this task from Next 2 weeks to Doing on the Product-Analytics (Kanban) board.Feb 15 2021, 4:07 PM
Pginer-WMF updated the task description. (Show Details)Feb 18 2021, 9:48 AM
nshahquinn-wmf moved this task from Doing to Next 2 weeks on the Product-Analytics (Kanban) board.Feb 18 2021, 4:19 PM
nshahquinn-wmf added a comment.Feb 18 2021, 5:55 PM

I've added some initial graphs and laid the foundation for some more. I'll continue this next week, when the data should start coming in. That will make it much easier to set up complex visualizations.

nshahquinn-wmf added a comment.Mar 1 2021, 3:48 PM

Pau reports the dashboard is currently showing errors:

superset.wikimedia.org_superset_dashboard_119_.png (1×1 px, 220 KB)

nshahquinn-wmf added a comment.Mar 1 2021, 3:53 PM
In T250378#6870972, @nshahquinn-wmf wrote:

Pau reports the dashboard is currently showing errors:

...but it loads fine for me. Hmm.

Pginer-WMF added a comment.Mar 1 2021, 3:59 PM
In T250378#6871005, @nshahquinn-wmf wrote:
In T250378#6870972, @nshahquinn-wmf wrote:

Pau reports the dashboard is currently showing errors:

...but it loads fine for me. Hmm.

I can confirm that now it works for me too.

nshahquinn-wmf edited projects, added Product-Analytics; removed Product-Analytics (Kanban).Mar 4 2021, 4:00 PM

Deprioritizing this a bit, in favor of T254891.

nshahquinn-wmf moved this task from Triage to Upcoming Quarter on the Product-Analytics board.Mar 4 2021, 4:00 PM
nshahquinn-wmf reassigned this task from nshahquinn-wmf to MNeisler.Jul 28 2021, 9:17 PM
nshahquinn-wmf moved this task from Upcoming Quarter to Current Quarter on the Product-Analytics board.
MNeisler edited projects, added Product-Analytics (Kanban); removed Product-Analytics.Sep 14 2021, 5:12 PM
MNeisler moved this task from Next 2 weeks to Doing on the Product-Analytics (Kanban) board.Sep 28 2021, 3:00 PM
MNeisler moved this task from Doing to [Deprecated] Done (previously: Needs sign-off) on the Product-Analytics (Kanban) board.Sep 30 2021, 3:37 PM

I've updated the section translations dashboard to include filters to view the data by the following dimensions:

  • page namespace (currently only content translations event recorded to date)
  • platform (currently only mobile web events recorded to date)
  • creates_new_page (true if translations that start a new page and false if it was added to an existing page)
  • time range

A couple of notes about the data:

  • The Monthly section translations by wiki" and "Section translations at all wikis, total" are based on edits_hourly database and will update monthly. We should have September data next week
  • The "Monthly section translations by wiki" chart currently only shows section translations on Bengali Wikipedia as that is the only wiki where it was deployed as of the last update. This chart is not limited to any specific wikis and will update to reflect any additional wikis as we continue to deploy section translations.
  • For real-time data, @nshahquinn-wmf included an sql query "Real-time daily section translations per wiki" which can be run to obtain more recent data. I updated the query to include information on whether the translation created a new page and the page namespace.

@Pginer-WMF - Let me know if you have any suggested changes or questions.

Pginer-WMF closed this task as Resolved.Oct 5 2021, 7:53 AM
In T250378#7391786, @MNeisler wrote:

I've updated the section translations dashboard to include filters to view the data by the following dimensions:

  • page namespace (currently only content translations event recorded to date)
  • platform (currently only mobile web events recorded to date)
  • creates_new_page (true if translations that start a new page and false if it was added to an existing page)
  • time range

A couple of notes about the data:

  • The Monthly section translations by wiki" and "Section translations at all wikis, total" are based on edits_hourly database and will update monthly. We should have September data next week
  • The "Monthly section translations by wiki" chart currently only shows section translations on Bengali Wikipedia as that is the only wiki where it was deployed as of the last update. This chart is not limited to any specific wikis and will update to reflect any additional wikis as we continue to deploy section translations.
  • For real-time data, @nshahquinn-wmf included an sql query "Real-time daily section translations per wiki" which can be run to obtain more recent data. I updated the query to include information on whether the translation created a new page and the page namespace.

@Pginer-WMF - Let me know if you have any suggested changes or questions.

This is great. Thanks for the updates.
Some of the filters will become more useful as new features are available in the tool. However, the "creates_new_page" has already been useful to identify that there is a ~50% split between new articles started and those expanded with a new section.

Pginer-WMF added a project: Language-Team (Language-2021-October-December).Oct 5 2021, 7:53 AM
Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL