In T172410#4271987, @elukey wrote:

During this year though we (as Analytics team) will try to identify use cases and work with people to move away from mysql, ideally getting to a position in which everybody can work with data on Hadoop only.

Thanks @ezachte! That helps a lot. I'm using the article count data as part of our monthly metrics, so I want them on an ongoing basis. Happily, I've figured out to use the zipped CSVs so I don't need anything new 😁

This is mostly done! I've heavily overhauled the calculation pipeline and created a notebook for calculating the monthly metrics table.

In T194712#4235995, @Deskana wrote:

@Neil_P._Quinn_WMF I don't use the dashboard at all.

In T194712#4230846, @Nemo_bis wrote:

This dashboard was IIRC one of the main talking points to show the effeciveness of VisualEditor and its suitability as default editor. It's definitely something that still comes up regularly.

In T191675#4231431, @Trizek-WMF wrote:

Survey:

• I don't think the levels of education are not internationalized, but I may be wrong. I've tried to find the terms used in CE insights for comparison, but didn't find those.

@ezachte, I've found the location of the data I want within the Wikistats dumpfiles, but I'm still not sure which folder is the canonical one.

It looks like this is because there have been several schema changes since March 2017 and I assume the queries haven't been updated.

@ezachte, @Erik_Zachte (I don't know which is the real one!): I'm working on producing these new metrics for our Board reporting, and I'm trying to get historical monthly data on the article counts for all our projects. This seems really tricky to calculate myself, but I think I can get it from Wikistats instead :)

@ggellerman did you ever make a research pipeline project? 😁

This looks like it will be harder than I thought. We want to start tracking some content metrics (namely the number of articles, number of media files, number of Wikidata entities, and number of Wikidata claims).

@Jdforrester-WMF, have you noticed this?

Benoît is back and, as far as I can tell, I didn't break anything 😁

This is actually resolved! When I originally filed this, the timestamps were stored in Mediawiki's string format (e.g. 20180514215953), but in June 2017 we started storing in JDBC format (e.g. 2018-05-14 21:59:53.0). This means Hive's date and time functions can now operate on them.

@Pginer-WMF, do you want the Product Analytics team to work on this, T194647, T194648, and T194650? If so, we can definitely consider it although you should note that (1) it may take a few weeks to triage since we're working through a big backlog right now and (2) we'll continue to be very capacity limited until our new data analyst starts, hopefully in 2-3 weeks.

For history purposes, today's TechCom radar email said about this proposal: "discussed and decided not to continue discussion within TechCom, because the standard is not currently relevant".

In T184096#4198458, @Tbayer wrote:

The calculation kept failing because - I think - of time limits on PAWS; the revert analysis is a bit computationally expensive and took 8 hours when it finally completed successfully; next time we run this one probably needs to invest some time to split it into several shorter timespans.

Sadly, I never got a chance to do this. @egalvezwmf will be very kindly doing some basic analysis of this year's data for us.

We still want to do the open subtasks, but they're not really linked to each other so there's no point in keep this parent task open.

Damn it. Today is not my day.

Hmm, let's try to actually unsubscribe Morten!

Actually, let's not overload Morten with notifications before he starts :)