Page MenuHomePhabricator

Further improvements to the WMCS edits dashboard
Open, HighPublic

Description

Here are some suggestions from @Bmueller to further improve the WMCS edits dashboard:

These ideas to be investigated further, implement the feasible ones.

Event Timeline

Restricted Application added a subscriber: Aklapper. · View Herald TranscriptDec 6 2019, 7:00 PM
srishakatux triaged this task as High priority.Dec 6 2019, 7:01 PM
fdans moved this task from Incoming to Radar on the Analytics board.Dec 9 2019, 5:13 PM
srishakatux added a comment.EditedDec 12 2019, 10:29 PM

Here is an update on suggested improvements:

  • In the Tabular View, we are now showing data sorted by wmcs edits percentage.
    • Technical details:
      • Patch submitted and merged: T240044.
      • Currently, Dashiki does not support sorting data in the Tabular View by multiple columns; filed a task around it: T240049
  • In the Timeseries View, we are now providing the option to select and compare all wikis.
    • UI changes this entails:
      • 10 popular wikis including TOTAL selected by default in the left menu.
      • ALLWIKIS changed to TOTAL
      • Data from a particular month listed under the last day of that month. e.g., 2019-11 as 2019-11-30. It makes more sense to me to have it this way than listing under the first day of the month as with that it seems like the data corresponds to the previous month.
    • Technical details:
WITH
        slice AS (
            SELECT
                wiki_db,
                SUM(IF(network_origin='wikimedia_labs', edit_count, 0)) AS wmcs_edits,
                SUM(edit_count) AS total_edits,
                ROUND(SUM(IF(network_origin='wikimedia_labs', edit_count, 0)) / SUM(edit_count), 3) AS wmcs_percent
            FROM wmf.editors_daily
            WHERE
                month = '2019-10'
            GROUP BY
                wiki_db
        ),
        total AS (
            SELECT
                last_day('2019-10-01') AS date,
                'TOTAL' AS wiki_db,
                ROUND(SUM(wmcs_edits) / SUM(total_edits), 3) AS wmcs_percent
            FROM slice
        )
    SELECT * FROM total
    UNION ALL
    SELECT
        last_day('2019-10-01') AS date,
        wiki_db,
        wmcs_percent
    FROM slice
    ORDER BY
        wiki_db
    LIMIT 10000
    ;
 SELECT
   last_day('2019-11-01') AS date,
   wiki_db,
   SUM(IF(network_origin='wikimedia_labs', edit_count, 0)) AS wmcs_edits
FROM wmf.editors_daily
WHERE
   month = '2019-11'
GROUP BY
   wiki_db
ORDER BY
   wiki_db
LIMIT 10000
;
  • To be investigated further: ability to filter by month and not only by date in all 3 views (to be further investigated...)

Note to self: once we lock these changes, I will make a patch containing modifications to hive queries.

And, changes can be seen here for testing https://wmcs-edits.wmflabs.org.

srishakatux updated the task description. (Show Details)Dec 14 2019, 1:53 AM