Page MenuHomePhabricator

Move page creation queries to Hive
Closed, DeclinedPublic

Description

During the ACTRIAL project, we set up queries to grab and visualize data from the page creation event logging database through ReportUpdater (see T170850).

That data is now also available in Hive, and we would rather use that as the source of the data. In order to do so, the following needs to be done:

  • Port the current queries to HQL.
  • Verify that both HQL and SQL queries produce the same results.
  • Wrap the HQL queries in this shell script.
  • Update the ReportUpdater configuration.
  • Test the configuration.
  • Submit it to code review.

Also:

Event Timeline

nshahquinn-wmf moved this task from Triage to Backlog on the Product-Analytics board.
nshahquinn-wmf lowered the priority of this task from Medium to Low.Sep 27 2018, 8:35 PM
Aklapper subscribed.

Removing task assignee due to inactivity, as this open task has been assigned to the same person for more than two years (see the emails sent to the task assignee on Oct27 and Nov23). Please assign this task to yourself again if you still realistically [plan to] work on this task - it would be welcome.
(See https://www.mediawiki.org/wiki/Bug_management/Assignee_cleanup for tips how to best manage your individual work in Phabricator.)

The dashboards that used this data are no longer in use, and there has been no feedback suggesting a need for the data. I see no need to keep this task around.