Page MenuHomePhabricator

Migrate table creation query to oozie for interlanguage links
Closed, ResolvedPublic8 Estimated Story Points

Description

Migrate table creation query from https://gerrit.wikimedia.org/r/#/c/362877/2/language/interlanguage_links_create_table.sql to oozie.

@Amire80 will start and @Milimetric will continue.

Re-opening: the new data is not matching the old data.

Event Timeline

Restricted Application added a subscriber: Aklapper. · View Herald Transcript

Change 365517 had a related patch set uploaded (by Amire80; owner: Amire80):
[analytics/refinery@master] [WIP] Create an Oozie job for interlanguage link table creation

https://gerrit.wikimedia.org/r/365517

priorities have sadly shifted a bit, I may not be able to get to this. cc @Nuria.

Nuria renamed this task from Migrate table creation query to oozie to Migrate table creation query to oozie for interlanguage links.Sep 14 2017, 4:34 PM

Ready to review, @Amire80. Please take a look at the table and SQL as they have changed a bit. I hope you find it to your liking and test out the sample data I put in there for October 1st:

select *
  from milimetric.interlanguage_navigation
 where date='2017-10-01'
   and previous_project = 'ro'
;
Nuria set the point value for this task to 5.Oct 17 2017, 4:12 PM

Thanks a lot for the updates. I'm traveling at the moment, and I'll review it next week.

@Amire80: any chance to review? I'd like to deploy the job to production and stop yours, it would save some cluster cycles if it indeed produces the data you need.

Change 365517 merged by Milimetric:
[analytics/refinery@master] Create Oozie job for interlanguage nav table

https://gerrit.wikimedia.org/r/365517

Nuria changed the point value for this task from 5 to 8.Nov 27 2017, 4:02 PM
Milimetric updated the task description. (Show Details)
Milimetric moved this task from Done to In Progress on the Analytics-Kanban board.

Change 402379 had a related patch set uploaded (by Milimetric; owner: Milimetric):
[analytics/refinery@master] Fix bad input events

https://gerrit.wikimedia.org/r/402379

Change 402379 merged by Milimetric:
[analytics/refinery@master] Fix bad input events

https://gerrit.wikimedia.org/r/402379

Change 403484 had a related patch set uploaded (by Milimetric; owner: Milimetric):
[analytics/refinery@master] Point data and success flags to the same directory

https://gerrit.wikimedia.org/r/403484

Change 403484 merged by Nuria:
[analytics/refinery@master] Point data and success flags to the same directory

https://gerrit.wikimedia.org/r/403484