Page MenuHomePhabricator

Add redirect and pagelinks tables for partition repair in sqoop job for mediawiki history
Closed, ResolvedPublic5 Estimated Story Points

Description

I think the newly added tables pagelinks and redirect are not listed for the sqoop job to repair their partitions.
This makes the mediawiki snapshot cleaner break, because the file structure and the hive table have different partitions.
When this is done, we should modify that cleaner script to include those tables.

Event Timeline

Change 374623 had a related patch set uploaded (by Mforns; owner: Mforns):
[analytics/refinery@master] Add pagelinks and redirect to refinery-drop-mediawiki-snapshots

https://gerrit.wikimedia.org/r/374623

JAllemandou set the point value for this task to 5.Aug 31 2017, 4:13 PM

Change 374623 abandoned by Mforns:
Add pagelinks and redirect to refinery-drop-mediawiki-snapshots

Reason:
This has been taken care of by another patch.

https://gerrit.wikimedia.org/r/374623