[[ https://gerrit.wikimedia.org/g/analytics/refinery/+/b1aa837f63592aea21e9b3ed3b611ac4cd00010d/python/refinery/sqoop.py#316 | This ]] will need to be updated to be compatible with the categorylinks [[ https://gerrit.wikimedia.org/r/c/mediawiki/core/+/1112833 | schema changes ]].
Done is:
[x] `cl_target_id` and `cl_collation_id` added to Sqoop's `categorylinks` table definition in `python/refinery/sqoop.py`
[x] Table `collation` added to Sqoop
[x] Table `collation` added to Sqoop's Puppet script invocation definition
[x] Table `categorylinks` `CREATE` HQL script updated with two new columns
[x] Table `wmf_raw.wikimedia_categorylinks` updated in Hive with two new columns (`ALTER TABLE ADD COLUMN...`)
[x] Table `wmf_raw.wikimedia_collation` created in Hive
[x] Table `wmf_raw.wikimedia_collation` added to mediawiki history load DAG
[x] Table `wmf_raw.wikimedia_collation` added to bin/refinery-drop-mediawiki-snapshots script