Change Details

Similar to T397923 for `categorylinks`, the `imagelinks` MediaWiki table is being normalized in T299953 and we should adapt to it. In addition to Sqoop, it's possible that Commons Impact Metrics also depends on this table directly. I think T415786 is the ticket that tracks the actual migration in the production database. We need to do the following: [] Add `il_target_id` to Sqoop's imagelinks table definition in `python/refinery/sqoop.py` [] Drop `il_to` column from Sqoop's imagelinks table definition by setting value to `null` [] Update the `CREATE HQL` script of `wmf_raw.mediawiki_imagelinks` with the new columns added [] Run alter table statement on table `wmf_raw.mediawiki_imagelinks` in Hive to the new column (ALTER TABLE ADD COLUMN...) [] Update `[[ https://gerrit.wikimedia.org/g/analytics/refinery/+/f84b3cc25cb6c4219e951f80f624d69e25f0548b/hql/commons_impact_metrics/category_and_media_with_usage_map.hql | commons_impact_metrics ]]` hql script

Similar to T397923 for `categorylinks`, the `imagelinks` MediaWiki table is being normalized in T299953 and we should adapt to it. In addition to Sqoop, it's possible that Commons Impact Metrics also depends on this table directly. I think T415786 is the ticket that tracks the actual migration in the production database. We need to do the following: [] Add `il_target_id` to Sqoop's imagelinks table definition in `python/refinery/sqoop.py` [] Drop `il_to` column from Sqoop's imagelinks table definition by setting value to `null` [] Update the `CREATE HQL` script of `wmf_raw.mediawiki_imagelinks` with the new columns added [] Run alter table statement on table `wmf_raw.mediawiki_imagelinks` in Hive to the new column (ALTER TABLE ADD COLUMN...) [] Update [[ https://gerrit.wikimedia.org/g/analytics/refinery/+/f84b3cc25cb6c4219e951f80f624d69e25f0548b/hql/commons_impact_metrics/category_and_media_with_usage_map.hql | commons_impact_metrics]] hql script

Similar to T397923 for `categorylinks`, the `imagelinks` MediaWiki table is being normalized in T299953 and we should adapt to it. In addition to Sqoop, it's possible that Commons Impact Metrics also depends on this table directly. I think T415786 is the ticket that tracks the actual migration in the production database. We need to do the following: [] Add `il_target_id` to Sqoop's imagelinks table definition in `python/refinery/sqoop.py` [] Drop `il_to` column from Sqoop's imagelinks table definition by setting value to `null` [] Update the `CREATE HQL` script of `wmf_raw.mediawiki_imagelinks` with the new columns added [] Run alter table statement on table `wmf_raw.mediawiki_imagelinks` in Hive to the new column (ALTER TABLE ADD COLUMN...) [] Update `[[ https://gerrit.wikimedia.org/g/analytics/refinery/+/f84b3cc25cb6c4219e951f80f624d69e25f0548b/hql/commons_impact_metrics/category_and_media_with_usage_map.hql | commons_impact_metrics ]]`]] hql script