Since we are dropping revision.rev_sha1 as per T389026, we need to modify our sqooping scripts so that they do not fail to sqoop wmf_raw.mediawiki_revision.
We should also consider removing the column, although I think we typically do not remove old fields.
| Status | Subtype | Assigned | Task | ||
|---|---|---|---|---|---|
| Resolved | Zabe | T389026 Rethink rev_sha1 field | |||
| Resolved | xcollazo | T405503 Prepare data engineering infrastructure for drop of rev_sha1 | |||
| Duplicate | None | T406644 Stop sqooping revision.rev_sha1 |
We should also consider removing the column, although I think we typically do not remove old fields.
@JAllemandou double checking: we typically do not remove old fields from sqooped tables, correct?
I did this as part of T406000. See https://gerrit.wikimedia.org/r/c/operations/puppet/+/1196631