We discussed refactoring the data retrieval scripts so that we can have a single log file (easier to check for errors) and make it easier to run the individual scripts to backfill the data.
The current backfilling system involves copy-pasting individual scripts into a remote R session and then backfilling, one script at a time. We can do better.
| Subject | Repo | Branch | Lines +/- | |
|---|---|---|---|---|
| Finish the automated backfilling script - hopefully! | wikimedia/discovery/golden | master | +56 -14 |
| Status | Subtype | Assigned | Task | ||
|---|---|---|---|---|---|
| Resolved | Ironholds | T114919 Refactor golden to be more robust and backfilling-friendly | |||
| Resolved | Ironholds | T114517 Data is not being retrieved/sync'd |
Change 246963 had a related patch set uploaded (by OliverKeyes):
Finish the automated backfilling script - hopefully!
Change 246963 merged by Bearloga:
Finish the automated backfilling script - hopefully!