Pointing includes testing, likely will take 2 weeks.
| Subject | Repo | Branch | Lines +/- | |
|---|---|---|---|---|
| Script sqooping mediawiki tables into hdfs | analytics/refinery | master | +2 K -28 | |
| Oozify sqoop import of mediawiki tables | analytics/refinery | master | +3 K -12 |
| Status | Subtype | Assigned | Task | ||
|---|---|---|---|---|---|
| Resolved | None | T120037 Vital Signs: Please provide an "all languages" de-duplicated stream for the Community/Content groups of metrics | |||
| Resolved | None | T120036 Vital Signs: Please make the data for enwiki and other big wikis less sad, and not just be missing for most days | |||
| Resolved | • odimitrijevic | T130256 Wikistats 2.0. | |||
| Resolved | None | T143924 Replacing standard edit metrics in dashiki with data from new edit data depot | |||
| Resolved | JAllemandou | T152035 Productionize Edit History Reconstruction and Extraction | |||
| Resolved | Milimetric | T141476 Productionize edit history extraction for all wikis using Sqoop |
I'll try to do this using new hotness oozie generator: https://github.com/etsy/arbiter
Change 303339 had a related patch set uploaded (by Milimetric):
[WIP] Oozify sqoop import of mediawiki tables
Change 303339 abandoned by Milimetric:
Oozify sqoop import of mediawiki tables
Reason:
oozie isn't really needed, will refactor to puppet as a cron job, maybe moving the python scripts to /bin?
Change 306292 had a related patch set uploaded (by Milimetric):
Script sqooping mediawiki tables into hdfs