Page MenuHomePhabricator
Create Task
Maniphest T169735

Sqoop job fqil for big wiki tables
Closed, ResolvedPublic
Actions

Description

Sqooping of enwiki.revision; wikidatawiki.revision, wikidatawiki.logging failed last month.
See https://gist.github.com/jobar/8cb108723b8c915e575004552ee5c210 for full error.

Related Objects

Event Timeline

JAllemandou created this task.Jul 5 2017, 12:19 PM
Restricted Application added a subscriber: Aklapper. · View Herald TranscriptJul 5 2017, 12:19 PM
elukey subscribed.Jul 5 2017, 12:21 PM
Milimetric mentioned this in T169782: Troubleshoot issues with sqoop of data not working for big tables.Jul 5 2017, 9:32 PM
Milimetric closed this task as a duplicate of T169782: Troubleshoot issues with sqoop of data not working for big tables.
Milimetric changed the task status from Duplicate to Resolved.Jul 5 2017, 10:01 PM
Milimetric subscribed.

Joseph - if you do end up updating this, no worries on too much detail. I get how the error is happening and will see how to increase that net_write_timeout or find other advice.

Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL · Credits