Add a --dry-run option to the sqoop script
Closed, ResolvedPublic5 Estimated Story Points
Actions

Assigned To

Authored By

	Milimetric
	Feb 28 2018, 10:14 PM

Description

The sqoop script is big and scary because when it runs it takes 3 days and moves a lot of data. It would be nice if there was a simple --dry-run option where it would just list the sqoop commands that it would do if --dry-run wasn't specified.

Details

	Subject	Repo	Branch	Lines +/-
	Add --dry-run parameter to mediawiki sqoop script	analytics/refinery	master	+24 -11

Customize query in gerrit

Event Timeline

Milimetric created this task.Feb 28 2018, 10:14 PM

Restricted Application added a subscriber: Aklapper. · View Herald TranscriptFeb 28 2018, 10:14 PM

Milimetric moved this task from Incoming to Wikistats on the Analytics board.Mar 1 2018, 6:04 PM

Milimetric moved this task from Wikistats to Geowiki on the Analytics board.Mar 1 2018, 6:21 PM

Milimetric triaged this task as Medium priority.Apr 19 2018, 5:35 PM

• fdans set the point value for this task to 3.Apr 23 2018, 4:04 PM

• Nuria added a project: Analytics-Kanban.Apr 23 2018, 4:20 PM

• fdans claimed this task.Apr 27 2018, 10:55 AM

Change 429410 had a related patch set uploaded (by Fdans; owner: Fdans):
[analytics/refinery@master] Add --dry-run parameter to mediawiki sqoop script

https://gerrit.wikimedia.org/r/429410

gerritbot added a project: Patch-For-Review.Apr 27 2018, 12:30 PM

• fdans moved this task from Next Up to In Code Review on the Analytics-Kanban board.Apr 27 2018, 2:45 PM

Change 429410 merged by Joal:
[analytics/refinery@master] Add --dry-run parameter to mediawiki sqoop script

https://gerrit.wikimedia.org/r/429410

• fdans moved this task from In Code Review to Ready to Deploy on the Analytics-Kanban board.May 2 2018, 11:21 AM

• fdans changed the point value for this task from 3 to 5.

JAllemandou moved this task from Ready to Deploy to Done on the Analytics-Kanban board.May 2 2018, 4:10 PM

• Nuria closed this task as Resolved.May 8 2018, 10:42 PM