add script for stitching json dump shards
Closed, ResolvedPublic
Actions

Assigned To

Authored By

	daniel
	Jul 22 2014, 9:54 AM

Description

we should have a (bash?) script for stitching multiple shards of a json dump into a single dump (and probably compress it at the same time).

Version: unspecified
Severity: normal
Whiteboard: u=dev c=infrastructure p=0

Status	Assigned	Task
Open	None	T88728 Improve Wikimedia dumping infrastructure
Open	None	T88991 improve Wikidata dumps [tracking]
Resolved	JanZerebecki	T70366 add script for stitching json dump shards

• bzimport raised the priority of this task from to Medium.Nov 22 2014, 3:37 AM

• bzimport set Reference to bz68366.

• bzimport added a subscriber: Unknown Object (MLST).

Lydia_Pintscher removed a subscriber: Unknown Object (MLST).

This is already done in operations/puppet.git/modules/snapshot/files/dumpwikidatajson.sh