Page MenuHomePhabricator
Create Task
Maniphest T70366

add script for stitching json dump shards
Closed, ResolvedPublic
Actions

Description

we should have a (bash?) script for stitching multiple shards of a json dump into a single dump (and probably compress it at the same time).

Version: unspecified
Severity: normal
Whiteboard: u=dev c=infrastructure p=0

Details

Reference
bz68366

Related Objects
Search...

Event Timeline

• bzimport raised the priority of this task from to Medium.Nov 22 2014, 3:37 AM
• bzimport added a project: MediaWiki-extensions-Wikibase-Repo.
• bzimport set Reference to bz68366.
• bzimport added a subscriber: Unknown Object (MLST).
daniel created this task.Jul 22 2014, 9:54 AM
Lydia_Pintscher added a project: Wikidata.Dec 1 2014, 2:41 PM
Lydia_Pintscher removed a subscriber: Unknown Object (MLST).
Lydia_Pintscher removed a subscriber: Unknown Object (MLST).
Lydia_Pintscher added a parent task: T88991: improve Wikidata dumps [tracking].Feb 9 2015, 4:03 PM
JanZerebecki closed this task as Resolved.Mar 4 2015, 1:44 PM
JanZerebecki claimed this task.
JanZerebecki subscribed.

This is already done in operations/puppet.git/modules/snapshot/files/dumpwikidatajson.sh

Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL · Credits