Page MenuHomePhabricator

Install snzip on stat1002 and stat1003 {hawk}
Closed, DeclinedPublic

Description

I'd like to have snzip, a snappy compression/decompression utility installed on stat1002/1003 so that I can work directly with snappy-compressed files.

See https://github.com/kubo/snzip. I can't find a Deb, but the author provides installation instructions in the README.

This is currently blocking my work on https://meta.wikimedia.org/wiki/Research:Measuring_edit_productivity / T99172

Event Timeline

Halfak raised the priority of this task from to Needs Triage.
Halfak updated the task description. (Show Details)
Halfak added a project: Analytics-Backlog.
Halfak added a subscriber: Halfak.

@Ottomata directed me to a compiled binary of snzip he has in his home folder. This will work for me for now.

I'd like to leave this open and put it on the analytics backlog with low priority. It'd be nice to have this as a .deb.

Ottomata removed a project: Research.
madhuvishy renamed this task from Install snzip on stat1002 and stat1003 to Install snzip on stat1002 and stat1003 {hawk}.Sep 17 2015, 5:16 PM
madhuvishy assigned this task to Ottomata.
madhuvishy moved this task from Incoming to Prioritized on the Analytics-Backlog board.

Just heard an update at Scrum of Scrums that Ops is giving Analytics ownership of this kind of work. They said they'd help if needed.

It seems like this library will not work for snappy compression from Hadoop. @Ottomata, unless we want to fix this upstream, then I don't see a good reason to spend more time getting the compression utility debianized.