Page MenuHomePhabricator
Create Task
Maniphest T185147

Host Google-News-word2vec.bin publicly
Closed, ResolvedPublic
Actions

Description

The download link for Google-News word vectors binary is https://drive.google.com/file/d/0B7XkCwpI5KDYNlNUTTlSS21pQmM/edit and is a google drive link not suitable for downloading from CLI. We should host the 3GB binary somewhere public so that we can easily download it on an ores server without having to rely on our individual connections.

Related Objects

Event Timeline

Sumit created this task.Jan 17 2018, 9:46 PM
Restricted Application added a subscriber: Aklapper. · View Herald TranscriptJan 17 2018, 9:46 PM
Sumit added a comment.Jan 17 2018, 9:47 PM

The binary *was* on ores-misc-01 which is now nuked. I'll upload it to ores-staging-01 from my system again from where it can be put somewhere public.

awight subscribed.Feb 1 2018, 2:26 PM

I found a few existing mirrors:

It would be safest to calculate the SHA-256 and verify content from our Makefile.

Halfak claimed this task.Feb 13 2018, 4:54 PM
Halfak moved this task from Parked to Completed on the Machine-Learning-Team (Active Tasks) board.
Halfak subscribed.

See: https://analytics.wikimedia.org/datasets/archive/public-datasets/all/ores/assets/

awight mentioned this in Unknown Object (Phame Post).May 2 2018, 6:41 PM
awight mentioned this in Unknown Object (Phame Post).
awight mentioned this in Unknown Object (Phame Post).
awight mentioned this in Blog Post: Status Update (May 2, 2018).
awight closed this task as Resolved.May 2 2018, 6:47 PM
Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL · Credits