Page MenuHomePhabricator

Package bloomd
Closed, ResolvedPublic

Description

http://armon.github.io/bloomd/

Bloomd is "a high-performance C server which is used to expose bloom filters and operations over them to networked clients. It uses a simple ASCII protocol which is human readable, and similar to memcached."

I propose we use a persistent bloom filter during the migration to content-based addressing of media files. The bloom filter would be updated with the name of each image file which has been moved to a content-based hash filename. We would use it in SwiftMedia rewrite.py to determine whether the request URL represents a file which has been migrated.

Event Timeline

ori raised the priority of this task from to Medium.
ori updated the task description. (Show Details)
ori subscribed.

Change 257167 had a related patch set uploaded (by Ori.livneh):
Imported Upstream version 0.7.4

https://gerrit.wikimedia.org/r/257167

Change 257167 merged by Ori.livneh:
Imported Upstream version 0.7.4

https://gerrit.wikimedia.org/r/257167

MarkTraceur subscribed.

It looks like this is done, can someone confirm or explain what else needs doing, so someone else can pick this up if needed?

Gilles lowered the priority of this task from Medium to Low.Dec 7 2016, 7:24 PM
Krinkle removed a project: Patch-For-Review.