Page MenuHomePhabricator

Create a plugin for recent-changes daemon to be able to process purge events for memcache
Closed, DeclinedPublic

Description

Create a plugin for https://github.com/wikimedia/change-propagation to be able to consume memcache purge events and send them to a set of memcache servers.

Event Timeline

Smalyshev created this task.May 6 2016, 7:33 AM
Restricted Application added a subscriber: Zppix. · View Herald TranscriptMay 6 2016, 7:33 AM

All you need is a rule, no plugins needed:

memcached:
  match:
    meta:
      uri: # the regex you need to match
   tags:
    - 'jnbfb' # if any
  exec:
    # the HTTP request to execute with method, uri, body, headers

The assumption is that memcached can talk HTTP. Change prop also supports HTCP.

Smalyshev added a comment.EditedMay 6 2016, 5:56 PM

There could be a set of memcached's (depending on sharding setup I guess) and the message itself needs processing before being sent out, and also needs fallback/retry if any of the memcached's fail. So I'm not sure it'd work without plugin?

elukey added a subscriber: elukey.May 9 2016, 3:30 PM

@Smalyshev Any progress on this? If you specify the requirements I can help with implementing it in ChangeProp Or did you decide to go to the other direction with this?

I understood that memcache is being handled with mcrouter, but I'll double-check.

aaron changed the task status from Open to Stalled.Aug 24 2016, 7:39 PM
Pchelolo closed this task as Declined.Oct 12 2016, 8:04 PM

Looks like this is no longer needed, closing.