Page MenuHomePhabricator

Requests to dumps.wikimedia.org should end up in hadoop wmf.webrequest via kafka!
Closed, DeclinedPublic

Description

It does not look like requests to this domain make their way into hadoop!

Having these requests would be great!

9:19 PM <ottomata> but to get into webrequest, there has to be varnish and a varnishkafka instance

Event Timeline

Addshore raised the priority of this task from to Needs Triage.
Addshore updated the task description. (Show Details)
Addshore subscribed.
Addshore set Security to None.
Addshore added a project: SRE.

Hmm, this isn't a duplicate..? lists.wm.o != dumps.wm.o !!!

yep, you are right. i don't know why i thought it was a duplicate, it's not.

Milimetric subscribed.

So we're leaning towards declining this unless requests for dumps.wikimedia.org go through varnish.

What about using piwik for tracking stats on dumps.wikimedia.org? Is that enough or do you want other stats?