Page MenuHomePhabricator

Ingest api data (for posts) into druid
Open, MediumPublic

Description

Ingest api data (for posts) into druid.
At this time the api logging is being migrated to use EventGate to be the only receiver of api events.

This is the schema of current requests: https://github.com/wikimedia/mediawiki-event-schemas/blob/master/jsonschema/mediawiki/api/request/0.0.1.yaml

These requests will be persisted onto the hadoop cluster onto a table that should be imported into druid either as is or maybe with small aggregation.

Event Timeline

Milimetric triaged this task as Medium priority.Mar 18 2019, 3:20 PM
Milimetric moved this task from Incoming to Event Platform on the Analytics board.