Page MenuHomePhabricator
Create Task
Maniphest T218347

Ingest cirrussearchrequest data into druid
Closed, DeclinedPublic
Actions

Description

Ingest cirrusserachrequest data into druid after the cirrussearchrequest logging has been migrated completely to EventGate and new tables are persisted in the cluster according to new schemas.

Schemas will be available here once created: https://github.com/wikimedia/mediawiki-event-schemas/tree/master/jsonschema/mediawiki

Related Objects
Search...

Event Timeline

• Nuria created this task.Mar 14 2019, 7:21 PM
Restricted Application added a subscriber: Aklapper. · View Herald TranscriptMar 14 2019, 7:21 PM
• Nuria added a comment.Mar 14 2019, 7:26 PM

Blocked on http://phabricator.wikimedia.org/T215442

• Nuria added a project: Discovery-ARCHIVED.Mar 14 2019, 7:26 PM
• Nuria added a subscriber: EBernhardson.
Milimetric triaged this task as Medium priority.Mar 18 2019, 3:20 PM
Milimetric moved this task from Incoming to Event Platform on the Analytics board.
• Nuria added a project: CirrusSearch.Mar 18 2019, 10:33 PM
Restricted Application added a project: Discovery-Search. · View Herald TranscriptMar 18 2019, 10:33 PM
debt added a parent task: T215442: Make Refine use JSONSchemas of event data to support Map types and proper types for integers vs decimals.Mar 21 2019, 7:03 PM
debt renamed this task from Ingest cirrusserachrequest data into druid to Ingest cirrussearchrequest data into druid.Mar 28 2019, 5:14 PM
debt moved this task from needs triage to watching / waiting on the Discovery-Search board.
Ottomata subscribed.Sep 20 2019, 3:09 PM

Actually blocked on T208589: [HiveToDruid] Add support for ingesting subfields of map columns.

Ottomata added a parent task: T208589: [HiveToDruid] Add support for ingesting subfields of map columns.Sep 20 2019, 5:48 PM
Ottomata moved this task from Event Platform to Incoming on the Analytics board.Sep 20 2019, 8:48 PM
• fdans moved this task from Incoming to Smart Tools for Better Data on the Analytics board.Sep 23 2019, 3:28 PM
Ottomata closed this task as Declined.Oct 27 2020, 3:57 PM

I think we are not going to to this, right? Especially now that this data can be accessed via Presto in Superset. Declining, re-open if I am wrong.

Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL