druid ingestion should calculate 1/sample rate to be able to normalize event counts
Closed, ResolvedPublic5 Estimated Story Points
Actions

Assigned To

Authored By

	• Nuria
	Nov 21 2018, 5:55 PM

Description

druid ingestion should calculate 1/sample rate to be able to normalize event counts.

Details

	Subject	Repo	Branch	Lines +/-
	Update analytics eventlogging_to_druid_job.pp to mirror changes in scala job	operations/puppet	production	+14 -16
	Allow for custom transforms in DataFrameToDruid	analytics/refinery/source	master	+657 -457

Customize query in gerrit

Related Objects

Mentioned In: T208589: [HiveToDruid] Add support for ingesting subfields of map columns
T203669: Return to real time banner impressions in Druid

Event Timeline

• Nuria created this task.Nov 21 2018, 5:55 PM

Restricted Application added a subscriber: Aklapper. · View Herald TranscriptNov 21 2018, 5:55 PM

• Nuria assigned this task to mforns.Nov 21 2018, 5:56 PM

• Nuria added a subscriber: elukey.

mforns mentioned this in T203669: Return to real time banner impressions in Druid.Nov 21 2018, 6:03 PM

Milimetric triaged this task as High priority.Nov 29 2018, 6:07 PM

Milimetric added a project: Analytics-Kanban.

Milimetric moved this task from Incoming to Smart Tools for Better Data on the Analytics board.

mforns moved this task from Next Up to In Progress on the Analytics-Kanban board.Nov 30 2018, 4:27 PM

Change 477295 had a related patch set uploaded (by Mforns; owner: Mforns):
[analytics/refinery/source@master] Allow for custom transforms in DataFrameToDruid

https://gerrit.wikimedia.org/r/477295

gerritbot added a project: Patch-For-Review.Dec 3 2018, 3:56 PM

mforns mentioned this in T208589: [HiveToDruid] Add support for ingesting subfields of map columns.Dec 12 2018, 8:30 PM

mforns moved this task from In Progress to In Code Review on the Analytics-Kanban board.Dec 14 2018, 3:27 PM

Change 479847 had a related patch set uploaded (by Mforns; owner: Mforns):
[operations/puppet@production] Update analytics eventlogging_to_druid_job.pp to mirror changes in scala job

https://gerrit.wikimedia.org/r/479847

• Tbayer subscribed.Jan 1 2019, 5:16 PM

Change 477295 merged by jenkins-bot:
[analytics/refinery/source@master] Allow for custom transforms in DataFrameToDruid

https://gerrit.wikimedia.org/r/477295

mforns moved this task from In Code Review to Ready to Deploy on the Analytics-Kanban board.Jan 7 2019, 3:53 PM

Change 479847 merged by Elukey:
[operations/puppet@production] Update analytics eventlogging_to_druid_job.pp to mirror changes in scala job

https://gerrit.wikimedia.org/r/479847

mforns moved this task from Ready to Deploy to Done on the Analytics-Kanban board.Jan 8 2019, 4:21 PM

AndyRussG subscribed.Jan 9 2019, 1:07 AM

• Nuria closed this task as Resolved.Jan 14 2019, 5:54 PM

• Nuria set the point value for this task to 5.

druid ingestion should calculate 1/sample rate to be able to normalize event countsClosed, ResolvedPublic5 Estimated Story PointsActions

Description

Details

Related Objects

Event Timeline

druid ingestion should calculate 1/sample rate to be able to normalize event counts
Closed, ResolvedPublic5 Estimated Story Points
Actions