Page MenuHomePhabricator

Puppetize druid
Closed, ResolvedPublic34 Estimated Story Points

Related Objects

StatusSubtypeAssignedTask
ResolvedNone
ResolvedOttomata

Event Timeline

JAllemandou moved this task from Incoming to Backlog (Later) on the Analytics board.
Nuria renamed this task from Productionitize druid to Puppetize druid.May 5 2016, 5:24 PM
Nuria updated the task description. (Show Details)

This can be done even if the absence of new hardware. How is the documentation?

This would take more or less time depending on the amount of processes that we have to set up and daemons that are running.

For example:

  • Will need to integrate with HDFS,
  • We will need to load data from druid into cassandra so it needs to talk to cassandra too. Is this just a query job? Or daemon configuration?

Do we need the hdfs labs cluster up to test this integration.

Nuria set the point value for this task to 34.May 5 2016, 5:33 PM
Nuria edited projects, added Analytics-Kanban; removed Analytics.

Change 288099 had a related patch set uploaded (by Ottomata):
[WIP] Druid module

https://gerrit.wikimedia.org/r/288099

Change 291043 had a related patch set uploaded (by Ottomata):
Include cloudera reprepro updates in jessie-wikimedia

https://gerrit.wikimedia.org/r/291043

Change 291043 merged by Ottomata:
Include cloudera reprepro updates in jessie-wikimedia

https://gerrit.wikimedia.org/r/291043

Change 288099 merged by Ottomata:
Druid module and analytics_cluster role class

https://gerrit.wikimedia.org/r/288099

Change 291113 had a related patch set uploaded (by Ottomata):
Apply druid roles in production with initial (guesswork) configuration

https://gerrit.wikimedia.org/r/291113

Change 291113 merged by Ottomata:
Apply druid roles in production with initial (guesswork) configuration

https://gerrit.wikimedia.org/r/291113

Change 291128 had a related patch set uploaded (by Ottomata):
Add analytics_cluster::hadoop::client to druid workers so CDH is installed

https://gerrit.wikimedia.org/r/291128

Change 291128 merged by Ottomata:
Add analytics_cluster::hadoop::client to druid workers so CDH is installed

https://gerrit.wikimedia.org/r/291128

Change 291129 had a related patch set uploaded (by Ottomata):
Install the druid service package for each service

https://gerrit.wikimedia.org/r/291129

Change 291129 merged by Ottomata:
Install the druid service package for each service

https://gerrit.wikimedia.org/r/291129

Change 291137 had a related patch set uploaded (by Ottomata):
Use ruby json lib to render Arrays as strings in druid runtime.properties.erb

https://gerrit.wikimedia.org/r/291137

Change 291137 merged by Ottomata:
Use ruby json lib to render Arrays as strings in druid runtime.properties.erb

https://gerrit.wikimedia.org/r/291137

Change 291140 had a related patch set uploaded (by Ottomata):
Druid puppet improvements for prod

https://gerrit.wikimedia.org/r/291140

Change 291140 merged by Ottomata:
Druid puppet improvements for prod

https://gerrit.wikimedia.org/r/291140

I'm calling this done!

There are going to be a lot of smaller follow up tasks, especially for monitoring.