Page MenuHomePhabricator
Create Task
Maniphest T194427

Deploy Turnilo (possible pivot replacement)
Closed, ResolvedPublic8 Estimated Story Points
Actions

Details

SubjectRepoBranchLines +/-
role::analytics_cluster::webserver: deprecate pivotoperations/puppetproduction+4 -7
Redirect pivot -> turnilooperations/puppetproduction+12 -1
Add turnilo.wikimedia.orgoperations/dnsmaster+1 -0
role::cache::misc: add Varnish config for turnilo.w.ooperations/puppetproduction+2 -0
Proper cluster names in turnilo datasourcesoperations/puppetproduction+13 -13
More turnilo yaml config fixesoperations/puppetproduction+25 -2 K
Fix bad comment line wrap for turnilo configoperations/puppetproduction+12 -238
Fix yaml rendering of druid_clusters for turnilooperations/puppetproduction+7 -1
Puppetize Turnilo (Pivot replacement)operations/puppetproduction+5 K -1
Customize query in gerrit

Related Objects
Search...

Event Timeline

Ottomata created this task.May 10 2018, 8:57 PM
Restricted Application added a subscriber: Aklapper. · View Herald TranscriptMay 10 2018, 8:57 PM
Ottomata set the point value for this task to 8.May 10 2018, 8:58 PM
gerritbot subscribed.May 10 2018, 8:59 PM

Change 432530 had a related patch set uploaded (by Ottomata; owner: Ottomata):
[operations/puppet@production] Puppetize Turnilo (Pivot replacement)

https://gerrit.wikimedia.org/r/432530

gerritbot added a project: Patch-For-Review.May 10 2018, 8:59 PM
gerritbot added a comment.May 14 2018, 2:13 PM

Change 432530 merged by Ottomata:
[operations/puppet@production] Puppetize Turnilo (Pivot replacement)

https://gerrit.wikimedia.org/r/432530

Milimetric triaged this task as Medium priority.May 14 2018, 2:29 PM
gerritbot added a comment.May 14 2018, 2:41 PM

Change 432989 had a related patch set uploaded (by Ottomata; owner: Ottomata):
[operations/puppet@production] Fix yaml rendering of druid_clusters for turnilo

https://gerrit.wikimedia.org/r/432989

gerritbot added a comment.May 14 2018, 2:44 PM

Change 432989 merged by Ottomata:
[operations/puppet@production] Fix yaml rendering of druid_clusters for turnilo

https://gerrit.wikimedia.org/r/432989

gerritbot added a comment.May 14 2018, 2:50 PM

Change 432990 had a related patch set uploaded (by Ottomata; owner: Ottomata):
[operations/puppet@production] Fix bad comment line wrap for turnilo config

https://gerrit.wikimedia.org/r/432990

gerritbot added a comment.May 14 2018, 2:50 PM

Change 432990 merged by Ottomata:
[operations/puppet@production] Fix bad comment line wrap for turnilo config

https://gerrit.wikimedia.org/r/432990

gerritbot added a comment.May 14 2018, 2:58 PM

Change 432993 had a related patch set uploaded (by Ottomata; owner: Ottomata):
[operations/puppet@production] More turnilo yaml config fixes

https://gerrit.wikimedia.org/r/432993

gerritbot added a comment.May 14 2018, 2:59 PM

Change 432993 merged by Ottomata:
[operations/puppet@production] More turnilo yaml config fixes

https://gerrit.wikimedia.org/r/432993

gerritbot added a comment.May 14 2018, 3:01 PM

Change 432994 had a related patch set uploaded (by Ottomata; owner: Ottomata):
[operations/puppet@production] Proper cluster names in turnilo datasources

https://gerrit.wikimedia.org/r/432994

gerritbot added a comment.May 14 2018, 3:02 PM

Change 432994 merged by Ottomata:
[operations/puppet@production] Proper cluster names in turnilo datasources

https://gerrit.wikimedia.org/r/432994

Ottomata moved this task from Next Up to Ready to Deploy on the Analytics-Kanban board.May 14 2018, 3:07 PM
Ottomata moved this task from Ready to Deploy to In Code Review on the Analytics-Kanban board.
• fdans moved this task from Incoming to Operational Excellence on the Analytics board.May 14 2018, 3:52 PM
elukey merged a task: T194054: Tests clone of pivot .May 15 2018, 6:12 AM
elukey added subscribers: • Nuria, faidon.
gerritbot added a comment.May 15 2018, 6:13 AM

Change 433112 had a related patch set uploaded (by Elukey; owner: Elukey):
[operations/puppet@production] role::cache::misc: add Varnish config for turnilo.w.o

https://gerrit.wikimedia.org/r/433112

gerritbot added a comment.May 15 2018, 6:22 AM

Change 433118 had a related patch set uploaded (by Elukey; owner: Elukey):
[operations/dns@master] Add turnilo.wikimedia.org

https://gerrit.wikimedia.org/r/433118

gerritbot added a comment.May 15 2018, 10:13 AM

Change 433112 merged by Elukey:
[operations/puppet@production] role::cache::misc: add Varnish config for turnilo.w.o

https://gerrit.wikimedia.org/r/433112

gerritbot added a comment.May 15 2018, 10:22 AM

Change 433118 merged by Elukey:
[operations/dns@master] Add turnilo.wikimedia.org

https://gerrit.wikimedia.org/r/433118

Ottomata moved this task from In Code Review to Ready to Deploy on the Analytics-Kanban board.May 15 2018, 2:21 PM
JAllemandou moved this task from Ready to Deploy to Done on the Analytics-Kanban board.May 17 2018, 4:07 PM
gerritbot added a comment.May 22 2018, 2:06 PM

Change 434499 had a related patch set uploaded (by Ottomata; owner: Ottomata):
[operations/puppet@production] Redirect pivot -> turnilo

https://gerrit.wikimedia.org/r/434499

gerritbot added a comment.May 23 2018, 2:25 PM

Change 434499 merged by Ottomata:
[operations/puppet@production] Redirect pivot -> turnilo

https://gerrit.wikimedia.org/r/434499

Stashbot subscribed.May 23 2018, 2:25 PM

Mentioned in SAL (#wikimedia-analytics) [2018-05-23T14:25:35Z] <ottomata> redirecting pivot -> turnilo.wikimedia.org - https://phabricator.wikimedia.org/T194427

• Tbayer added a subtask: T195819: Pageviews-daily broken after move from Pivot to Turnilo.May 29 2018, 9:36 AM
• Nuria added a comment.May 29 2018, 11:14 AM

@Ottomata do we need to re-generate this file everytime we add anew data source?
https://gerrit.wikimedia.org/r/#/c/432530/4/modules/turnilo/templates/config.yaml.erb

Ottomata added subscribers: JAllemandou, Milimetric.May 29 2018, 1:09 PM

I'm not 100%, but I know that Turnilo has the ability to discover datasources on it's own. Perhaps the use of the config.yaml file is preventing it from doing so? @Milimetric and @JAllemandou might know more.

gerritbot added a comment.May 31 2018, 10:41 AM

Change 436501 had a related patch set uploaded (by Elukey; owner: Elukey):
[operations/puppet@production] role::analytics_cluster::webserver: deprecate pivot

https://gerrit.wikimedia.org/r/436501

gerritbot added a comment.May 31 2018, 10:43 AM

Change 436501 merged by Elukey:
[operations/puppet@production] role::analytics_cluster::webserver: deprecate pivot

https://gerrit.wikimedia.org/r/436501

• Nuria closed subtask T195819: Pageviews-daily broken after move from Pivot to Turnilo as Resolved.May 31 2018, 4:41 PM
• Tbayer reopened subtask T195819: Pageviews-daily broken after move from Pivot to Turnilo as Open.Jun 2 2018, 10:15 AM
elukey closed subtask T195819: Pageviews-daily broken after move from Pivot to Turnilo as Resolved.Jun 4 2018, 8:12 AM
• Nuria closed this task as Resolved.Jun 4 2018, 2:53 PM
• Tbayer subscribed.Jun 6 2018, 3:00 PM

Since Turnilo has now officially replaced Pivot, it would be great to update the documentation on Wikitech (the main page at https://wikitech.wikimedia.org/wiki/Analytics/Systems/Pivot , and others where Pivot is mentioned).

• Nuria added a comment.Jun 6 2018, 4:00 PM

Added turnilo page: https://wikitech.wikimedia.org/wiki/Analytics/Systems/Turnilo

• Vvjjkkii reopened subtask T195819: Pageviews-daily broken after move from Pivot to Turnilo as Open.Jul 1 2018, 1:07 AM
• Vvjjkkii renamed this task from Deploy Turnilo (possible pivot replacement) to k6caaaaaaa.Jul 1 2018, 1:10 AM
• Vvjjkkii reopened this task as Open.
• Vvjjkkii removed Ottomata as the assignee of this task.
• Vvjjkkii raised the priority of this task from Medium to High.
• Vvjjkkii added projects: CheckUser, Connected-Open-Heritage-Batch-uploads (RAÄ-KMB_1_2017-02), Tamil-Sites, Gamepress, Hashtags, Jade, KartoEditor, Language-2018-Apr-June, New-Editor-Experiences, Mail, TCB-Team (now WMDE-TechWish).
• Vvjjkkii updated the task description. (Show Details)
• Vvjjkkii removed the point value for this task.
• Vvjjkkii removed subscribers: gerritbot, Aklapper.
CommunityTechBot closed subtask T195819: Pageviews-daily broken after move from Pivot to Turnilo as Resolved.Jul 2 2018, 3:08 AM
CommunityTechBot renamed this task from k6caaaaaaa to Deploy Turnilo (possible pivot replacement).Jul 2 2018, 3:15 PM
CommunityTechBot closed this task as Resolved.
CommunityTechBot assigned this task to Ottomata.
CommunityTechBot lowered the priority of this task from High to Medium.
CommunityTechBot set the point value for this task to 8.
CommunityTechBot updated the task description. (Show Details)
CommunityTechBot removed projects: TCB-Team (now WMDE-TechWish), Mail, New-Editor-Experiences, Language-2018-Apr-June, KartoEditor, Jade, Hashtags, Gamepress, Tamil-Sites, Connected-Open-Heritage-Batch-uploads (RAÄ-KMB_1_2017-02), CheckUser.
CommunityTechBot added subscribers: gerritbot, Aklapper.
Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL