Page MenuHomePhabricator
Create Task
Maniphest T101763

Cleanup Wikimetrics puppet module so it can run puppet continuously without own puppetmaster {dove} [21 pts]
Closed, ResolvedPublic
Actions

Description

Currently the puppet module is not idempotent, and so puppet is usually disabled and so running puppet ocassionally will cause a huge batch of issues that the wikimetrics team does not want to deal with (running your own puppetmaster is going to cause a lot of pain unless you are actually playing with puppet). Solution is to make the puppet module properly idempotent, and then it can run without having to be its own puppetmaster.

The plan is to move this to use puppet for infrastructure and fabric to automate deployment.

Details

SubjectRepoBranchLines +/-
wikimetrics: Puppet module for wikimetricsoperations/puppetproduction+216 -376
Customize query in gerrit

Related Objects
Search...

Event Timeline

yuvipanda created this task.Jun 8 2015, 7:56 PM
yuvipanda raised the priority of this task from to Needs Triage.
yuvipanda updated the task description. (Show Details)
yuvipanda added a project: Analytics-Wikimetrics.
yuvipanda subscribed.
Restricted Application added a subscriber: Aklapper. · View Herald TranscriptJun 8 2015, 7:56 PM
yuvipanda added a comment.Jun 8 2015, 8:02 PM

The current module can be moved as is to vagrant, and a different one (modeled after ORES, probably?) can be used for prod / labs puppet.

yuvipanda added a subscriber: Milimetric.Jun 8 2015, 11:35 PM
• madhuvishy renamed this task from Cleanup Wikimetrics puppet module so it can run puppet continuously without own puppetmaster to Cleanup Wikimetrics puppet module so it can run puppet continuously without own puppetmaster {dove}.Jul 18 2015, 7:07 PM
• madhuvishy claimed this task.
• madhuvishy triaged this task as Medium priority.
• madhuvishy updated the task description. (Show Details)
• madhuvishy added projects: Analytics-Kanban, Puppet.
• madhuvishy set Security to None.
• madhuvishy moved this task from Next Up to In Progress on the Analytics-Kanban board.
• madhuvishy moved this task from In Progress to Paused on the Analytics-Kanban board.Jul 22 2015, 3:32 PM
Milimetric moved this task from Paused to Next Up on the Analytics-Kanban board.Jul 28 2015, 3:47 PM
• madhuvishy edited projects, added Analytics-Backlog; removed Analytics-Kanban.Sep 14 2015, 4:03 PM
• madhuvishy lowered the priority of this task from Medium to Low.Sep 17 2015, 5:20 PM
• madhuvishy moved this task from Incoming to Prioritized on the Analytics-Backlog board.
yuvipanda added a comment.Dec 9 2015, 1:50 AM

Hello! After every time we change any fundamental settings (DNS, LDAP, puppetmaster, etc) it usually takes an hour or so of ops time to clean this up. After having said this verbally on IRC for many times, I am now officially declaring the wikimetrics and limn instances as unsupported. We'll add your keys to root, and then you're all on your own. Analytics has plenty of goodwill left for them in ops, just not for these 3 specific instances.

<3

Andrew awarded a token.Dec 9 2015, 1:53 AM
Krenair subscribed.Dec 9 2015, 1:55 AM
Legoktm subscribed.Dec 9 2015, 2:00 AM
Milimetric raised the priority of this task from Low to High.Dec 14 2015, 6:40 PM
Milimetric added a comment.Dec 15 2015, 5:56 PM
In T101763#1864407, @yuvipanda wrote:

Hello! After every time we change any fundamental settings (DNS, LDAP, puppetmaster, etc) it usually takes an hour or so of ops time to clean this up. After having said this verbally on IRC for many times, I am now officially declaring the wikimetrics and limn instances as unsupported. We'll add your keys to root, and then you're all on your own. Analytics has plenty of goodwill left for them in ops, just not for these 3 specific instances.

<3

Thanks, Yuvi. Should've done it a while ago, I think, sorry I didn't say so sooner.

Milimetric renamed this task from Cleanup Wikimetrics puppet module so it can run puppet continuously without own puppetmaster {dove} to Cleanup Wikimetrics puppet module so it can run puppet continuously without own puppetmaster {dove} [? pts].Dec 17 2015, 6:02 PM
Milimetric edited projects, added Analytics-Kanban; removed Analytics-Backlog.
• Nuria subscribed.Dec 22 2015, 6:17 PM

The goal of this task is to do enough changes so we can deploy wikimetrics with ease, rather than refactor whole wikimetrics setup.

• Nuria added a comment.Dec 22 2015, 6:32 PM

Things to do:

Move alembic and pip install, db creation, any server initialization, and config to fabric deployment

Infrastructure setup is done via puppet

How to deal with database passwords and other private config stuff (OAuth keys, etc)? move to /data/project
(so you can only access them if you have permits to machine)

Using Virtualenv for pip installs - make sure it works with celery-redis (celery and redis are fine separately)




Create a gerrit repo for wikimetrics-deploy






Testing on instance on different project, move dns proxy when done (use backup to move data)
• Nuria renamed this task from Cleanup Wikimetrics puppet module so it can run puppet continuously without own puppetmaster {dove} [? pts] to Cleanup Wikimetrics puppet module so it can run puppet continuously without own puppetmaster {dove} [21  pts].Dec 22 2015, 6:32 PM
• Nuria moved this task from Next Up to Paused on the Analytics-Kanban board.Jan 11 2016, 5:43 PM
• Nuria moved this task from Paused to In Progress on the Analytics-Kanban board.
gerritbot subscribed.Jan 13 2016, 1:24 AM
Change 260687 had a related patch set uploaded (by Madhuvishy):

wikimetrics: Puppet module for wikimetrics



https://gerrit.wikimedia.org/r/260687
gerritbot added a project: Patch-For-Review.Jan 13 2016, 1:24 AM
• madhuvishy moved this task from In Progress to In Code Review on the Analytics-Kanban board.Jan 13 2016, 1:26 AM
gerritbot added a comment.Jan 14 2016, 8:36 PM
Change 260687 merged by Yuvipanda:

wikimetrics: Puppet module for wikimetrics



https://gerrit.wikimedia.org/r/260687
• madhuvishy moved this task from In Code Review to Done on the Analytics-Kanban board.Jan 15 2016, 2:24 AM
• Nuria closed this task as Resolved.Jan 20 2016, 4:59 PM
• Nuria closed subtask T122228: Use fabric to deploy wikimetrics {dove} [13 pts] as Resolved.
• Phabricator_maintenance removed a subscriber: yuvipanda.Jun 7 2017, 6:50 PM
Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL