Page MenuHomePhabricator
Create Task
Maniphest T184561

Modernize Puppet Configuration Management (2017-18 Q3 Goal)
Closed, ResolvedPublic
Actions

Description

Main tracking task for 2017-18 Q3 goal Modernize Puppet configuration management:

  • Complete Puppet 4 agent upgrade on Ubuntu trusty hosts T182894
  • Upgrade PuppetDB to version 3.2 or newer T177253
  • Upgrade Puppet master infrastructure to Debian stretch T184562
  • Investigate landscape of PuppetDB frontends, and provision one T184563
  • Port Cumin to work with a newer PuppetDB API T182575
  • Investigate challenges and plan Puppet 5 upgrade T184564

Details

SubjectRepoBranchLines +/-
puppetmaster: adjust passenger pool sizeoperations/puppetproduction+4 -1
Remove non-authoritative SRV puppet recordsoperations/dnsmaster+0 -24
Customize query in gerrit

Related Objects
Search...

StatusSubtypeAssignedTask
 ResolvedjbondT184561 Modernize Puppet Configuration Management (2017-18 Q3 Goal)
 ResolvedfgiunchediT184562 Upgrade Puppet Master Infrastructure to Debian Stretch
 ResolvedfgiunchediT188623 Upgrade hiera to stretch (version 3)
 ResolvedfgiunchediT185215 Puppet compiler failure to lookup some keys
 ResolvedfgiunchediT189891 Failover puppet ca service from eqiad to codfw
 ResolvedVolansT184563 Investigate landscape of PuppetDB Frontends and Provision One
 ResolvedjbondT184564 Plan Puppet 5 upgrade
 ResolvedjbondT219803 upgrade facter and puppet across the fleet
 DeclinedjbondT221343 puppet fails to run in cp1008 under certain conditions
 OpenNoneT222160 facter3: use structured facts
 ResolvedjbondT222326 cronspam from smart-data-dump due to facter bug
 ResolvedjbondT222356 facter3: Unable to parse routing table
 ResolvedjbondT223938 facter 3: add timeout to custom facts external calls
 ResolvedjbondT227587 upgrade puppet master servers
 ResolvedjbondT227779 Hiera incompatible with newer versions of puppet
 ResolvedherronT182894 Trusty puppet 4 approach
 ResolvedherronT184017 Puppet - Error: /Stage[main]/Apparmor/Service[apparmor]: Provider init is not functional on this host
 ResolvedVolansT182575 Cumin: PuppetDB backend, add support for API v4
 ResolvedherronT177253 Upgrade PuppetDB to version 4.4
 ResolvedherronT185499 Build a pair of debian stretch PuppetDB servers
 ResolvedherronT185501 Add PuppetDB version selector (puppet/hiera)
 ResolvedherronT185500 Extend puppetmaster::puppetdb to support puppetlabs packaged puppetdb 4.4
 ResolvedherronT185502 Port puppetlabs PuppetDB 4.4 package to stretch
 Resolved• MoritzMuehlenhoffT187257 puppetdb4: systemd config review
 ResolvedherronT187258 puppetdb4: use postgres db backend in puppet-compiler
 ResolvedherronT187259 puppetdb4: upgrade puppetdbquery module
 ResolvedherronT188032 naggen2: support puppetdb 4 settings and api
 ResolvedherronT188544 compile/diff catalogs between puppetdb v2 (production) and puppetdb v4
 ResolvedfgiunchediT189516 Update jmx_exporter mbeans whitelist for puppetdb 4
 ResolvedfgiunchediT190252 Port puppetdb grafana dashboard to v4 metrics
 ResolvedVolansT190918 Puppet: enable reports to puppetdb

Event Timeline

herron triaged this task as Medium priority.Jan 9 2018, 9:50 PM
herron created this task.
Restricted Application added a subscriber: Aklapper. · View Herald TranscriptJan 9 2018, 9:50 PM
herron added a subtask: T182894: Trusty puppet 4 approach.Jan 9 2018, 9:55 PM
herron added subtasks: T182575: Cumin: PuppetDB backend, add support for API v4, T177253: Upgrade PuppetDB to version 4.4.
Paladox added projects: SRE, Puppet.Jan 9 2018, 9:57 PM
Paladox subscribed.
Volans added a project: Goal.Jan 9 2018, 10:42 PM
Volans updated the task description. (Show Details)Jan 9 2018, 10:48 PM
Volans added a subscriber: faidon.Jan 9 2018, 11:06 PM
Krenair subscribed.Jan 9 2018, 11:15 PM
Volans subscribed.Jan 15 2018, 10:00 AM
Volans closed subtask T182575: Cumin: PuppetDB backend, add support for API v4 as Resolved.Jan 22 2018, 4:51 PM
Volans updated the task description. (Show Details)
gerritbot subscribed.Mar 26 2018, 9:02 AM

Change 421839 had a related patch set uploaded (by Filippo Giunchedi; owner: Filippo Giunchedi):
[operations/dns@master] Remove non-authoritative SRV puppet records

https://gerrit.wikimedia.org/r/421839

gerritbot added a project: Patch-For-Review.Mar 26 2018, 9:02 AM
gerritbot added a comment.Mar 26 2018, 10:58 AM

Change 421860 had a related patch set uploaded (by Filippo Giunchedi; owner: Filippo Giunchedi):
[operations/puppet@production] [WIP] puppetmaster: adjust passenger pool size

https://gerrit.wikimedia.org/r/421860

gerritbot added a comment.Mar 26 2018, 1:49 PM

Change 421839 merged by Filippo Giunchedi:
[operations/dns@master] Remove non-authoritative SRV puppet records

https://gerrit.wikimedia.org/r/421839

Volans closed subtask T184563: Investigate landscape of PuppetDB Frontends and Provision One as Resolved.Mar 26 2018, 6:35 PM
Volans updated the task description. (Show Details)
fgiunchedi closed subtask T184562: Upgrade Puppet Master Infrastructure to Debian Stretch as Resolved.Mar 28 2018, 1:59 PM
fgiunchedi updated the task description. (Show Details)Mar 28 2018, 2:18 PM
herron closed subtask T177253: Upgrade PuppetDB to version 4.4 as Resolved.Mar 29 2018, 4:43 PM
herron updated the task description. (Show Details)
herron removed a project: Patch-For-Review.Apr 3 2018, 9:33 PM
herron updated the task description. (Show Details)
Volans closed subtask T190918: Puppet: enable reports to puppetdb as Resolved.Apr 4 2018, 10:04 AM
gerritbot added a comment.Apr 18 2018, 9:12 AM

Change 421860 merged by Filippo Giunchedi:
[operations/puppet@production] puppetmaster: adjust passenger pool size

https://gerrit.wikimedia.org/r/421860

• 238482n375 set Security to Software security bug.Jun 15 2018, 8:07 AM
• 238482n375 added a project: acl*security.
• 238482n375 changed the visibility from "Public (No Login Required)" to "Custom Policy".
• 238482n375 subscribed.
This comment was removed by Volans.
Volans removed a project: acl*security.Jun 15 2018, 8:45 AM
Volans changed the visibility from "Custom Policy" to "Public (No Login Required)".
Volans removed a subscriber: • 238482n375.
Restricted Application added a project: acl*security. · View Herald TranscriptJun 15 2018, 8:45 AM
Aklapper removed a project: acl*security.Jun 19 2018, 6:06 PM
• GTirloni subscribed.Oct 31 2018, 1:39 PM
• Phabricator_maintenance moved this task from Backlog to Acknowledged on the SRE board.Jan 26 2019, 9:41 PM
• GTirloni unsubscribed.Mar 21 2019, 9:11 PM
jbond closed this task as Resolved.Nov 7 2019, 5:36 PM
jbond claimed this task.
jbond closed subtask T184564: Plan Puppet 5 upgrade as Resolved.
jbond subscribed.

suspect this can be closed but reopen if im wrong

Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL · Credits