Page MenuHomePhabricator

OKR: Work required to prepare for puppet 6
Open, MediumPublic

Description

This task is in place so we can track the tasks required to prepare are systems for a move to puppet version 6. It is not envisaged that we will move to puppet6 untill at least bullseye is releases however we should try to get our code base to a level where the transition should be simple

  • update the current infrastructure to the latest 5.5 version T265139
  • update the puppet compiler T236373
  • migrate all cron types to systemd::timer::job (the cron type is no longer a native puppet type in puppet version6)
  • Check if which other native types need to be migrated
  • if still using nagios migrate to puppetlabs/nagios_core as nagios types are no longer core puppet
  • migrate any scripts away from deprecated CA functions and certificate authority api and subcommands
  • ensure manifests use the correct name space PUP-4242
  • Check if we prefer the chatty tidy behaviour PUP-8667
  • drop the pluginsync config PUP-8532
  • upgrade puppetdb servers
  • migrate puppet master away from webrick to clojure app PUP-8591
  • migrate puppet CA (likley the same work as moving to clojure) PUP-8912
  • update puppet agents
  • update CI jobs to have a minimum ruby version of 2.3. This implies no jessie agents
  • Remove any features or functions deprecated in puppet 5.5 (including hiera version3 and hiera_* functions)

Benefits to explore (some of theses benefits will be realized by updating to the latest 5.5 branch

Details

ProjectBranchLines +/-Subject
operations/puppetproduction+15 -3
operations/puppetproduction+7 -6
operations/puppetproduction+9 -0
operations/puppetproduction+11 -3
operations/puppetproduction+26 -24
operations/puppetproduction+0 -4
operations/puppetproduction+0 -3
operations/puppetproduction+0 -3
operations/puppetproduction+0 -3
operations/puppetproduction+1 -4
operations/puppetproduction+7 -6
operations/puppetproduction+15 -13
operations/puppetproduction+0 -18
operations/puppetproduction+15 -13
operations/puppetproduction+75 -91
operations/puppetproduction+15 -107
operations/puppetproduction+0 -7
operations/puppetproduction+25 -29
operations/puppetproduction+19 -13
operations/puppetproduction+17 -11
operations/puppetproduction+14 -7
operations/puppetproduction+14 -7
operations/puppetproduction+15 -7
Show related patches Customize query in gerrit

Event Timeline

jbond triaged this task as Medium priority.Oct 9 2020, 1:06 PM
jbond created this task.
Restricted Application added a subscriber: Aklapper. · View Herald TranscriptOct 9 2020, 1:06 PM
jbond updated the task description. (Show Details)Oct 9 2020, 1:12 PM
jbond updated the task description. (Show Details)Oct 9 2020, 1:34 PM
Reedy renamed this task from OKR: Worked required to prepare for puppet 6 to OKR: Work required to prepare for puppet 6.Oct 9 2020, 1:57 PM
jbond added a comment.EditedOct 9 2020, 2:02 PM

will move to puppet6 untill at least bullseye

Its worth noting that bullseye currently has puppet 5.5.19 (with sid on 5.5.21) its not clear if bullseye will ship with puppet6 and im unclear how we would progress if they don't. one options could be to hire external expertise to do the debian work on our behalf

Dzahn added a subscriber: Dzahn.Oct 9 2020, 3:25 PM

Change 635516 had a related patch set uploaded (by Jbond; owner: John Bond):
[operations/puppet@production] service_auto_restart: update to use systemd::timer:job instead of cron

https://gerrit.wikimedia.org/r/635516

Change 635517 had a related patch set uploaded (by Jbond; owner: John Bond):
[operations/puppet@production] service-auto-restart: clean up cron

https://gerrit.wikimedia.org/r/635517

Change 635516 merged by Jbond:
[operations/puppet@production] service_auto_restart: update to use systemd::timer:job instead of cron

https://gerrit.wikimedia.org/r/635516

Change 636401 had a related patch set uploaded (by Jbond; owner: John Bond):
[operations/puppet@production] smart: switch cron job to systemd::timer::job

https://gerrit.wikimedia.org/r/636401

Change 636402 had a related patch set uploaded (by Jbond; owner: John Bond):
[operations/puppet@production] smart: remove cron type

https://gerrit.wikimedia.org/r/636402

Change 636404 had a related patch set uploaded (by Jbond; owner: John Bond):
[operations/puppet@production] cumin: switch check-cumin-aliases to systemd::timer::job

https://gerrit.wikimedia.org/r/636404

Change 636405 had a related patch set uploaded (by Jbond; owner: John Bond):
[operations/puppet@production] cumin: remove cron type

https://gerrit.wikimedia.org/r/636405

Change 636401 merged by Jbond:
[operations/puppet@production] smart: switch cron job to systemd::timer::job

https://gerrit.wikimedia.org/r/636401

Change 636102 had a related patch set uploaded (by Jbond; owner: Dzahn):
[operations/puppet@production] cumin: replace check-aliases-cron with a systemd timer

https://gerrit.wikimedia.org/r/636102

Change 636404 abandoned by Jbond:
[operations/puppet@production] cumin: switch check-cumin-aliases to systemd::timer::job

Reason:
I997bca1659539a048e61346ee405125da8b915c6

https://gerrit.wikimedia.org/r/636404

Change 636408 had a related patch set uploaded (by Jbond; owner: John Bond):
[operations/puppet@production] prometheus_intel_microcode: update cron to systemd::timer::job

https://gerrit.wikimedia.org/r/636408

Change 636409 had a related patch set uploaded (by Jbond; owner: John Bond):
[operations/puppet@production] prometheus_intel_microcode: remove cron type

https://gerrit.wikimedia.org/r/636409

Change 636410 had a related patch set uploaded (by Jbond; owner: John Bond):
[operations/puppet@production] remote-backup-mariadb: update cron to systemd::timer::job

https://gerrit.wikimedia.org/r/636410

Change 636411 had a related patch set uploaded (by Jbond; owner: John Bond):
[operations/puppet@production] remote-backup-mariadb: remove cron type

https://gerrit.wikimedia.org/r/636411

Change 636408 merged by Jbond:
[operations/puppet@production] prometheus_intel_microcode: update cron to systemd::timer::job

https://gerrit.wikimedia.org/r/636408

Change 636410 merged by Jbond:
[operations/puppet@production] remote-backup-mariadb: update cron to systemd::timer::job

https://gerrit.wikimedia.org/r/636410

Change 636622 had a related patch set uploaded (by Jbond; owner: John Bond):
[operations/puppet@production] systemd::timer::job: add complex interval type checking

https://gerrit.wikimedia.org/r/636622

Change 636622 merged by Jbond:
[operations/puppet@production] systemd::timer::job: add complex interval type checking

https://gerrit.wikimedia.org/r/636622

Change 636628 had a related patch set uploaded (by Jbond; owner: John Bond):
[operations/puppet@production] systemd::timer::job: switch monitoring_enabled default to false

https://gerrit.wikimedia.org/r/636628

Change 636644 had a related patch set uploaded (by Jcrespo; owner: Jcrespo):
[operations/puppet@production] mariadb: Cleanup old cron deletions after some time after deploy

https://gerrit.wikimedia.org/r/636644

Change 636082 had a related patch set uploaded (by Dzahn; owner: Dzahn):
[operations/puppet@production] mirrors: replace cron jobs with systemd timers

https://gerrit.wikimedia.org/r/636082

Change 636104 had a related patch set uploaded (by Dzahn; owner: Dzahn):
[operations/puppet@production] puppetmaster: replace cron to remove old reports with systemd timer

https://gerrit.wikimedia.org/r/636104

Change 636105 had a related patch set uploaded (by Dzahn; owner: Dzahn):
[operations/puppet@production] planet: replace update cron jobs with systemd timers

https://gerrit.wikimedia.org/r/636105

Change 636087 had a related patch set uploaded (by Dzahn; owner: Dzahn):
[operations/puppet@production] dumps: rm profile::dumps::distribution::datasets::cleanup_miscdatasets

https://gerrit.wikimedia.org/r/636087

Change 633857 had a related patch set uploaded (by Dzahn; owner: Dzahn):
[operations/puppet@production] gerrit: replace cron jobs with systemd timers (WIP)

https://gerrit.wikimedia.org/r/633857

Change 636628 merged by Jbond:
[operations/puppet@production] systemd::timer::job: switch monitoring_enabled default to false

https://gerrit.wikimedia.org/r/636628

Change 633857 merged by Dzahn:
[operations/puppet@production] gerrit: replace clear_gerrit_logs cron job with systemd timer

https://gerrit.wikimedia.org/r/633857

Change 637037 had a related patch set uploaded (by Dzahn; owner: Dzahn):
[operations/puppet@production] mailman: replace cron with systemd timer

https://gerrit.wikimedia.org/r/637037

Change 637038 had a related patch set uploaded (by Dzahn; owner: Dzahn):
[operations/puppet@production] OTRS: replace cron with systemd timer

https://gerrit.wikimedia.org/r/637038

Change 636087 merged by Bstorm:
[operations/puppet@production] dumps: rm profile::dumps::distribution::datasets::cleanup_miscdatasets

https://gerrit.wikimedia.org/r/636087

ssingh added a subscriber: ssingh.Thu, Oct 29, 7:59 PM

Change 636405 abandoned by Jbond:
[operations/puppet@production] cumin: remove cron type

Reason:

https://gerrit.wikimedia.org/r/636405

Change 636411 merged by Jbond:
[operations/puppet@production] remote-backup-mariadb: remove cron type

https://gerrit.wikimedia.org/r/636411

Change 636409 merged by Jbond:
[operations/puppet@production] prometheus_intel_microcode: remove cron type

https://gerrit.wikimedia.org/r/636409

Change 636402 merged by Jbond:
[operations/puppet@production] smart: remove cron type

https://gerrit.wikimedia.org/r/636402

Change 635517 merged by Jbond:
[operations/puppet@production] service-auto-restart: clean up cron

https://gerrit.wikimedia.org/r/635517

Change 636105 merged by Dzahn:
[operations/puppet@production] planet: replace update cron jobs with systemd timers

https://gerrit.wikimedia.org/r/636105

Mentioned in SAL (#wikimedia-operations) [2020-11-16T20:40:06Z] <mutante> planet1002/planet2002 - delete entire crontab of user planet, drop update cronjobs after switching to systemd timers with gerrit:636105 (T265138)

Change 636102 merged by Dzahn:
[operations/puppet@production] cumin: replace check-aliases-cron with a systemd timer

https://gerrit.wikimedia.org/r/636102

Mentioned in SAL (#wikimedia-operations) [2020-11-16T23:28:44Z] <mutante> cumin1001 - sudo systemctl start cumin-check-aliases (to confirm switching cron to timer worked) T265138

Change 641315 had a related patch set uploaded (by Dzahn; owner: Dzahn):
[operations/puppet@production] aptrepo: replace cron with systemd timer

https://gerrit.wikimedia.org/r/641315

Change 637038 merged by Dzahn:
[operations/puppet@production] OTRS: replace cron with systemd timer

https://gerrit.wikimedia.org/r/637038

Mentioned in SAL (#wikimedia-operations) [2020-11-17T22:07:15Z] <mutante> otrs1001 - removing otrs-cache-cleanup cron from otrs's crontab - adding same command as systemd timer. gerrit:637038 T265138

Change 641579 had a related patch set uploaded (by Dzahn; owner: Dzahn):
[operations/puppet@production] planet: let systemd timer for each language run at random minute

https://gerrit.wikimedia.org/r/641579

Change 641579 merged by Dzahn:
[operations/puppet@production] planet: let systemd timer for each language run at random minute

https://gerrit.wikimedia.org/r/641579

jbond moved this task from Unsorted 💣 to Active 🚁 on the User-jbond board.Fri, Nov 20, 11:33 AM