Page MenuHomePhabricator
Create Task
Maniphest T342214

update systems to use new puppetdb instance
Closed, ResolvedPublic
Actions

Description

Now that the puppetdb 7 is being populated we should move the services which use puppetdb to the new instance. specifically

  • cumin
  • spicerack
    • tested sre.host.reimage
  • netbox
  • puppetboard

Details

SubjectRepoBranchLines +/-
os-reports: Stop configuring a puppetdb server and switch to discovery recordoperations/puppetproduction+12 -19
Move os-reports to the puppetdb host(s)operations/puppetproduction+15 -27
puppetdb: add a motd to inform users that theses serveres are no longer liveoperations/puppetproduction+7 -0
puppetmaster: update to use new puppetdb serversoperations/puppetproduction+6 -14
puppetmaster: add parameter to change the port that puppetdb runsoperations/puppetproduction+5 -0
puppetdb-api: switch dev sevices back to puppetdb-apioperations/puppetproduction+2 -2
puppetdb-api: swap the production and next environmentsoperations/puppetproduction+4 -4
cumin::unprivmaster: Test using puppetdbapi-nextoperations/puppetproduction+4 -2
DO NOT MERGE: Change to test new puppetdb-api-nextoperations/cookbooksmaster+1 -1
proifile::puppetdb::microservice: add allowed_rolesoperations/puppetproduction+27 -27
sre.discovery.datacenter: exclude puppetdb-api-nextoperations/cookbooksmaster+1 -0
netbox::standalone: switch to using new puppetdb apioperations/puppetproduction+1 -0
netbox: actully use puppetdb_microservice_fqdnoperations/puppetproduction+1 -1
netbox: drop pupetdb_host as its not usedoperations/puppetproduction+0 -3
netbox: make the puppetdb microservic domain configurableoperations/puppetproduction+9 -2
puppetdb::microservice: add -next domainoperations/puppetproduction+1 -1
puppetdb-api-next: add new discovery record for testing puppetdb-apioperations/dnsmaster+2 -0
puppetdb-api-next: Add new puppetdb-api discovery recordoperations/puppetproduction+24 -1
puppetdb: add allow-header-cert-info: true to auth.confoperations/puppetproduction+2 -0
puppetdb: Set X-Client headersoperations/puppetproduction+3 -0
puppetboard: add -next domain to tls certsoperations/puppetproduction+1 -0
services: swap puppetboard and puppetboard-nextoperations/puppetproduction+4 -5
Show related patches Customize query in gerrit

Related Objects
Search...

StatusSubtypeAssignedTask
 OpenNoneT330490 Next steps for Puppet 7
 ResolvedjbondT342214 update systems to use new puppetdb instance

Event Timeline

jbond changed the task status from Open to In Progress.Jul 19 2023, 10:29 AM
jbond triaged this task as Medium priority.
jbond created this task.
gerritbot added a comment.Jul 19 2023, 10:48 AM

Change 939655 had a related patch set uploaded (by Jbond; author: jbond):

[operations/puppet@production] services: swap puppetboard and puppetboard-next

https://gerrit.wikimedia.org/r/939655

gerritbot added a project: Patch-For-Review.Jul 19 2023, 10:48 AM
gerritbot added a comment.Jul 19 2023, 12:14 PM

Change 939655 merged by Jbond:

[operations/puppet@production] services: swap puppetboard and puppetboard-next

https://gerrit.wikimedia.org/r/939655

gerritbot added a comment.Jul 19 2023, 12:19 PM

Change 939675 had a related patch set uploaded (by Jbond; author: jbond):

[operations/puppet@production] puppetboard: add -next domain to tls certs

https://gerrit.wikimedia.org/r/939675

gerritbot added a comment.Jul 19 2023, 12:20 PM

Change 939675 merged by Jbond:

[operations/puppet@production] puppetboard: add -next domain to tls certs

https://gerrit.wikimedia.org/r/939675

Maintenance_bot removed a project: Patch-For-Review.Jul 19 2023, 12:29 PM
gerritbot added a comment.Jul 19 2023, 12:36 PM

Change 939678 had a related patch set uploaded (by Jbond; author: jbond):

[operations/dns@master] puppetdb-api-next: add new discovery record for testing puppetdb-api

https://gerrit.wikimedia.org/r/939678

gerritbot added a project: Patch-For-Review.Jul 19 2023, 12:36 PM
gerritbot added a comment.Jul 19 2023, 12:40 PM

Change 939679 had a related patch set uploaded (by Jbond; author: jbond):

[operations/puppet@production] puppetdb-api-next: Add new puppetdb-api discovery record

https://gerrit.wikimedia.org/r/939679

gerritbot added a comment.Jul 19 2023, 1:21 PM

Change 939685 had a related patch set uploaded (by Jbond; author: jbond):

[operations/puppet@production] puppetdb: Set X-Client headers

https://gerrit.wikimedia.org/r/939685

gerritbot added a comment.Jul 19 2023, 1:23 PM

Change 939685 merged by Jbond:

[operations/puppet@production] puppetdb: Set X-Client headers

https://gerrit.wikimedia.org/r/939685

gerritbot added a comment.Jul 19 2023, 1:29 PM

Change 939689 had a related patch set uploaded (by Jbond; author: jbond):

[operations/puppet@production] puppetdb: add allow-header-cert-info: true to auth.conf

https://gerrit.wikimedia.org/r/939689

gerritbot added a comment.Jul 19 2023, 1:32 PM

Change 939689 merged by Jbond:

[operations/puppet@production] puppetdb: add allow-header-cert-info: true to auth.conf

https://gerrit.wikimedia.org/r/939689

gerritbot added a comment.Jul 19 2023, 1:52 PM

Change 939679 merged by Jbond:

[operations/puppet@production] puppetdb-api-next: Add new puppetdb-api discovery record

https://gerrit.wikimedia.org/r/939679

gerritbot added a comment.Jul 19 2023, 1:56 PM

Change 939678 merged by Jbond:

[operations/dns@master] puppetdb-api-next: add new discovery record for testing puppetdb-api

https://gerrit.wikimedia.org/r/939678

gerritbot added a comment.Jul 19 2023, 2:00 PM

Change 939698 had a related patch set uploaded (by Jbond; author: jbond):

[operations/puppet@production] puppetdb::microservice: add -next domain

https://gerrit.wikimedia.org/r/939698

jbond updated the task description. (Show Details)Jul 19 2023, 2:01 PM
gerritbot added a comment.Jul 19 2023, 2:03 PM

Change 939698 merged by Jbond:

[operations/puppet@production] puppetdb::microservice: add -next domain

https://gerrit.wikimedia.org/r/939698

Maintenance_bot removed a project: Patch-For-Review.Jul 19 2023, 2:11 PM
gerritbot added a comment.Jul 19 2023, 2:21 PM

Change 939706 had a related patch set uploaded (by Jbond; author: jbond):

[operations/puppet@production] netbox: make the puppetdb microservic domain configurable

https://gerrit.wikimedia.org/r/939706

gerritbot added a project: Patch-For-Review.Jul 19 2023, 2:21 PM
gerritbot added a comment.Jul 19 2023, 2:25 PM

Change 939709 had a related patch set uploaded (by Jbond; author: jbond):

[operations/puppet@production] netbox: drop pupetdb_host as its not used

https://gerrit.wikimedia.org/r/939709

gerritbot added a comment.Jul 19 2023, 2:29 PM

Change 939706 merged by Jbond:

[operations/puppet@production] netbox: make the puppetdb microservic domain configurable

https://gerrit.wikimedia.org/r/939706

gerritbot added a comment.Jul 19 2023, 2:29 PM

Change 939709 merged by Jbond:

[operations/puppet@production] netbox: drop pupetdb_host as its not used

https://gerrit.wikimedia.org/r/939709

Maintenance_bot removed a project: Patch-For-Review.Jul 19 2023, 2:31 PM
gerritbot added a comment.Jul 19 2023, 2:32 PM

Change 939710 had a related patch set uploaded (by Jbond; author: jbond):

[operations/puppet@production] netbox::standalone: switch to using new puppetdb api

https://gerrit.wikimedia.org/r/939710

gerritbot added a project: Patch-For-Review.Jul 19 2023, 2:32 PM
gerritbot added a comment.Jul 19 2023, 2:36 PM

Change 939712 had a related patch set uploaded (by Jbond; author: jbond):

[operations/puppet@production] netbox: actully use puppetdb_microservice_fqdn

https://gerrit.wikimedia.org/r/939712

gerritbot added a comment.Jul 19 2023, 2:39 PM

Change 939712 merged by Jbond:

[operations/puppet@production] netbox: actully use puppetdb_microservice_fqdn

https://gerrit.wikimedia.org/r/939712

gerritbot added a comment.Jul 19 2023, 2:43 PM

Change 939710 merged by Jbond:

[operations/puppet@production] netbox::standalone: switch to using new puppetdb api

https://gerrit.wikimedia.org/r/939710

jbond added a comment.EditedJul 19 2023, 3:10 PM

for puppetdb-api. i have updated netbox-next and tested the following:

Reports

scripts

Maintenance_bot removed a project: Patch-For-Review.Jul 19 2023, 3:10 PM
gerritbot added a comment.Jul 19 2023, 3:15 PM

Change 939725 had a related patch set uploaded (by Jbond; author: jbond):

[operations/cookbooks@master] sre.discovery.datacenter: exclude puppetdb-api-next

https://gerrit.wikimedia.org/r/939725

gerritbot added a project: Patch-For-Review.Jul 19 2023, 3:15 PM
gerritbot added a comment.Jul 19 2023, 3:19 PM

Change 939726 had a related patch set uploaded (by Jbond; author: jbond):

[operations/cookbooks@master] DO NOT MERGE: Change to test new puppetdb-api-next

https://gerrit.wikimedia.org/r/939726

ops-monitoring-bot added a comment.Jul 19 2023, 3:23 PM

Cookbook cookbooks.sre.hosts.reimage was started by jbond@cumin1001 for host sretest1002.eqiad.wmnet with OS bullseye

ops-monitoring-bot added a comment.Jul 19 2023, 3:44 PM

Cookbook cookbooks.sre.hosts.reimage started by jbond@cumin1001 for host sretest1002.eqiad.wmnet with OS bullseye executed with errors:

  • sretest1002 (FAIL)
    • Downtimed on Icinga/Alertmanager
    • Disabled Puppet
    • Removed from Puppet and PuppetDB if present
    • Deleted any existing Puppet certificate
    • Removed from Debmonitor if present
    • Forced PXE for next reboot
    • Host rebooted via IPMI
    • Host up (Debian installer)
    • Checked BIOS boot parameters are back to normal
    • Host up (new fresh bullseye OS)
    • Generated Puppet certificate
    • Signed new Puppet certificate
    • Run Puppet in NOOP mode to populate exported resources in PuppetDB
    • The reimage failed, see the cookbook logs for the details
gerritbot added a comment.Jul 20 2023, 9:30 AM

Change 939725 merged by jenkins-bot:

[operations/cookbooks@master] sre.discovery.datacenter: exclude puppetdb-api-next

https://gerrit.wikimedia.org/r/939725

gerritbot added a comment.Jul 20 2023, 11:05 AM

Change 939741 had a related patch set uploaded (by Jbond; author: jbond):

[operations/puppet@production] proifile::puppetdb::microservice: add allowed_roles

https://gerrit.wikimedia.org/r/939741

gerritbot added a comment.Jul 20 2023, 11:22 AM

Change 939741 merged by Jbond:

[operations/puppet@production] proifile::puppetdb::microservice: add allowed_roles

https://gerrit.wikimedia.org/r/939741

ops-monitoring-bot added a comment.Jul 20 2023, 12:24 PM

Cookbook cookbooks.sre.hosts.reimage was started by jbond@cumin1001 for host sretest1002.eqiad.wmnet with OS bullseye

ops-monitoring-bot added a comment.Jul 20 2023, 12:43 PM

Cookbook cookbooks.sre.hosts.reimage started by jbond@cumin1001 for host sretest1002.eqiad.wmnet with OS bullseye executed with errors:

  • sretest1002 (FAIL)
    • Downtimed on Icinga/Alertmanager
    • Unable to disable Puppet, the host may have been unreachable
    • Removed from Puppet and PuppetDB if present
    • Deleted any existing Puppet certificate
    • Removed from Debmonitor if present
    • Forced PXE for next reboot
    • Host rebooted via IPMI
    • The reimage failed, see the cookbook logs for the details
ops-monitoring-bot added a comment.Jul 20 2023, 12:43 PM

Cookbook cookbooks.sre.hosts.reimage was started by jbond@cumin1001 for host sretest1002.eqiad.wmnet with OS bullseye

ops-monitoring-bot added a comment.Jul 20 2023, 12:56 PM

Cookbook cookbooks.sre.hosts.reimage started by jbond@cumin1001 for host sretest1002.eqiad.wmnet with OS bullseye executed with errors:

  • sretest1002 (FAIL)
    • Removed from Puppet and PuppetDB if present
    • Deleted any existing Puppet certificate
    • Removed from Debmonitor if present
    • Forced PXE for next reboot
    • Host rebooted via IPMI
    • Host up (Debian installer)
    • Checked BIOS boot parameters are back to normal
    • Host up (new fresh bullseye OS)
    • Generated Puppet certificate
    • Signed new Puppet certificate
    • Run Puppet in NOOP mode to populate exported resources in PuppetDB
    • The reimage failed, see the cookbook logs for the details
ops-monitoring-bot added a comment.Jul 20 2023, 1:00 PM

Cookbook cookbooks.sre.hosts.reimage was started by jbond@cumin1001 for host sretest1002.eqiad.wmnet with OS bullseye

ops-monitoring-bot added a comment.Jul 20 2023, 1:12 PM

Cookbook cookbooks.sre.hosts.reimage started by jbond@cumin1001 for host sretest1002.eqiad.wmnet with OS bullseye executed with errors:

  • sretest1002 (FAIL)
    • Downtimed on Icinga/Alertmanager
    • Unable to disable Puppet, the host may have been unreachable
    • Removed from Puppet and PuppetDB if present
    • Deleted any existing Puppet certificate
    • Removed from Debmonitor if present
    • Forced PXE for next reboot
    • Host rebooted via IPMI
    • The reimage failed, see the cookbook logs for the details
ops-monitoring-bot added a comment.Jul 20 2023, 1:17 PM

Cookbook cookbooks.sre.hosts.reimage was started by jbond@cumin1001 for host sretest1002.eqiad.wmnet with OS bullseye

ops-monitoring-bot added a comment.Jul 20 2023, 2:01 PM

Cookbook cookbooks.sre.hosts.reimage started by jbond@cumin1001 for host sretest1002.eqiad.wmnet with OS bullseye executed with errors:

  • sretest1002 (FAIL)
    • Removed from Puppet and PuppetDB if present
    • Deleted any existing Puppet certificate
    • Removed from Debmonitor if present
    • Forced PXE for next reboot
    • Host rebooted via IPMI
    • Host up (Debian installer)
    • Checked BIOS boot parameters are back to normal
    • Host up (new fresh bullseye OS)
    • Generated Puppet certificate
    • Signed new Puppet certificate
    • Run Puppet in NOOP mode to populate exported resources in PuppetDB
    • The reimage failed, see the cookbook logs for the details
ops-monitoring-bot added a comment.Jul 20 2023, 2:14 PM

Cookbook cookbooks.sre.hosts.reimage was started by jbond@cumin1001 for host sretest1002.eqiad.wmnet with OS bullseye

ops-monitoring-bot added a comment.Jul 20 2023, 3:06 PM

Cookbook cookbooks.sre.hosts.reimage started by jbond@cumin1001 for host sretest1002.eqiad.wmnet with OS bullseye executed with errors:

  • sretest1002 (FAIL)
    • Downtimed on Icinga/Alertmanager
    • Unable to disable Puppet, the host may have been unreachable
    • Removed from Puppet and PuppetDB if present
    • Deleted any existing Puppet certificate
    • Removed from Debmonitor if present
    • Forced PXE for next reboot
    • Host rebooted via IPMI
    • Host up (Debian installer)
    • Checked BIOS boot parameters are back to normal
    • Host up (new fresh bullseye OS)
    • Generated Puppet certificate
    • Signed new Puppet certificate
    • Run Puppet in NOOP mode to populate exported resources in PuppetDB
    • The reimage failed, see the cookbook logs for the details
ops-monitoring-bot added a comment.Jul 20 2023, 3:07 PM

Cookbook cookbooks.sre.hosts.reimage was started by jbond@cumin1001 for host sretest1002.eqiad.wmnet with OS bullseye

ops-monitoring-bot added a comment.Jul 20 2023, 3:20 PM

Cookbook cookbooks.sre.hosts.reimage started by jbond@cumin1001 for host sretest1002.eqiad.wmnet with OS bullseye executed with errors:

  • sretest1002 (FAIL)
    • Downtimed on Icinga/Alertmanager
    • Unable to disable Puppet, the host may have been unreachable
    • Removed from Puppet and PuppetDB if present
    • Deleted any existing Puppet certificate
    • Removed from Debmonitor if present
    • Forced PXE for next reboot
    • Host rebooted via IPMI
    • Host up (Debian installer)
    • Checked BIOS boot parameters are back to normal
    • Host up (new fresh bullseye OS)
    • Generated Puppet certificate
    • Signed new Puppet certificate
    • Run Puppet in NOOP mode to populate exported resources in PuppetDB
    • The reimage failed, see the cookbook logs for the details
ops-monitoring-bot added a comment.Jul 20 2023, 3:46 PM

Cookbook cookbooks.sre.hosts.reimage was started by jbond@cumin1001 for host sretest1002.eqiad.wmnet with OS bullseye

ops-monitoring-bot added a comment.Jul 20 2023, 4:21 PM

Cookbook cookbooks.sre.hosts.reimage started by jbond@cumin1001 for host sretest1002.eqiad.wmnet with OS bullseye completed:

  • sretest1002 (WARN)
    • Downtimed on Icinga/Alertmanager
    • Unable to disable Puppet, the host may have been unreachable
    • Removed from Puppet and PuppetDB if present
    • Deleted any existing Puppet certificate
    • Removed from Debmonitor if present
    • Forced PXE for next reboot
    • Host rebooted via IPMI
    • Host up (Debian installer)
    • Checked BIOS boot parameters are back to normal
    • Host up (new fresh bullseye OS)
    • Generated Puppet certificate
    • Signed new Puppet certificate
    • Run Puppet in NOOP mode to populate exported resources in PuppetDB
    • Found Nagios_host resource for this host in PuppetDB
    • Downtimed the new host on Icinga/Alertmanager
    • Removed previous downtime on Alertmanager (old OS)
    • First Puppet run completed and logged in /var/log/spicerack/sre/hosts/reimage/202307201605_jbond_2598166_sretest1002.out
    • configmaster.wikimedia.org updated with the host new SSH public key for wmf-update-known-hosts-production
    • Rebooted
    • Automatic Puppet run was successful
    • Forced a re-check of all Icinga services for the host
    • Icinga status is optimal
    • Icinga downtime removed
    • Updated Netbox data from PuppetDB
ops-monitoring-bot added a comment.Jul 20 2023, 4:38 PM

Cookbook cookbooks.sre.hosts.reimage was started by jbond@cumin1001 for host sretest1002.eqiad.wmnet with OS bullseye

ops-monitoring-bot added a comment.Jul 20 2023, 4:52 PM

Cookbook cookbooks.sre.hosts.reimage started by jbond@cumin1001 for host sretest1002.eqiad.wmnet with OS bullseye executed with errors:

  • sretest1002 (FAIL)
    • Downtimed on Icinga/Alertmanager
    • Disabled Puppet
    • Removed from Puppet and PuppetDB if present
    • Deleted any existing Puppet certificate
    • Removed from Debmonitor if present
    • Forced PXE for next reboot
    • Host rebooted via IPMI
    • Host up (Debian installer)
    • Checked BIOS boot parameters are back to normal
    • Host up (new fresh bullseye OS)
    • Generated Puppet certificate
    • Signed new Puppet certificate
    • Run Puppet in NOOP mode to populate exported resources in PuppetDB
    • The reimage failed, see the cookbook logs for the details
gerritbot added a comment.Jul 20 2023, 4:59 PM

Change 939726 abandoned by Jbond:

[operations/cookbooks@master] DO NOT MERGE: Change to test new puppetdb-api-next

Reason:

abanoned, confirmed working

https://gerrit.wikimedia.org/r/939726

gerritbot added a comment.Jul 20 2023, 5:03 PM

Change 939726 restored by Jbond:

[operations/cookbooks@master] DO NOT MERGE: Change to test new puppetdb-api-next

https://gerrit.wikimedia.org/r/939726

ops-monitoring-bot added a comment.Jul 20 2023, 5:09 PM

Cookbook cookbooks.sre.hosts.reimage was started by jbond@cumin1001 for host sretest1002.eqiad.wmnet with OS bullseye

ops-monitoring-bot added a comment.Jul 20 2023, 5:41 PM

Cookbook cookbooks.sre.hosts.reimage started by jbond@cumin1001 for host sretest1002.eqiad.wmnet with OS bullseye completed:

  • sretest1002 (WARN)
    • Downtimed on Icinga/Alertmanager
    • Unable to disable Puppet, the host may have been unreachable
    • Removed from Puppet and PuppetDB if present
    • Deleted any existing Puppet certificate
    • Removed from Debmonitor if present
    • Forced PXE for next reboot
    • Host rebooted via IPMI
    • Host up (Debian installer)
    • Checked BIOS boot parameters are back to normal
    • Host up (new fresh bullseye OS)
    • Generated Puppet certificate
    • Signed new Puppet certificate
    • Run Puppet in NOOP mode to populate exported resources in PuppetDB
    • Found Nagios_host resource for this host in PuppetDB
    • Downtimed the new host on Icinga/Alertmanager
    • Removed previous downtime on Alertmanager (old OS)
    • First Puppet run completed and logged in /var/log/spicerack/sre/hosts/reimage/202307201725_jbond_2620913_sretest1002.out
    • configmaster.wikimedia.org updated with the host new SSH public key for wmf-update-known-hosts-production
    • Rebooted
    • Automatic Puppet run was successful
    • Forced a re-check of all Icinga services for the host
    • Icinga status is optimal
    • Icinga downtime removed
    • Updated Netbox data from PuppetDB
jbond updated the task description. (Show Details)Jul 21 2023, 3:43 PM
gerritbot added a comment.Jul 21 2023, 3:48 PM

Change 940384 had a related patch set uploaded (by Jbond; author: jbond):

[operations/puppet@production] puppetdb-api: swap the production and next environments

https://gerrit.wikimedia.org/r/940384

gerritbot added a comment.Jul 21 2023, 5:20 PM

Change 940396 had a related patch set uploaded (by Jbond; author: jbond):

[operations/puppet@production] cumin::unprivmaster: Test using puppetdbapi-next

https://gerrit.wikimedia.org/r/940396

gerritbot added a comment.Jul 21 2023, 5:32 PM

Change 940396 merged by Jbond:

[operations/puppet@production] cumin::unprivmaster: Test using puppetdbapi-next

https://gerrit.wikimedia.org/r/940396

gerritbot added a comment.Aug 31 2023, 1:35 PM

Change 940384 merged by Jbond:

[operations/puppet@production] puppetdb-api: swap the production and next environments

https://gerrit.wikimedia.org/r/940384

jbond closed this task as Resolved.Sep 4 2023, 11:16 AM
jbond claimed this task.
jbond updated the task description. (Show Details)

This is now in place

gerritbot added a comment.Sep 4 2023, 11:19 AM

Change 954622 had a related patch set uploaded (by Jbond; author: jbond):

[operations/puppet@production] puppetmaster: update to use new puppetdb servers

https://gerrit.wikimedia.org/r/954622

gerritbot added a comment.Sep 4 2023, 11:21 AM

Change 954647 had a related patch set uploaded (by Jbond; author: jbond):

[operations/puppet@production] puppetdb-api: switch dev sevices back to puppetdb-api

https://gerrit.wikimedia.org/r/954647

gerritbot added a comment.Sep 4 2023, 12:13 PM

Change 954669 had a related patch set uploaded (by Jbond; author: jbond):

[operations/puppet@production] puppetmaster: add parameter to change the port that puppetdb runs

https://gerrit.wikimedia.org/r/954669

gerritbot added a comment.Sep 4 2023, 12:17 PM

Change 954647 merged by Jbond:

[operations/puppet@production] puppetdb-api: switch dev sevices back to puppetdb-api

https://gerrit.wikimedia.org/r/954647

gerritbot added a comment.Sep 4 2023, 12:19 PM

Change 954669 merged by Jbond:

[operations/puppet@production] puppetmaster: add parameter to change the port that puppetdb runs

https://gerrit.wikimedia.org/r/954669

gerritbot added a comment.Sep 6 2023, 9:36 AM

Change 954622 merged by Jbond:

[operations/puppet@production] puppetmaster: update to use new puppetdb servers

https://gerrit.wikimedia.org/r/954622

gerritbot added a comment.Sep 6 2023, 9:59 AM

Change 955303 had a related patch set uploaded (by Jbond; author: jbond):

[operations/puppet@production] puppetdb: add a motd to inform users that theses serveres are no longer live

https://gerrit.wikimedia.org/r/955303

gerritbot added a comment.Sep 6 2023, 10:23 AM

Change 955303 merged by Jbond:

[operations/puppet@production] puppetdb: add a motd to inform users that theses serveres are no longer live

https://gerrit.wikimedia.org/r/955303

ops-monitoring-bot added a comment.Sep 12 2023, 10:05 AM

Icinga downtime and Alertmanager silence (ID=90305a26-47b2-42a2-abe5-284f8035bf3b) set by jmm@cumin2002 for 3 days, 0:00:00 on 1 host(s) and their services with reason: Disable puppetdb/postgres on old nodes to ensure nothing hits them anyway

puppetdb1002.eqiad.wmnet
ops-monitoring-bot added a comment.Sep 12 2023, 10:09 AM

Icinga downtime and Alertmanager silence (ID=2af641c9-48a3-42b7-8c75-56c12506718a) set by jmm@cumin2002 for 3 days, 0:00:00 on 1 host(s) and their services with reason: Disable puppetdb/postgres/nginx on old nodes to ensure nothing hits them anyway

puppetdb2002.codfw.wmnet
ops-monitoring-bot added a comment.Sep 20 2023, 8:16 AM

Icinga downtime and Alertmanager silence (ID=11ec6d55-6d8f-4537-a398-4863d7f38c9c) set by jmm@cumin2002 for 5 days, 0:00:00 on 1 host(s) and their services with reason: Disable puppetdb/postgres/nginx on old nodes to ensure nothing hits them anyway

puppetdb2002.codfw.wmnet
ops-monitoring-bot added a comment.Sep 20 2023, 8:17 AM

Icinga downtime and Alertmanager silence (ID=708cd0d4-307e-4f35-acfa-ddae4ae88236) set by jmm@cumin2002 for 5 days, 0:00:00 on 1 host(s) and their services with reason: Disable puppetdb/postgres/nginx on old nodes to ensure nothing hits them anyway

puppetdb1002.eqiad.wmnet
gerritbot added a comment.Sep 21 2023, 9:57 AM

Change 959696 had a related patch set uploaded (by Muehlenhoff; author: Muehlenhoff):

[operations/puppet@production] os-reports: Stop configuring a puppetdb server and switch to discovery record

https://gerrit.wikimedia.org/r/959696

gerritbot added a comment.Sep 22 2023, 10:46 AM

Change 960015 had a related patch set uploaded (by Muehlenhoff; author: Muehlenhoff):

[operations/puppet@production] Move os-reports to the puppetdb host(s)

https://gerrit.wikimedia.org/r/960015

gerritbot added a comment.Sep 22 2023, 11:22 AM

Change 960015 merged by Muehlenhoff:

[operations/puppet@production] Move os-reports to the puppetdb host(s)

https://gerrit.wikimedia.org/r/960015

gerritbot added a comment.Sep 22 2023, 12:36 PM

Change 959696 abandoned by Muehlenhoff:

[operations/puppet@production] os-reports: Stop configuring a puppetdb server and switch to discovery record

Reason:

Obsoleted by https://gerrit.wikimedia.org/r/c/operations/puppet/+/960015

https://gerrit.wikimedia.org/r/959696

ops-monitoring-bot added a comment.Sep 25 2023, 9:43 AM

Icinga downtime and Alertmanager silence (ID=73525cca-1535-4d44-89d8-fcd584ea67a9) set by jmm@cumin2002 for 5 days, 0:00:00 on 1 host(s) and their services with reason: Disable puppetdb/postgres/nginx on old nodes to ensure nothing hits them anyway

puppetdb1002.eqiad.wmnet
ops-monitoring-bot added a comment.Sep 25 2023, 9:43 AM

Icinga downtime and Alertmanager silence (ID=69921077-8a56-48de-9905-0d3d1b91d292) set by jmm@cumin2002 for 5 days, 0:00:00 on 1 host(s) and their services with reason: Disable puppetdb/postgres/nginx on old nodes to ensure nothing hits them anyway

puppetdb2002.codfw.wmnet
Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL