Page MenuHomePhabricator
Create Task
Maniphest T234315

upgrade puppet master frontends servers
Closed, ResolvedPublic
Actions

Description

upgrade puppetmaster1001 and 2001

Details

SubjectRepoBranchLines +/-
puppetmaster: offline rhodiumoperations/puppetproduction+1 -1
pybal_config: remove puppetmaster1001 from pybal_config backendoperations/puppetproduction+1 -1
pupetmasters: remove local server configoperations/puppetproduction+0 -3
pybal_backend: enable codfw endpointoperations/puppetproduction+1 -1
puppetmaster/pybal_config: move ca and pybal_config to puppetmaster2001operations/puppetproduction+3 -3
config-master: move eqsin and eqiad config master back to eqiadoperations/dnsmaster+2 -2
puppet.eqiad.wmnet: moveback to puppetmaster1001operations/dnsmaster+1 -1
puppet.wikimedia.org.: move back to puppetmaster1001operations/dnsmaster+1 -1
puppet.eqsin.wmnet: move back to eqiadoperations/dnsmaster+1 -1
puppetmaster: update ca to puppetmaster2002operations/puppetproduction+1 -1
puppetmaster1001: updateboot image to busteroperations/puppetproduction+1 -0
puppet.eqiad.wmnet: move to codfwoperations/dnsmaster+2 -2
puppet.wikimedia.org: move to codfwoperations/dnsmaster+1 -1
puppet.codfw.wmnet: move cname back to puppetmaster2001operations/dnsmaster+2 -2
config-manager/puppet: move codfw entries to eqiadoperations/dnsmaster+2 -2
puppet/config-master: move services from ulsfo, eqsin and esams to eqiadoperations/dnsmaster+7 -7
pybal_config: disable pybal backend in codfw to prepare for reimageoperations/puppetproduction+1 -1
puppetmaster2001: switch boot options to install with busteroperations/puppetproduction+1 -0
puppetmaster: change active puppetmaster ca to codfwoperations/puppetproduction+1 -1
puppet::rsync: disable chroot on volatile and ssl rsyncoperations/puppetproduction+20 -14
puppetmaster_ca: move ca functions to puppetmaster2001operations/puppetproduction+1 -1
puppetmaster1001: move ca to puppetmaster2001 for reimageoperations/puppetproduction+1 -1
puppetmaster1001: update config-master to prepare for reimageoperations/dnsmaster+5 -5
puppetmaster1001: move eqaid puppet to codfwoperations/dnsmaster+1 -1
puppetmaster1001: migrate esams puppet traffic to codfwoperations/dnsmaster+1 -1
puppetmaster2001: move codfw back to puppetmaster2001operations/dnsmaster+1 -1
puppetmaster2001: move eqsin back to puppetmaster2001operations/dnsmaster+1 -1
puppet: point puppet.codfw.wmnet to puppetmaster1001.eqiad.wmnetoperations/dnsmaster+1 -1
puppet: point puppet.ulsfo.wmnet to puppetmaster1001.eqiad.wmnetoperations/dnsmaster+1 -1
puppet: point puppet,eqsin.wmnet to puppetmaster1001.eqiad.wmnetoperations/dnsmaster+1 -1
Show related patches Customize query in gerrit

Related Objects
Search...

Event Timeline

jbond created this task.Oct 1 2019, 10:50 AM
Restricted Application removed a project: Patch-For-Review. · View Herald TranscriptOct 1 2019, 10:50 AM
jbond triaged this task as Medium priority.Oct 1 2019, 10:50 AM
gerritbot added a comment.Oct 1 2019, 10:51 AM

Change 540096 had a related patch set uploaded (by Jbond; owner: John Bond):
[operations/dns@master] puppet: point puppet,eqsin.wmnet to puppetmaster1001.eqiad.wmnet

https://gerrit.wikimedia.org/r/540096

gerritbot added a project: Patch-For-Review.Oct 1 2019, 10:51 AM
gerritbot added a comment.Oct 1 2019, 11:00 AM

Change 540096 merged by Jbond:
[operations/dns@master] puppet: point puppet,eqsin.wmnet to puppetmaster1001.eqiad.wmnet

https://gerrit.wikimedia.org/r/540096

gerritbot added a comment.Oct 1 2019, 11:13 AM

Change 540100 had a related patch set uploaded (by Jbond; owner: John Bond):
[operations/dns@master] puppet: point puppet.ulsfo.wmnet to puppetmaster1001.eqiad.wmnet

https://gerrit.wikimedia.org/r/540100

gerritbot added a comment.Oct 1 2019, 11:14 AM

Change 540100 merged by Jbond:
[operations/dns@master] puppet: point puppet.ulsfo.wmnet to puppetmaster1001.eqiad.wmnet

https://gerrit.wikimedia.org/r/540100

gerritbot added a comment.Oct 1 2019, 11:27 AM

Change 540102 had a related patch set uploaded (by Jbond; owner: John Bond):
[operations/dns@master] puppet: point puppet.codfw.wmnet to puppetmaster1001.eqiad.wmnet

https://gerrit.wikimedia.org/r/540102

gerritbot added a comment.Oct 1 2019, 11:42 AM

Change 540102 merged by Jbond:
[operations/dns@master] puppet: point puppet.codfw.wmnet to puppetmaster1001.eqiad.wmnet

https://gerrit.wikimedia.org/r/540102

gerritbot added a comment.Oct 1 2019, 2:37 PM

Change 540130 had a related patch set uploaded (by Jbond; owner: John Bond):
[operations/dns@master] puppetmaster2001: move eqsin back to puppetmaster2001

https://gerrit.wikimedia.org/r/540130

gerritbot added a comment.Oct 1 2019, 2:41 PM

Change 540133 had a related patch set uploaded (by Jbond; owner: John Bond):
[operations/dns@master] puppetmaster2001: move codfw back to puppetmaster2001

https://gerrit.wikimedia.org/r/540133

gerritbot added a comment.Oct 1 2019, 2:42 PM

Change 540130 merged by Jbond:
[operations/dns@master] puppetmaster2001: move eqsin back to puppetmaster2001

https://gerrit.wikimedia.org/r/540130

CDanis closed subtask T234332: ensure additional puppetmaster files are managed by puppet as Resolved.Oct 1 2019, 2:53 PM
jbond reopened subtask T234332: ensure additional puppetmaster files are managed by puppet as Open.Oct 1 2019, 2:56 PM
gerritbot added a comment.Oct 1 2019, 3:00 PM

Change 540133 merged by Jbond:
[operations/dns@master] puppetmaster2001: move codfw back to puppetmaster2001

https://gerrit.wikimedia.org/r/540133

gerritbot added a comment.Oct 2 2019, 10:13 AM

Change 540367 had a related patch set uploaded (by Jbond; owner: John Bond):
[operations/dns@master] puppetmaster1001: migrate esams puppet traffic to codfw

https://gerrit.wikimedia.org/r/540367

gerritbot added a comment.Oct 2 2019, 10:13 AM

Change 540368 had a related patch set uploaded (by Jbond; owner: John Bond):
[operations/dns@master] puppetmaster1001: move eqaid puppet to codfw

https://gerrit.wikimedia.org/r/540368

gerritbot added a comment.Oct 2 2019, 11:15 AM

Change 540367 merged by Jbond:
[operations/dns@master] puppetmaster1001: migrate esams puppet traffic to codfw

https://gerrit.wikimedia.org/r/540367

gerritbot added a comment.Oct 2 2019, 11:25 AM

Change 540368 merged by Jbond:
[operations/dns@master] puppetmaster1001: move eqaid puppet to codfw

https://gerrit.wikimedia.org/r/540368

gerritbot added a comment.Oct 2 2019, 12:11 PM

Change 540390 had a related patch set uploaded (by Jbond; owner: John Bond):
[operations/dns@master] puppetmaster1001: update config-manager to prepare for reimage

https://gerrit.wikimedia.org/r/540390

gerritbot added a comment.Oct 2 2019, 12:18 PM

Change 540392 had a related patch set uploaded (by Jbond; owner: John Bond):
[operations/puppet@production] puppetmaster1001: move ca to puppetmaster2001 for reimage

https://gerrit.wikimedia.org/r/540392

gerritbot added a comment.Oct 2 2019, 12:22 PM

Change 540393 had a related patch set uploaded (by Jbond; owner: John Bond):
[operations/puppet@production] pybal_config: remove puppetmaster1001 from pybal_config backend

https://gerrit.wikimedia.org/r/540393

gerritbot added a comment.Oct 2 2019, 1:16 PM

Change 540392 merged by Jbond:
[operations/puppet@production] puppetmaster1001: move ca to puppetmaster2001 for reimage

https://gerrit.wikimedia.org/r/540392

gerritbot added a comment.Oct 2 2019, 1:17 PM

Change 540390 merged by Jbond:
[operations/dns@master] puppetmaster1001: update config-master to prepare for reimage

https://gerrit.wikimedia.org/r/540390

jbond added a comment.EditedOct 2 2019, 3:36 PM

Tagging https://phabricator.wikimedia.org/T184562#4069362
https://wikitech.wikimedia.org/wiki/Puppet_CA_replacement

gerritbot added a comment.Oct 2 2019, 3:36 PM

Change 540431 had a related patch set uploaded (by Jbond; owner: John Bond):
[operations/puppet@production] puppetmaster_ca: move ca functions to puppetmaster2001

https://gerrit.wikimedia.org/r/540431

jbond added a comment.Oct 2 2019, 3:38 PM

tagging:

gerritbot added a comment.Oct 2 2019, 3:39 PM

Change 540431 merged by Jbond:
[operations/puppet@production] puppetmaster_ca: move ca functions to puppetmaster2001

https://gerrit.wikimedia.org/r/540431

jbond added a comment.Oct 2 2019, 4:00 PM

during the upgrade of the puppet master i attempted to move the puppetmaster_ca from puppetmaster1001 to puppetmaster2001. however when i attempted this we saw a whole skew of errors· Looking at the apache logs we see the following stack strace

[ 2019-10-02 15:51:08.8008 17543/7f8a90079700 age/Cor/App/Implementation.cpp:304 ]: Could not spawn process for appl
ication /usr/share/puppet/rack/puppet-master: An error occurred while starting up the preloader.
  Error ID: 8aaa24bb
  Error details saved to: /tmp/passenger-error-d7nHyI.html
  Message from application: exit (SystemExit)
  /usr/lib/ruby/vendor_ruby/puppet/util.rb:554:in `exit'
  /usr/lib/ruby/vendor_ruby/puppet/util.rb:554:in `rescue in exit_on_fail'
  /usr/lib/ruby/vendor_ruby/puppet/util.rb:540:in `exit_on_fail'
  /usr/lib/ruby/vendor_ruby/puppet/application.rb:341:in `run'
  /usr/lib/ruby/vendor_ruby/puppet/util/command_line.rb:132:in `run'
  /usr/lib/ruby/vendor_ruby/puppet/util/command_line.rb:72:in `execute'
  config.ru:111:in `block in <main>'
  /usr/lib/ruby/vendor_ruby/rack/builder.rb:55:in `instance_eval'
  /usr/lib/ruby/vendor_ruby/rack/builder.rb:55:in `initialize'
  config.ru:1:in `new'
  config.ru:1:in `<main>'
  /usr/share/passenger/helper-scripts/rack-preloader.rb:110:in `eval'
  /usr/share/passenger/helper-scripts/rack-preloader.rb:110:in `preload_app'
  /usr/share/passenger/helper-scripts/rack-preloader.rb:156:in `<module:App>'
  /usr/share/passenger/helper-scripts/rack-preloader.rb:30:in `<module:PhusionPassenger>'
  /usr/share/passenger/helper-scripts/rack-preloader.rb:29:in `<main>'

And we see the following error in the puppet agent -t output

Error: /File[/var/lib/puppet/facts.d]: Failed to generate additional resources using 'eval_generate': Error 500 on SERVER: <!DOCTYPE html>
<html>
<head>
  <title>We're sorry, but something went wrong (500)</title>
  <style type="text/css">
    body { background-color: #fff; color: #666; text-align: center; font-family: arial, sans-serif; }
    .dialog {
      width: 25em;
      padding: 0 4em;
      margin: 4em auto 0 auto;
      border: 1px solid #ccc;
      border-right-color: #999;
      border-bottom-color: #999;
    }
    h1 { font-size: 100%; color: #f00; line-height: 1.5em; }
    #operator_info_panel {
      width: 27em;
      margin: 4em auto 0 auto;
      line-height: 1.2em;
    }
    #show_operator_info { text-decoration: none; color: #99f; font-size: smaller; }
    #show_operator_info:hover { text-decoration: underline; }
    #operator_info { color: #444; text-align: justify; }
  </style>
</head>

<body>
  <div class="dialog">
    <h1>We're sorry, but something went wrong.</h1>
    <p>We've been notified about this issue and we'll take a look at it shortly.</p>
  </div>
  <div id="operator_info_panel">
    <a id="show_operator_info" href="javascript:void(showOperatorInfo())">Information for the administrator of this website</a>
    <div id="operator_info" style="display: none">
      <p>The Phusion Passenger application server encountered an error while starting your web application.
        Because you are running this web application in staging or production mode, the details of the error
        have been omitted from this web page for security reasons.</p>
      <p><strong>Please read <a href="https://www.phusionpassenger.com/library/admin/log_file/">the Passenger log file</a> to find the details of the error.</strong></p>
      <p>Alternatively, you can turn on the "friendly error pages" feature (see below), which will make Phusion Passenger show many details about the error right in the browser.</p>
      <p>To turn on friendly error pages:</p>
      <ul>
        <li><a href="https://www.phusionpassenger.com/library/config/nginx/reference/#passenger_friendly_error_pages">Nginx integration mode</a></li>
        <li><a href="https://www.phusionpassenger.com/library/config/apache/reference/#passengerfriendlyerrorpages">Apache integration mode</a></li>
        <li><a href="https://www.phusionpassenger.com/library/config/standalone/reference/#--friendly-error-pages---no-friendly-error-pages-friendly_error_pages">Standalone mode</a></li>
      </ul>
    </div>
  </div>

  <script>
    function showOperatorInfo() {
      document.getElementById('operator_info').style.display = 'block';
    }
  </script>
</body>
</html>

Error: /File[/var/lib/puppet/facts.d]: Could not evaluate: Could not retrieve information from environment production source(s) puppet:///pluginfacts
jbond added a comment.EditedOct 7 2019, 2:51 PM

Today i have noticed that the GID and UID for puppet on puppetmaster1001 is different to the uid on puppetmaster2001. This is causing issues for at least GoeIP. Although even when manually fixing the error clients still receive

Error: /Stage[main]/Geoip::Data::Puppet/File[/usr/share/GeoIP]: Failed to generate additional resources using 'eval_generate': Error 500 on SERVER: Server Error: Not authorized to call search on /file_metadata/volatile/GeoIP with {:links=>"manage", :recurse=>true, :source_permissions=>"ignore", :checksum_type=>"md5"}
Error: /Stage[main]/Geoip::Data::Puppet/File[/usr/share/GeoIP]: Could not evaluate: Could not retrieve file metadata for puppet:///volatile/GeoIP: Error 500 on SERVER: Server Error: Not authorized to call find on /file_metadata/volatile/GeoIP with {:links=>"manage", :checksum_type=>"md5", :source_permissions=>"ignore"}
jbond added a comment.Oct 7 2019, 3:36 PM

https://phabricator.wikimedia.org/P9250

gerritbot added a comment.Oct 8 2019, 1:44 PM

Change 541545 had a related patch set uploaded (by Jbond; owner: John Bond):
[operations/puppet@production] puppet::rsync: disable chroot on volatile and ssl rsync

https://gerrit.wikimedia.org/r/541545

gerritbot added a comment.Oct 9 2019, 9:20 AM

Change 541545 merged by Jbond:
[operations/puppet@production] puppet::rsync: disable chroot on volatile and ssl rsync

https://gerrit.wikimedia.org/r/541545

gerritbot added a comment.Oct 9 2019, 10:58 AM

Change 541781 had a related patch set uploaded (by Jbond; owner: John Bond):
[operations/puppet@production] puppetmaster: change active puppetmaster ca to codfw

https://gerrit.wikimedia.org/r/541781

gerritbot added a comment.Oct 9 2019, 11:09 AM

Change 541781 merged by Jbond:
[operations/puppet@production] puppetmaster: change active puppetmaster ca to codfw

https://gerrit.wikimedia.org/r/541781

gerritbot added a comment.Oct 9 2019, 12:53 PM

Change 541804 had a related patch set uploaded (by Jbond; owner: John Bond):
[operations/dns@master] puppet/config-master: move services from ulsfo, eqsin and esams to eqiad

https://gerrit.wikimedia.org/r/541804

gerritbot added a comment.Oct 9 2019, 12:55 PM

Change 541807 had a related patch set uploaded (by Jbond; owner: John Bond):
[operations/puppet@production] pybal_config: disable pybal backend in codfw to prepare for reimage

https://gerrit.wikimedia.org/r/541807

gerritbot added a comment.Oct 9 2019, 12:57 PM

Change 541810 had a related patch set uploaded (by Jbond; owner: John Bond):
[operations/puppet@production] puppetmaster2001: switch boot options to install with buster

https://gerrit.wikimedia.org/r/541810

gerritbot added a comment.Oct 9 2019, 12:59 PM

Change 541810 merged by Jbond:
[operations/puppet@production] puppetmaster2001: switch boot options to install with buster

https://gerrit.wikimedia.org/r/541810

gerritbot added a comment.Oct 9 2019, 1:03 PM

Change 541807 merged by Jbond:
[operations/puppet@production] pybal_config: disable pybal backend in codfw to prepare for reimage

https://gerrit.wikimedia.org/r/541807

gerritbot added a comment.Oct 9 2019, 1:06 PM

Change 541804 merged by Jbond:
[operations/dns@master] puppet/config-master: move services from ulsfo, eqsin and esams to eqiad

https://gerrit.wikimedia.org/r/541804

gerritbot added a comment.Oct 9 2019, 1:36 PM

Change 541818 had a related patch set uploaded (by Jbond; owner: John Bond):
[operations/dns@master] config-manager/puppet: move codfw entries to eqiad

https://gerrit.wikimedia.org/r/541818

gerritbot added a comment.Oct 9 2019, 1:39 PM

Change 541818 merged by Jbond:
[operations/dns@master] config-manager/puppet: move codfw entries to eqiad

https://gerrit.wikimedia.org/r/541818

ops-monitoring-bot added a comment.Oct 9 2019, 1:49 PM

Script wmf-auto-reimage was launched by jbond on cumin1001.eqiad.wmnet for hosts:

['puppetmaster2001.codfw.wmnet']

The log can be found in /var/log/wmf-auto-reimage/201910091349_jbond_34479.log.

ops-monitoring-bot added a comment.Oct 9 2019, 2:08 PM

Completed auto-reimage of hosts:

['puppetmaster2001.codfw.wmnet']

Of which those FAILED:

['puppetmaster2001.codfw.wmnet']
jbond closed subtask T235077: apache fails to start on buster to to an SSL error as Resolved.Oct 9 2019, 2:38 PM
gerritbot added a comment.Oct 9 2019, 2:48 PM

Change 541834 had a related patch set uploaded (by Jbond; owner: John Bond):
[operations/dns@master] puppet.codfw.wmnet: move cname back to puppetmaster2001

https://gerrit.wikimedia.org/r/541834

gerritbot added a comment.Oct 9 2019, 2:50 PM

Change 541834 merged by Jbond:
[operations/dns@master] puppet.codfw.wmnet: move cname back to puppetmaster2001

https://gerrit.wikimedia.org/r/541834

gerritbot added a comment.Oct 9 2019, 3:14 PM

Change 541838 had a related patch set uploaded (by Jbond; owner: John Bond):
[operations/puppet@production] puppetmaster/pybal_config: move ca and pybal_config to puppetmaster2001

https://gerrit.wikimedia.org/r/541838

gerritbot added a comment.Oct 10 2019, 9:36 AM

Change 542070 had a related patch set uploaded (by Jbond; owner: John Bond):
[operations/dns@master] puppet.wikimedia.org: move to codfw

https://gerrit.wikimedia.org/r/542070

gerritbot added a comment.Oct 10 2019, 9:52 AM

Change 542070 merged by Jbond:
[operations/dns@master] puppet.wikimedia.org: move to codfw

https://gerrit.wikimedia.org/r/542070

gerritbot added a comment.Oct 10 2019, 10:38 AM

Change 542078 had a related patch set uploaded (by Jbond; owner: John Bond):
[operations/dns@master] puppet.eqiad.wmnet: move to codfw

https://gerrit.wikimedia.org/r/542078

gerritbot added a comment.Oct 10 2019, 12:04 PM

Change 542078 merged by Jbond:
[operations/dns@master] puppet.eqiad.wmnet: move to codfw

https://gerrit.wikimedia.org/r/542078

ops-monitoring-bot added a comment.Oct 10 2019, 1:33 PM

Script wmf-auto-reimage was launched by jbond on cumin1001.eqiad.wmnet for hosts:

['puppetmaster1001.eqiad.wmnet']

The log can be found in /var/log/wmf-auto-reimage/201910101333_jbond_37870.log.

gerritbot added a comment.Oct 10 2019, 1:36 PM

Change 542105 had a related patch set uploaded (by Jbond; owner: John Bond):
[operations/puppet@production] puppetmaster1001: updateboot image to buster

https://gerrit.wikimedia.org/r/542105

gerritbot added a comment.Oct 10 2019, 1:41 PM

Change 542105 merged by Jbond:
[operations/puppet@production] puppetmaster1001: updateboot image to buster

https://gerrit.wikimedia.org/r/542105

ops-monitoring-bot added a comment.Oct 10 2019, 1:49 PM

Script wmf-auto-reimage was launched by jbond on cumin1001.eqiad.wmnet for hosts:

['puppetmaster1001.eqiad.wmnet']

The log can be found in /var/log/wmf-auto-reimage/201910101348_jbond_40696.log.

ops-monitoring-bot added a comment.Oct 10 2019, 1:49 PM

Completed auto-reimage of hosts:

['puppetmaster1001.eqiad.wmnet']

Of which those FAILED:

['puppetmaster1001.eqiad.wmnet']
ops-monitoring-bot added a comment.Oct 10 2019, 1:50 PM

Script wmf-auto-reimage was launched by jbond on cumin1001.eqiad.wmnet for hosts:

['puppetmaster1001.eqiad.wmnet']

The log can be found in /var/log/wmf-auto-reimage/201910101350_jbond_40938.log.

ops-monitoring-bot added a comment.Oct 10 2019, 1:50 PM

Completed auto-reimage of hosts:

['puppetmaster1001.eqiad.wmnet']

Of which those FAILED:

['puppetmaster1001.eqiad.wmnet']
gerritbot added a comment.Oct 10 2019, 1:54 PM

Change 542108 had a related patch set uploaded (by Jbond; owner: John Bond):
[operations/puppet@production] puppetmaster: update ca to puppetmaster2002

https://gerrit.wikimedia.org/r/542108

gerritbot added a comment.Oct 10 2019, 1:55 PM

Change 542108 merged by Jbond:
[operations/puppet@production] puppetmaster: update ca to puppetmaster2002

https://gerrit.wikimedia.org/r/542108

ops-monitoring-bot added a comment.Oct 10 2019, 2:00 PM

Script wmf-auto-reimage was launched by jbond on cumin1001.eqiad.wmnet for hosts:

['puppetmaster1001.eqiad.wmnet']

The log can be found in /var/log/wmf-auto-reimage/201910101359_jbond_46457.log.

ops-monitoring-bot added a comment.Oct 10 2019, 2:12 PM

Completed auto-reimage of hosts:

['puppetmaster1001.eqiad.wmnet']

Of which those FAILED:

['puppetmaster1001.eqiad.wmnet']
gerritbot added a comment.Oct 10 2019, 3:19 PM

Change 542137 had a related patch set uploaded (by Jbond; owner: John Bond):
[operations/dns@master] puppet.eqsin.wmnet: move back to eqiad

https://gerrit.wikimedia.org/r/542137

gerritbot added a comment.Oct 10 2019, 3:19 PM

Change 542138 had a related patch set uploaded (by Jbond; owner: John Bond):
[operations/dns@master] puppet.eqiad.wmnet: moveback to puppetmaster1001

https://gerrit.wikimedia.org/r/542138

gerritbot added a comment.Oct 10 2019, 3:25 PM

Change 542137 merged by Jbond:
[operations/dns@master] puppet.eqsin.wmnet: move back to eqiad

https://gerrit.wikimedia.org/r/542137

gerritbot added a comment.Oct 10 2019, 3:43 PM

Change 542154 had a related patch set uploaded (by Jbond; owner: John Bond):
[operations/dns@master] puppet.wikimedia.org.: move back to puppetmaster1001

https://gerrit.wikimedia.org/r/542154

gerritbot added a comment.Oct 10 2019, 3:51 PM

Change 542154 merged by Jbond:
[operations/dns@master] puppet.wikimedia.org.: move back to puppetmaster1001

https://gerrit.wikimedia.org/r/542154

gerritbot added a comment.Oct 10 2019, 4:00 PM

Change 542138 merged by Jbond:
[operations/dns@master] puppet.eqiad.wmnet: moveback to puppetmaster1001

https://gerrit.wikimedia.org/r/542138

gerritbot added a comment.Oct 14 2019, 12:51 PM

Change 542924 had a related patch set uploaded (by Jbond; owner: John Bond):
[operations/dns@master] config-master: move eqsin and eqiad config master back to eqiad

https://gerrit.wikimedia.org/r/542924

gerritbot added a comment.Oct 14 2019, 12:52 PM

Change 542926 had a related patch set uploaded (by Jbond; owner: John Bond):
[operations/puppet@production] pybal_backend: enable codfw endpoint

https://gerrit.wikimedia.org/r/542926

gerritbot added a comment.Oct 14 2019, 12:58 PM

Change 542929 had a related patch set uploaded (by Jbond; owner: John Bond):
[operations/puppet@production] pupetmasters: remove local server config

https://gerrit.wikimedia.org/r/542929

gerritbot added a comment.Oct 14 2019, 3:03 PM

Change 542924 merged by Jbond:
[operations/dns@master] config-master: move eqsin and eqiad config master back to eqiad

https://gerrit.wikimedia.org/r/542924

gerritbot added a comment.Oct 15 2019, 11:04 AM

Change 541838 abandoned by Jbond:
puppetmaster/pybal_config: move ca and pybal_config to puppetmaster2001

https://gerrit.wikimedia.org/r/541838

gerritbot added a comment.Oct 15 2019, 11:06 AM

Change 542926 merged by Jbond:
[operations/puppet@production] pybal_backend: enable codfw endpoint

https://gerrit.wikimedia.org/r/542926

gerritbot added a comment.Oct 15 2019, 11:08 AM

Change 542929 merged by Jbond:
[operations/puppet@production] pupetmasters: remove local server config

https://gerrit.wikimedia.org/r/542929

gerritbot added a comment.Oct 15 2019, 11:19 AM

Change 540393 abandoned by Jbond:
pybal_config: remove puppetmaster1001 from pybal_config backend

https://gerrit.wikimedia.org/r/540393

gerritbot added a comment.Oct 15 2019, 1:43 PM

Change 543148 had a related patch set uploaded (by Jbond; owner: John Bond):
[operations/puppet@production] puppetmaster: offline rhodium

https://gerrit.wikimedia.org/r/543148

gerritbot added a comment.Oct 15 2019, 1:45 PM

Change 543148 merged by Jbond:
[operations/puppet@production] puppetmaster: offline rhodium

https://gerrit.wikimedia.org/r/543148

jbond closed this task as Resolved.Oct 16 2019, 12:26 PM
jbond closed subtask T234332: ensure additional puppetmaster files are managed by puppet as Resolved.Oct 16 2019, 12:37 PM
jbond reopened subtask T234332: ensure additional puppetmaster files are managed by puppet as Open.Oct 16 2019, 2:18 PM
jbond closed subtask T234332: ensure additional puppetmaster files are managed by puppet as Resolved.Nov 7 2019, 5:26 PM
jbond closed subtask T235185: missing CRL as Declined.Jul 3 2023, 3:22 PM
Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL · Credits