Page MenuHomePhabricator
Create Task
Maniphest T224247

upgrade and rename krypton & create its codfw equivalent
Closed, ResolvedPublic
Actions

Description

The server krypton.eqiad.wmnet is a "webserver_misc_apps".

Things we should probably do:

  • upgrade from jessie to stretch / switch to PHP 7
  • create an equivalent of it in codfw for failover | miscweb2001 is up
  • pick a "cluster" name for them instead of a misc host name and rename them to something1001/2001 | it is called "miscweb", created on wiki and in puppet

services hosted here that are moving to miscweb1001:

Details

SubjectRepoBranchLines +/-
racktables: use codfw database when in codfwoperations/puppetproduction+2 -1
iegreview app: use codfw database when in codfwoperations/puppetproduction+1 -0
wikimania_scholarships app: use codfw database when in codfwoperations/puppetproduction+1 -0
racktables: set db host in Hiera, set to eqiad, use lookupoperations/puppetproduction+4 -2
wikimania_scholarships: set db host in Hieraoperations/puppetproduction+5 -2
iegreview: set db host in Hieraoperations/puppetproduction+5 -2
site/install_server: decom krypton.eqiad.wmnetoperations/puppetproduction+7 -8
misc_apps::httpd: remove jessie/php5 supportoperations/puppetproduction+2 -6
wikimania_scholarships: remove jessie/php5 supportoperations/puppetproduction+1 -6
ATS/varnish: switch wikimania scholarships to miscweb, use TLSoperations/puppetproduction+3 -3
ATS: configure "never-cache" for webserver-misc-apps.discovery.wmnetoperations/puppetproduction+3 -0
iegreview: remove jessie supportoperations/puppetproduction+2 -7
racktables: remove jessie supportoperations/puppetproduction+2 -8
ATS/varnish: switch iegreview to miscweb backend and use TLSoperations/puppetproduction+3 -3
ATS/varnish: replace krypton with miscweb1001, rename directoroperations/puppetproduction+13 -12
ATS/varnish: add director miscweb and switch racktables to itoperations/puppetproduction+6 -3
iegreview: require a mysql client to be installedoperations/puppetproduction+2 -0
misc_apps::httpd: allow port 80 from deployment serversoperations/puppetproduction+9 -1
misc_apps::httpd: do not load SSL httpd moduleoperations/puppetproduction+1 -1
install_server: switch miscweb servers to buster installeroperations/puppetproduction+2 -0
logstash: replace krypton with grafana1001 in collector ferm rulesoperations/puppetproduction+1 -1
site: add miscweb role to miscweb1001operations/puppetproduction+1 -1
install_server: add miscweb1001 to DHCPoperations/puppetproduction+5 -0
add IP for miscweb1001operations/dnsmaster+2 -0
add miscweb2001 to role webserver_misc_apps in site.ppoperations/puppetproduction+1 -1
cumin: add alias for new miscweb* cluster nameoperations/puppetproduction+1 -0
netboot: add miscweb[12]00[12] to partmanoperations/puppetproduction+1 -1
Show related patches Customize query in gerrit

Related Objects
Search...

Event Timeline

There are a very large number of changes, so older changes are hidden. Show Older Changes
Dzahn mentioned this in T224194: switch webserver_misc_apps to PHP 7.2 (7.1).May 24 2019, 10:16 PM
Dzahn updated the task description. (Show Details)
Dzahn mentioned this in T224323: ganeti VM request - miscweb2001 - equivalent of krypton.May 24 2019, 10:38 PM
gerritbot added a comment.May 24 2019, 10:41 PM

Change 512446 had a related patch set uploaded (by Dzahn; owner: Dzahn):
[operations/dns@master] rename krypton to miscweb1001

https://gerrit.wikimedia.org/r/512446

gerritbot added a project: Patch-For-Review.May 24 2019, 10:41 PM
Dzahn added a comment.May 24 2019, 10:48 PM
In T224247#5209664, @MoritzMuehlenhoff wrote:

miscweb1001/2001?

Sounds good!

added new name: https://wikitech.wikimedia.org/w/index.php?title=Infrastructure_naming_conventions&type=revision&diff=1827332&oldid=1827319

renaming /replacing krypton https://gerrit.wikimedia.org/r/c/operations/dns/+/512446

requesting ganeti VM https://phabricator.wikimedia.org/T224323

MoritzMuehlenhoff added a parent task: T224549: Track remaining jessie systems in production.May 29 2019, 10:38 AM
MoritzMuehlenhoff mentioned this in T224549: Track remaining jessie systems in production.
gerritbot added a comment.May 29 2019, 9:22 PM

Change 513215 had a related patch set uploaded (by Dzahn; owner: Dzahn):
[operations/puppet@production] netboot: add miscweb[12]00[12] to partman

https://gerrit.wikimedia.org/r/513215

gerritbot added a comment.May 29 2019, 9:29 PM

Change 513215 merged by Dzahn:
[operations/puppet@production] netboot: add miscweb[12]00[12] to partman

https://gerrit.wikimedia.org/r/513215

gerritbot added a comment.May 29 2019, 10:23 PM

Change 513227 had a related patch set uploaded (by Dzahn; owner: Dzahn):
[operations/puppet@production] cumin: add alias for new miscweb* cluster name

https://gerrit.wikimedia.org/r/513227

gerritbot added a comment.May 29 2019, 10:28 PM

Change 513230 had a related patch set uploaded (by Dzahn; owner: Dzahn):
[operations/puppet@production] add miscweb2001 to role webserver_misc_apps in site.pp

https://gerrit.wikimedia.org/r/513230

gerritbot added a comment.May 29 2019, 10:38 PM

Change 513227 merged by Dzahn:
[operations/puppet@production] cumin: add alias for new miscweb* cluster name

https://gerrit.wikimedia.org/r/513227

gerritbot added a comment.May 29 2019, 10:40 PM

Change 513230 merged by Dzahn:
[operations/puppet@production] add miscweb2001 to role webserver_misc_apps in site.pp

https://gerrit.wikimedia.org/r/513230

Dzahn closed subtask T224323: ganeti VM request - miscweb2001 - equivalent of krypton as Resolved.May 29 2019, 11:34 PM
Dzahn raised the priority of this task from Medium to High.Aug 27 2019, 9:41 AM
gerritbot added a comment.Aug 27 2019, 10:13 AM

Change 512446 merged by Dzahn:
[operations/dns@master] add IP for miscweb1001

https://gerrit.wikimedia.org/r/512446

gerritbot added a comment.Aug 27 2019, 10:17 AM

Change 532683 had a related patch set uploaded (by Dzahn; owner: Dzahn):
[operations/puppet@production] site: add miscweb role to miscweb1001

https://gerrit.wikimedia.org/r/532683

Dzahn updated the task description. (Show Details)Aug 27 2019, 10:17 AM
Stashbot mentioned this in T105507: request VM for misc. PHP applications.Aug 27 2019, 10:25 AM

Mentioned in SAL (#wikimedia-operations) [2019-08-27T10:25:05Z] <mutante> ganeti eqiad - creating new VM with same specs as krypton to replace it with a stretch instance and mirror miscweb2001. krypton to be removed (T224323, T105507, T224247)

gerritbot added a comment.Aug 27 2019, 10:54 AM

Change 532687 had a related patch set uploaded (by Dzahn; owner: Dzahn):
[operations/puppet@production] install_server: add miscweb1001 to DHCP

https://gerrit.wikimedia.org/r/532687

gerritbot added a comment.Aug 27 2019, 10:58 AM

Change 532687 merged by Dzahn:
[operations/puppet@production] install_server: add miscweb1001 to DHCP

https://gerrit.wikimedia.org/r/532687

gerritbot added a comment.Aug 27 2019, 11:44 AM

Change 532683 merged by Dzahn:
[operations/puppet@production] site: add miscweb role to miscweb1001

https://gerrit.wikimedia.org/r/532683

Stashbot added a comment.Aug 27 2019, 11:51 AM

Mentioned in SAL (#wikimedia-operations) [2019-08-27T11:51:31Z] <mutante> miscweb1001 - manually remove tin.eqiad.wmnet (!) from /srv/iegreview/iegreview-cache/.config and replace with deploy1001 after first puppet run. still existing bug that tin is not fully removed (T224247, T175288, T197470)

Stashbot mentioned this in T175288: setup/install/deploy deploy1001 as deployment server.Aug 27 2019, 11:51 AM
Stashbot mentioned this in T197470: find a way to systematically update the deployment server name across all repos.
Stashbot added a comment.Aug 27 2019, 11:54 AM

Mentioned in SAL (#wikimedia-operations) [2019-08-27T11:54:56Z] <mutante> miscweb1001 - a2dismod mpm_event ; a2enmod php7.0 ; systemctl restart apache2 (T224247, T196968) please also see https://gerrit.wikimedia.org/r/c/operations/puppet/+/451206

Stashbot mentioned this in T196968: Re-organize the apache configuration for MediaWiki in puppet.Aug 27 2019, 11:55 AM
gerritbot added a comment.Aug 27 2019, 12:04 PM

Change 532695 had a related patch set uploaded (by Dzahn; owner: Dzahn):
[operations/puppet@production] trafficserver/varnish: replace krypton with miscweb1001, rename director

https://gerrit.wikimedia.org/r/532695

gerritbot added a comment.Aug 27 2019, 12:32 PM

Change 532701 had a related patch set uploaded (by Dzahn; owner: Dzahn):
[operations/puppet@production] site/install_server: remote krypton.eqiad.wmnet

https://gerrit.wikimedia.org/r/532701

gerritbot added a comment.Aug 27 2019, 12:38 PM

Change 532702 had a related patch set uploaded (by Dzahn; owner: Dzahn):
[operations/puppet@production] logstash: replace krypton with grafana1001 in collector ferm rules

https://gerrit.wikimedia.org/r/532702

gerritbot added a comment.Aug 27 2019, 1:38 PM

Change 532702 merged by Dzahn:
[operations/puppet@production] logstash: replace krypton with grafana1001 in collector ferm rules

https://gerrit.wikimedia.org/r/532702

gerritbot added a comment.Aug 28 2019, 7:20 AM

Change 532862 had a related patch set uploaded (by Dzahn; owner: Dzahn):
[operations/puppet@production] install_server: switch miscweb servers to buster installer

https://gerrit.wikimedia.org/r/532862

gerritbot added a comment.Aug 28 2019, 7:27 AM

Change 532862 merged by Dzahn:
[operations/puppet@production] install_server: switch miscweb servers to buster installer

https://gerrit.wikimedia.org/r/532862

gerritbot added a comment.Aug 28 2019, 8:54 AM

Change 532948 had a related patch set uploaded (by Dzahn; owner: Dzahn):
[operations/puppet@production] misc_apps::httpd: do not load SSL httpd module

https://gerrit.wikimedia.org/r/532948

gerritbot added a comment.Aug 28 2019, 9:02 AM

Change 532948 merged by Dzahn:
[operations/puppet@production] misc_apps::httpd: do not load SSL httpd module

https://gerrit.wikimedia.org/r/532948

gerritbot added a comment.Aug 28 2019, 9:48 AM

Change 532954 had a related patch set uploaded (by Dzahn; owner: Dzahn):
[operations/puppet@production] misc_apps::httpd: allow port 80 from deployment servers

https://gerrit.wikimedia.org/r/532954

gerritbot added a comment.Aug 28 2019, 9:52 AM

Change 532954 merged by Dzahn:
[operations/puppet@production] misc_apps::httpd: allow port 80 from deployment servers

https://gerrit.wikimedia.org/r/532954

gerritbot added a comment.Aug 28 2019, 10:08 AM

Change 532959 had a related patch set uploaded (by Dzahn; owner: Dzahn):
[operations/puppet@production] iegreview: require a mysql client to be installed

https://gerrit.wikimedia.org/r/532959

gerritbot added a comment.Aug 28 2019, 10:11 AM

Change 532959 merged by Dzahn:
[operations/puppet@production] iegreview: require a mysql client to be installed

https://gerrit.wikimedia.org/r/532959

gerritbot added a comment.Aug 28 2019, 2:03 PM

Change 533024 had a related patch set uploaded (by Dzahn; owner: Dzahn):
[operations/puppet@production] ATS/varnish: add director miscweb and switch racktables to it

https://gerrit.wikimedia.org/r/533024

gerritbot added a comment.Aug 28 2019, 2:19 PM

Change 533024 merged by Dzahn:
[operations/puppet@production] ATS/varnish: add director miscweb and switch racktables to it

https://gerrit.wikimedia.org/r/533024

gerritbot added a comment.Aug 29 2019, 7:43 AM

Change 533154 had a related patch set uploaded (by Dzahn; owner: Dzahn):
[operations/puppet@production] ATS/varnish: switch iegreview to miscweb backend and use TLS

https://gerrit.wikimedia.org/r/533154

gerritbot added a comment.Aug 29 2019, 7:51 AM

Change 533155 had a related patch set uploaded (by Dzahn; owner: Dzahn):
[operations/puppet@production] racktables: remove jessie support

https://gerrit.wikimedia.org/r/533155

gerritbot added a comment.Aug 29 2019, 7:53 AM

Change 533157 had a related patch set uploaded (by Dzahn; owner: Dzahn):
[operations/puppet@production] iegreview: remove jessie support

https://gerrit.wikimedia.org/r/533157

gerritbot added a comment.Aug 29 2019, 7:57 AM

Change 533158 had a related patch set uploaded (by Dzahn; owner: Dzahn):
[operations/puppet@production] wikimania_scholarships: remove jessie/php5 support

https://gerrit.wikimedia.org/r/533158

gerritbot added a comment.Aug 29 2019, 8:00 AM

Change 532695 abandoned by Dzahn:
ATS/varnish: replace krypton with miscweb1001, rename director

Reason:
doing in separate changes instead (https://gerrit.wikimedia.org/r/c/operations/puppet/ /533024, https://gerrit.wikimedia.org/r/c/operations/puppet/ /533154 )

https://gerrit.wikimedia.org/r/532695

gerritbot added a comment.Aug 29 2019, 8:00 AM

Change 533159 had a related patch set uploaded (by Dzahn; owner: Dzahn):
[operations/puppet@production] misc_apps::httpd: remove jessie/php5 support

https://gerrit.wikimedia.org/r/533159

gerritbot added a comment.Aug 29 2019, 8:20 AM

Change 533154 merged by Dzahn:
[operations/puppet@production] ATS/varnish: switch iegreview to miscweb backend and use TLS

https://gerrit.wikimedia.org/r/533154

gerritbot added a comment.Aug 29 2019, 9:24 AM

Change 533155 merged by Dzahn:
[operations/puppet@production] racktables: remove jessie support

https://gerrit.wikimedia.org/r/533155

gerritbot added a comment.Aug 29 2019, 9:27 AM

Change 533157 merged by Dzahn:
[operations/puppet@production] iegreview: remove jessie support

https://gerrit.wikimedia.org/r/533157

gerritbot added a comment.Aug 29 2019, 9:47 AM

Change 533175 had a related patch set uploaded (by Dzahn; owner: Dzahn):
[operations/puppet@production] ATS/varnish: switch scholarschips to miscweb and use TLS

https://gerrit.wikimedia.org/r/533175

gerritbot added a comment.Aug 29 2019, 10:18 AM

Change 533181 had a related patch set uploaded (by Dzahn; owner: Dzahn):
[operations/puppet@production] ATS: configure "never_cache" for miscweb1001 backend

https://gerrit.wikimedia.org/r/533181

gerritbot added a comment.Aug 29 2019, 11:24 AM

Change 533181 merged by Dzahn:
[operations/puppet@production] ATS: configure "never-cache" for webserver-misc-apps.discovery.wmnet

https://gerrit.wikimedia.org/r/533181

gerritbot added a comment.Aug 29 2019, 11:31 AM

Change 533175 merged by Dzahn:
[operations/puppet@production] ATS/varnish: switch wikimania scholarships to miscweb, use TLS

https://gerrit.wikimedia.org/r/533175

gerritbot added a comment.Aug 29 2019, 11:43 AM

Change 533158 merged by Dzahn:
[operations/puppet@production] wikimania_scholarships: remove jessie/php5 support

https://gerrit.wikimedia.org/r/533158

gerritbot added a comment.Aug 29 2019, 11:52 AM

Change 533159 merged by Dzahn:
[operations/puppet@production] misc_apps::httpd: remove jessie/php5 support

https://gerrit.wikimedia.org/r/533159

gerritbot added a comment.Aug 29 2019, 12:16 PM

Change 532701 merged by Dzahn:
[operations/puppet@production] site/install_server: decom krypton.eqiad.wmnet

https://gerrit.wikimedia.org/r/532701

Dzahn updated the task description. (Show Details)Aug 29 2019, 12:22 PM
Dzahn removed a project: Patch-For-Review.
Dzahn updated the task description. (Show Details)
Dzahn added a comment.Aug 29 2019, 12:27 PM

The following services have been moved away from krypton miscweb1001.

  • new DNS discovery record 'webserver-misc-apps.discovery.wmnet is an alias for miscweb1001.eqiad.wmnet
  • miscweb1001.eqiad.wmnet is on stretch (because we don't have the envoy package for buster just yet but coming soon)
  • using PHP7 instead of PHP5, PHP5 support in puppet code removed
  • using envoy for TLS termination on backend, https:// url in ATS config for this backend
  • equivalent of backend server in codfw exists as miscweb2001.codfw.wmnet and also the DBA connection should not be an issue anymore, though untested
Dzahn added a comment.Aug 29 2019, 12:31 PM

TODO: DB config needs to use codfw proxy if puppet role applied on codfw node

Joe moved this task from Incoming 🐫 to Doing 😎 on the serviceops board.Sep 16 2019, 3:02 PM
Dzahn closed subtask T231546: decom krypton.eqiad.wmnet as Resolved.Sep 18 2019, 8:14 PM

krypton has been decom'ed fully

gerritbot added a comment.Sep 18 2019, 9:34 PM

Change 537761 had a related patch set uploaded (by Dzahn; owner: Dzahn):
[operations/puppet@production] racktables: set db host in Hiera, set to eqiad

https://gerrit.wikimedia.org/r/537761

gerritbot added a project: Patch-For-Review.Sep 18 2019, 9:34 PM
gerritbot added a comment.Sep 18 2019, 9:39 PM

Change 537762 had a related patch set uploaded (by Dzahn; owner: Dzahn):
[operations/puppet@production] iegreview: set db host in Hiera

https://gerrit.wikimedia.org/r/537762

gerritbot added a comment.Sep 18 2019, 9:43 PM

Change 537763 had a related patch set uploaded (by Dzahn; owner: Dzahn):
[operations/puppet@production] wikimania_scholarships: set db host in Hiera

https://gerrit.wikimedia.org/r/537763

gerritbot added a comment.Sep 19 2019, 7:50 PM

Change 537762 merged by Dzahn:
[operations/puppet@production] iegreview: set db host in Hiera

https://gerrit.wikimedia.org/r/537762

gerritbot added a comment.Sep 19 2019, 8:25 PM

Change 537763 merged by Dzahn:
[operations/puppet@production] wikimania_scholarships: set db host in Hiera

https://gerrit.wikimedia.org/r/537763

gerritbot added a comment.Sep 19 2019, 8:40 PM

Change 537761 merged by Dzahn:
[operations/puppet@production] racktables: set db host in Hiera, set to eqiad, use lookup

https://gerrit.wikimedia.org/r/537761

Maintenance_bot removed a project: Patch-For-Review.Sep 19 2019, 9:10 PM
Dzahn mentioned this in T210008: upgrade krypton (webserver_misc_apps) to stretch.Sep 30 2019, 6:47 PM
Dzahn added a subtask: T210008: upgrade krypton (webserver_misc_apps) to stretch.
Dzahn merged a task: T210008: upgrade krypton (webserver_misc_apps) to stretch.
Dzahn added subscribers: Andrew, hashar, Stashbot, gerritbot.
hashar unsubscribed.Oct 25 2019, 11:52 AM
akosiaris closed this task as Resolved.Nov 20 2019, 8:31 AM
akosiaris subscribed.

krypton is no more since 7a36b4e7a94f486a400f0363c263c446c33bba80, resolving.

Dzahn reopened this task as Open.Nov 20 2019, 1:19 PM
Dzahn added a comment.Nov 22 2019, 5:51 PM

That's true, just had one last little todo here for the one in codfw. Doing that now.

gerritbot added a comment.Nov 22 2019, 6:10 PM

Change 552551 had a related patch set uploaded (by Dzahn; owner: Dzahn):
[operations/puppet@production] wikimania_scholarships app: use codfw database when in codfw

https://gerrit.wikimedia.org/r/552551

gerritbot added a project: Patch-For-Review.Nov 22 2019, 6:10 PM
gerritbot added a comment.Nov 22 2019, 6:15 PM

Change 552552 had a related patch set uploaded (by Dzahn; owner: Dzahn):
[operations/puppet@production] iegreview app: use codfw database when in codfw

https://gerrit.wikimedia.org/r/552552

gerritbot added a comment.Nov 22 2019, 6:19 PM

Change 552553 had a related patch set uploaded (by Dzahn; owner: Dzahn):
[operations/puppet@production] racktables: use codfw database when in codfw

https://gerrit.wikimedia.org/r/552553

gerritbot added a comment.Nov 25 2019, 8:57 PM

Change 552551 merged by Dzahn:
[operations/puppet@production] wikimania_scholarships app: use codfw database when in codfw

https://gerrit.wikimedia.org/r/552551

gerritbot added a comment.Nov 25 2019, 9:32 PM

Change 552552 merged by Dzahn:
[operations/puppet@production] iegreview app: use codfw database when in codfw

https://gerrit.wikimedia.org/r/552552

gerritbot added a comment.Nov 25 2019, 10:01 PM

Change 552553 merged by Dzahn:
[operations/puppet@production] racktables: use codfw database when in codfw

https://gerrit.wikimedia.org/r/552553

Dzahn closed this task as Resolved.Nov 25 2019, 10:45 PM
Dzahn removed a project: Patch-For-Review.
Dzahn mentioned this in T247648: miscweb1001/2001 - upgrade to buster or decom.Mar 27 2020, 10:24 AM
Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL · Credits