Page MenuHomePhabricator
Create Task
Maniphest T329219

Main Tracking Task for ESAMS Migration to KNAMS
Closed, ResolvedPublicRequest
Actions

Description

https://wikitech.wikimedia.org/wiki/SRE/business_case/Network_-_move_from_esams_to_knams

  • Sign off on Revised Interxion Contract T315937
  • Submit travel request by May
  • PDU order - need onsite by June 30 T323414
  • Smart hands migration of router and x-connects (Leaseweb/Lumen, Relined, GTT, LibertyGlobal, Nikhef, T-Mobile, Datahop) to new cabinets, test connection - complete before July 31 T337997
  • OOB connection with ATOM86 T333604
  • Order of network switches, servers, cables, and expendables - need onsite by July 31 T320548 T327438 T326586 T331460 T336871 T336869 T338422
  • Submit termination notice for Iron Mountain, Leaseweb, Relined - submit by July 31 (SENT TO LEGAL)
  • Migrate esams circuits to knams - Lumen, Telia, EuNetworks, AMS-IX, FiberRing T339943
  • Move mx router from esams to knams - complete in August
  • Physical install and cabling of hardware at knams - complete in August
  • Configure and test network and OOB connections - complete in August
  • Configure servers and route traffic from esams to knams - complete in August
  • Send announcement in August
  • Decommission esams - drive wiping and shipping out hardware - complete before November T341528

Details

SubjectRepoBranchLines +/-
constants: update ns2 IP addressoperations/software/pywmflibmaster+1 -1
wikimedia.org: remove nsa.wikimedia.orgoperations/dnsmaster+1 -2
hiera: remove references to nsa.wikimedia.orgoperations/puppetproduction+2 -5
27.35.198.in-addr.arpa: update PTR for 198.35.27.27operations/dnsmaster+3 -2
asw1-b*27-esams: add durum300[34]operations/homer/publicmaster+2 -0
wmf-config: remove public subnets from reverse-proxy.phpoperations/mediawiki-configmaster+7 -5
wmf-config: update new esams IP rangesoperations/mediawiki-configmaster+4 -4
Repool esams after knams migration (merge on Monday Aug 21)operations/dnsmaster+0 -2
knams migration: remove references to old esamsoperations/dnsmaster+9 -12
Announce Anycast prefixes from esamsoperations/homer/publicmaster+3 -0
Reverse includes for new esams rangesoperations/dnsmaster+16 -0
10.in-addr.arpa: remove include for netbox/0.21.10.in-addr.arpaoperations/dnsmaster+2 -2
Remove all mentions of old-esams, replace with new esamsoperations/puppetproduction+27 -89
Remove PTRs for 91.198.174.0/24 and 2620:0:862::/48operations/dnsmaster+5 -129
10.in-addr.arpa: remove include for 0.20.10.in-addr.arpaoperations/dnsmaster+5 -4
Homer: remove all mentions of old esamsoperations/homer/publicmaster+0 -232
esams: update dhcp_serveroperations/homer/publicmaster+2 -2
old esams cleanupoperations/homer/publicmaster+11 -32
hiera: decommission dns3001 and dns3002operations/puppetproduction+0 -4
P:pybal: update bgp-peer-address for asw1-b*27-esamsoperations/puppetproduction+3 -1
hiera: LVS: update tagged_subnets for esamsoperations/puppetproduction+5 -1
common: update ntp_servers with dns300[34]operations/homer/publicmaster+2 -0
Update esams netflow collectoroperations/puppetproduction+1 -1
Update netflow collector IPoperations/homer/publicmaster+1 -1
esams/ntp: point to dns3003operations/dnsmaster+1 -1
devices: add anycast_ and lvs_neigbhors for esams (bw27/by27)operations/homer/publicmaster+8 -0
hiera: enable single backend on esams and switch to F4-U hardware configoperations/puppetproduction+23 -0
Rancid: esams migrationoperations/puppetproduction+4 -4
Add new-esams network infra to monitoringoperations/puppetproduction+37 -36
Add new esams switches to icinga hostgroupsoperations/puppetproduction+5 -1
esams: remove profile::bird::neighbors_listoperations/puppetproduction+0 -5
Add dns3003 to asw1-by27 anycast peersoperations/homer/publicmaster+11 -9
More esams router renamingoperations/homer/publicmaster+5 -19
Rename mr devices at Amsterdam POP sitesoperations/homer/publicmaster+2 -2
realm.pp fix new esams rangeoperations/puppetproduction+4 -4
realm: update subnets for knams migrationoperations/puppetproduction+2 -0
network: update data.yaml: swap esams/knamsoperations/puppetproduction+1 -1
Additon of new devices in new esams racksoperations/homer/publicmaster+38 -50
Remove include for reverse /24 range formerly used for esams tunnelsoperations/dnsmaster+0 -12
Remove dns300x from network device NTP serversoperations/homer/publicmaster+0 -2
hiera: authdns_addrs: do not duplicate ns2-v4 IPoperations/puppetproduction+3 -2
hiera: remove dns300[1-2] from authdns_serversoperations/puppetproduction+2 -2
Depool esams for duration of esams -> knams migrationoperations/dnsmaster+2 -0
Show related patches Customize query in gerrit

Related Objects
Search...

StatusSubtypeAssignedTask
 ResolvedRequestNoneT329219 Main Tracking Task for ESAMS Migration to KNAMS
Unknown Object (Task)
 ResolvedRobHT334280 Q4:knams: PDU installation
Unknown Object (Task)
Unknown Object (Task)
Unknown Object (Task)
Unknown Object (Task)
Unknown Object (Task)
 ResolvedRobHT331886 Q4/Q1:knams racking elevations & planning
Unknown Object (Task)
Unknown Object (Task)
Unknown Object (Task)
Unknown Object (Task)
Unknown Object (Task)
Unknown Object (Task)
Unknown Object (Task)
Unknown Object (Task)
 ResolvedVolansT340465 Add support for knams as PoP in tooling and automation
Unknown Object (Task)
 ResolvedPapaulT342198 Relocate one of the mx480 from esams to knams
 ResolvedcmooneyT343214 New IP and Vlan allocations for esams knams move
ResolvedcmooneyT343216 Announce new public IPv6 prefix from Amsterdam for knams migration
Unknown Object (Task)
 ResolvedRobHT344129 Update on-wiki documentation about esams
 Resolvedwiki_willyT344355 Replacement of esams VMs in knams Ganeti clusters
 ResolvedssinghT344363 Q1:unified decommission task for old esams hosts (knams migration)
Restricted Task
Restricted Task
Restricted Task
Unknown Object (Task)
Restricted Task

Event Timeline

There are a very large number of changes, so older changes are hidden. Show Older Changes
gerritbot added a comment.Aug 15 2023, 12:03 PM

Change 949023 merged by Ayounsi:

[operations/puppet@production] Add new esams switches to icinga hostgroups

https://gerrit.wikimedia.org/r/949023

gerritbot added a comment.Aug 15 2023, 12:42 PM

Change 949035 had a related patch set uploaded (by Ayounsi; author: Ayounsi):

[operations/puppet@production] Add new-esams network infra to monitoring

https://gerrit.wikimedia.org/r/949035

gerritbot added a comment.Aug 15 2023, 12:50 PM

Change 949035 merged by Ayounsi:

[operations/puppet@production] Add new-esams network infra to monitoring

https://gerrit.wikimedia.org/r/949035

gerritbot added a comment.Aug 15 2023, 3:57 PM

Change 949072 had a related patch set uploaded (by Ayounsi; author: Ayounsi):

[operations/puppet@production] Rancid: esams migration

https://gerrit.wikimedia.org/r/949072

gerritbot added a comment.Aug 15 2023, 3:58 PM

Change 949072 merged by Ayounsi:

[operations/puppet@production] Rancid: esams migration

https://gerrit.wikimedia.org/r/949072

gerritbot added a comment.Aug 15 2023, 7:25 PM

Change 949100 had a related patch set uploaded (by Ssingh; author: Ssingh):

[operations/homer/public@master] devices: add anycast_ and lvs_neigbhors for esams (bw27/by27)

https://gerrit.wikimedia.org/r/949100

gerritbot added a comment.Aug 15 2023, 9:00 PM

Change 949113 had a related patch set uploaded (by Ssingh; author: Ssingh):

[operations/dns@master] esams/ntp: point to dns3003

https://gerrit.wikimedia.org/r/949113

gerritbot added a comment.Aug 15 2023, 9:04 PM

Change 948581 abandoned by Ssingh:

[operations/puppet@production] hiera: enable single backend on esams and switch to F4-U hardware config

Reason:

no longer required

https://gerrit.wikimedia.org/r/948581

gerritbot added a comment.Aug 16 2023, 1:44 PM

Change 949100 merged by Ssingh:

[operations/homer/public@master] devices: add anycast_ and lvs_neigbhors for esams (bw27/by27)

https://gerrit.wikimedia.org/r/949100

Stashbot added a comment.Aug 16 2023, 1:46 PM

Mentioned in SAL (#wikimedia-operations) [2023-08-16T13:46:44Z] <sukhe> running homer on asw1-b*27-esams* for CR 949100: T329219

gerritbot added a comment.Aug 16 2023, 1:51 PM

Change 949113 merged by Ssingh:

[operations/dns@master] esams/ntp: point to dns3003

https://gerrit.wikimedia.org/r/949113

gerritbot added a comment.Aug 16 2023, 1:56 PM

Change 949525 had a related patch set uploaded (by Ssingh; author: Ssingh):

[operations/homer/public@master] common: update ntp_servers with dns300[34]

https://gerrit.wikimedia.org/r/949525

gerritbot added a comment.Aug 16 2023, 2:16 PM

Change 949529 had a related patch set uploaded (by Ssingh; author: Ssingh):

[operations/puppet@production] hiera: LVS: update tagged_subnets for esams

https://gerrit.wikimedia.org/r/949529

gerritbot added a comment.Aug 16 2023, 2:51 PM

Change 949531 had a related patch set uploaded (by Ssingh; author: Ssingh):

[operations/puppet@production] P:pybal: update bgp-peer-address for asw1-b*27-esams

https://gerrit.wikimedia.org/r/949531

gerritbot added a comment.Aug 16 2023, 2:54 PM

Change 949533 had a related patch set uploaded (by Ayounsi; author: Ayounsi):

[operations/homer/public@master] Update netflow collector IP

https://gerrit.wikimedia.org/r/949533

gerritbot added a comment.Aug 16 2023, 2:58 PM

Change 949534 had a related patch set uploaded (by Ayounsi; author: Ayounsi):

[operations/puppet@production] Update esams netflow collector

https://gerrit.wikimedia.org/r/949534

gerritbot added a comment.Aug 16 2023, 3:19 PM

Change 949533 merged by Ayounsi:

[operations/homer/public@master] Update netflow collector IP

https://gerrit.wikimedia.org/r/949533

gerritbot added a comment.Aug 16 2023, 3:21 PM

Change 949542 had a related patch set uploaded (by Fabfur; author: Fabfur):

[operations/puppet@production] hiera: decommission dns3001 and dns3002

https://gerrit.wikimedia.org/r/949542

gerritbot added a comment.Aug 16 2023, 3:30 PM

Change 949534 merged by Ayounsi:

[operations/puppet@production] Update esams netflow collector

https://gerrit.wikimedia.org/r/949534

gerritbot added a comment.Aug 16 2023, 3:34 PM

Change 949525 merged by Ssingh:

[operations/homer/public@master] common: update ntp_servers with dns300[34]

https://gerrit.wikimedia.org/r/949525

gerritbot added a comment.Aug 16 2023, 3:40 PM

Change 949529 merged by Ssingh:

[operations/puppet@production] hiera: LVS: update tagged_subnets for esams

https://gerrit.wikimedia.org/r/949529

gerritbot added a comment.Aug 16 2023, 3:42 PM

Change 949531 merged by Ssingh:

[operations/puppet@production] P:pybal: update bgp-peer-address for asw1-b*27-esams

https://gerrit.wikimedia.org/r/949531

gerritbot added a comment.Aug 16 2023, 3:56 PM

Change 949551 had a related patch set uploaded (by BCornwall; author: BCornwall):

[operations/puppet@production] Remove esams hosts prior to knams migration

https://gerrit.wikimedia.org/r/949551

gerritbot added a comment.Aug 16 2023, 3:58 PM

Change 949542 merged by Fabfur:

[operations/puppet@production] hiera: decommission dns3001 and dns3002

https://gerrit.wikimedia.org/r/949542

RobH reopened subtask Unknown Object (Task) as Open.Aug 16 2023, 4:12 PM
ops-monitoring-bot added a comment.Aug 16 2023, 4:25 PM

cookbooks.sre.hosts.decommission executed by fabfur@cumin1001 for hosts: dns3001.wikimedia.org

  • dns3001.wikimedia.org (PASS)
    • Downtimed host on Icinga/Alertmanager
    • Found physical host
    • Downtimed management interface on Alertmanager
    • Wiped all swraid, partition-table and filesystem signatures
    • Powered off
    • [Netbox] Set status to Decommissioning, deleted all non-mgmt IPs, updated switch interfaces (disabled, removed vlans, etc)
    • Configured the linked switch interface(s)
    • Removed from DebMonitor
    • Removed from Puppet master and PuppetDB
  • COMMON_STEPS (FAIL)
    • Failed to run the sre.dns.netbox cookbook, run it manually

ERROR: some step on some host failed, check the bolded items above

ops-monitoring-bot added a comment.Aug 16 2023, 4:41 PM

cookbooks.sre.hosts.decommission executed by fabfur@cumin1001 for hosts: dns3002.wikimedia.org

  • dns3002.wikimedia.org (PASS)
    • Downtimed host on Icinga/Alertmanager
    • Found physical host
    • Downtimed management interface on Alertmanager
    • Wiped all swraid, partition-table and filesystem signatures
    • Powered off
    • [Netbox] Set status to Decommissioning, deleted all non-mgmt IPs, updated switch interfaces (disabled, removed vlans, etc)
    • Configured the linked switch interface(s)
    • Removed from DebMonitor
    • Removed from Puppet master and PuppetDB
ops-monitoring-bot added a comment.Aug 16 2023, 5:07 PM

cookbooks.sre.hosts.decommission executed by brett@cumin2002 for hosts: cp[3050-3053].esams.wmnet

  • cp3050.esams.wmnet (PASS)
    • Downtimed host on Icinga/Alertmanager
    • Found physical host
    • Downtimed management interface on Alertmanager
    • Wiped all swraid, partition-table and filesystem signatures
    • Powered off
    • [Netbox] Set status to Decommissioning, deleted all non-mgmt IPs, updated switch interfaces (disabled, removed vlans, etc)
    • Configured the linked switch interface(s)
    • Removed from DebMonitor
    • Removed from Puppet master and PuppetDB
  • cp3051.esams.wmnet (PASS)
    • Downtimed host on Icinga/Alertmanager
    • Found physical host
    • Downtimed management interface on Alertmanager
    • Wiped all swraid, partition-table and filesystem signatures
    • Powered off
    • [Netbox] Set status to Decommissioning, deleted all non-mgmt IPs, updated switch interfaces (disabled, removed vlans, etc)
    • Configured the linked switch interface(s)
    • Removed from DebMonitor
    • Removed from Puppet master and PuppetDB
  • cp3052.esams.wmnet (PASS)
    • Downtimed host on Icinga/Alertmanager
    • Found physical host
    • Downtimed management interface on Alertmanager
    • Wiped all swraid, partition-table and filesystem signatures
    • Powered off
    • [Netbox] Set status to Decommissioning, deleted all non-mgmt IPs, updated switch interfaces (disabled, removed vlans, etc)
    • Configured the linked switch interface(s)
    • Removed from DebMonitor
    • Removed from Puppet master and PuppetDB
  • cp3053.esams.wmnet (PASS)
    • Downtimed host on Icinga/Alertmanager
    • Found physical host
    • Downtimed management interface on Alertmanager
    • Wiped all swraid, partition-table and filesystem signatures
    • Powered off
    • [Netbox] Set status to Decommissioning, deleted all non-mgmt IPs, updated switch interfaces (disabled, removed vlans, etc)
    • Configured the linked switch interface(s)
    • Removed from DebMonitor
    • Removed from Puppet master and PuppetDB
ops-monitoring-bot added a comment.Aug 16 2023, 5:23 PM

cookbooks.sre.hosts.decommission executed by brett@cumin2002 for hosts: cp[3054-3057].esams.wmnet

  • cp3054.esams.wmnet (PASS)
    • Downtimed host on Icinga/Alertmanager
    • Found physical host
    • Downtimed management interface on Alertmanager
    • Wiped all swraid, partition-table and filesystem signatures
    • Powered off
    • [Netbox] Set status to Decommissioning, deleted all non-mgmt IPs, updated switch interfaces (disabled, removed vlans, etc)
    • Configured the linked switch interface(s)
    • Removed from DebMonitor
    • Removed from Puppet master and PuppetDB
  • cp3055.esams.wmnet (PASS)
    • Downtimed host on Icinga/Alertmanager
    • Found physical host
    • Downtimed management interface on Alertmanager
    • Wiped all swraid, partition-table and filesystem signatures
    • Powered off
    • [Netbox] Set status to Decommissioning, deleted all non-mgmt IPs, updated switch interfaces (disabled, removed vlans, etc)
    • Configured the linked switch interface(s)
    • Removed from DebMonitor
    • Removed from Puppet master and PuppetDB
  • cp3056.esams.wmnet (PASS)
    • Downtimed host on Icinga/Alertmanager
    • Found physical host
    • Downtimed management interface on Alertmanager
    • Wiped all swraid, partition-table and filesystem signatures
    • Powered off
    • [Netbox] Set status to Decommissioning, deleted all non-mgmt IPs, updated switch interfaces (disabled, removed vlans, etc)
    • Configured the linked switch interface(s)
    • Removed from DebMonitor
    • Removed from Puppet master and PuppetDB
  • cp3057.esams.wmnet (PASS)
    • Downtimed host on Icinga/Alertmanager
    • Found physical host
    • Downtimed management interface on Alertmanager
    • Wiped all swraid, partition-table and filesystem signatures
    • Powered off
    • [Netbox] Set status to Decommissioning, deleted all non-mgmt IPs, updated switch interfaces (disabled, removed vlans, etc)
    • Configured the linked switch interface(s)
    • Removed from DebMonitor
    • Removed from Puppet master and PuppetDB
gerritbot added a comment.Aug 17 2023, 5:54 AM

Change 949621 had a related patch set uploaded (by Ayounsi; author: Ayounsi):

[operations/homer/public@master] esams: update dhcp_server

https://gerrit.wikimedia.org/r/949621

gerritbot added a comment.Aug 17 2023, 6:17 AM

Change 949623 had a related patch set uploaded (by Ayounsi; author: Ayounsi):

[operations/homer/public@master] old esams cleanup

https://gerrit.wikimedia.org/r/949623

gerritbot added a comment.Aug 17 2023, 6:26 AM

Change 949623 merged by jenkins-bot:

[operations/homer/public@master] old esams cleanup

https://gerrit.wikimedia.org/r/949623

gerritbot added a comment.Aug 17 2023, 7:07 AM

Change 949621 merged by jenkins-bot:

[operations/homer/public@master] esams: update dhcp_server

https://gerrit.wikimedia.org/r/949621

gerritbot added a comment.Aug 17 2023, 9:55 AM

Change 949853 had a related patch set uploaded (by Ayounsi; author: Ayounsi):

[operations/homer/public@master] Homer: remove all mentions of old esams

https://gerrit.wikimedia.org/r/949853

gerritbot added a comment.Aug 17 2023, 10:12 AM

Change 949930 had a related patch set uploaded (by Ssingh; author: Ssingh):

[operations/dns@master] knams migration: remove references to old esams

https://gerrit.wikimedia.org/r/949930

Fabfur added a subtask: T344363: Q1:unified decommission task for old esams hosts (knams migration).Aug 17 2023, 10:16 AM
gerritbot added a comment.Aug 17 2023, 10:17 AM

Change 949934 had a related patch set uploaded (by Ayounsi; author: Ayounsi):

[operations/puppet@production] Remove all mentions of old-esams, replace with new esams

https://gerrit.wikimedia.org/r/949934

gerritbot added a comment.Aug 17 2023, 10:36 AM

Change 949853 merged by jenkins-bot:

[operations/homer/public@master] Homer: remove all mentions of old esams

https://gerrit.wikimedia.org/r/949853

gerritbot added a comment.Aug 17 2023, 10:45 AM

Change 949938 had a related patch set uploaded (by Ssingh; author: Ssingh):

[operations/dns@master] 10.in-addr.arpa: remove include for 0.20.10.in-addr.arpa

https://gerrit.wikimedia.org/r/949938

gerritbot added a comment.Aug 17 2023, 10:53 AM

Change 949938 merged by Ssingh:

[operations/dns@master] 10.in-addr.arpa: remove include for 0.20.10.in-addr.arpa

https://gerrit.wikimedia.org/r/949938

gerritbot added a comment.Aug 17 2023, 12:59 PM

Change 949972 had a related patch set uploaded (by Ssingh; author: Ssingh):

[operations/dns@master] 10.in-addr.arpa: remove include for netbox/0.21.10.in-addr.arpa

https://gerrit.wikimedia.org/r/949972

gerritbot added a comment.Aug 17 2023, 1:15 PM

Change 949975 had a related patch set uploaded (by Ssingh; author: Ssingh):

[operations/dns@master] Remove PTRs for 91.198.174.0/24 and 2620:0:862::/48

https://gerrit.wikimedia.org/r/949975

gerritbot added a comment.Aug 17 2023, 1:29 PM

Change 949975 merged by Ayounsi:

[operations/dns@master] Remove PTRs for 91.198.174.0/24 and 2620:0:862::/48

https://gerrit.wikimedia.org/r/949975

gerritbot added a comment.Aug 17 2023, 4:11 PM

Change 949934 merged by Ayounsi:

[operations/puppet@production] Remove all mentions of old-esams, replace with new esams

https://gerrit.wikimedia.org/r/949934

gerritbot added a comment.Aug 17 2023, 4:59 PM

Change 949972 abandoned by Ssingh:

[operations/dns@master] 10.in-addr.arpa: remove include for netbox/0.21.10.in-addr.arpa

Reason:

no longer required

https://gerrit.wikimedia.org/r/949972

RobH closed subtask Unknown Object (Task) as Resolved.Aug 17 2023, 6:28 PM
gerritbot added a comment.Aug 17 2023, 10:04 PM

Change 950045 had a related patch set uploaded (by Cathal Mooney; author: Cathal Mooney):

[operations/dns@master] Reverse includes for new esams range

https://gerrit.wikimedia.org/r/950045

gerritbot added a comment.Aug 18 2023, 9:36 AM

Change 950045 merged by Cathal Mooney:

[operations/dns@master] Reverse includes for new esams ranges

https://gerrit.wikimedia.org/r/950045

gerritbot added a comment.Aug 18 2023, 2:16 PM

Change 950176 had a related patch set uploaded (by Ssingh; author: Ssingh):

[operations/dns@master] Repool esams after knams migration (merge on Monday Aug 21)

https://gerrit.wikimedia.org/r/950176

ops-monitoring-bot added a comment.Aug 19 2023, 8:26 AM

Icinga downtime and Alertmanager silence (ID=7e93d2ff-5842-45cb-8ae6-d620952951e6) set by cmooney@cumin1001 for 2:00:00 on 16 host(s) and their services with reason: Downtime esams hosts prior to cr1-esams reboot

asw1-bw27-esams,asw1-bw27-esams.mgmt,asw1-by27-esams,asw1-by27-esams.mgmt,cr2-drmrs,cr2-eqiad,cr[1-2]-esams,cr2-esams.mgmt,mr1-esams,mr1-esams.oob,ps1-oe[14-16]-esams,re0.cr1-esams.mgmt,scs-by27-esams
ayounsi added a subtask: Restricted Task.Aug 21 2023, 6:35 AM
gerritbot added a comment.Aug 21 2023, 8:51 PM

Change 951186 had a related patch set uploaded (by Cathal Mooney; author: Cathal Mooney):

[operations/homer/public@master] Announce Anycast prefixes from esams

https://gerrit.wikimedia.org/r/951186

gerritbot added a comment.Aug 21 2023, 9:12 PM

Change 951186 merged by jenkins-bot:

[operations/homer/public@master] Announce Anycast prefixes from esams

https://gerrit.wikimedia.org/r/951186

gerritbot added a comment.Aug 22 2023, 1:07 PM

Change 949930 merged by Ssingh:

[operations/dns@master] knams migration: remove references to old esams

https://gerrit.wikimedia.org/r/949930

gerritbot added a comment.Aug 22 2023, 1:19 PM

Change 950176 merged by Ssingh:

[operations/dns@master] Repool esams after knams migration (merge on Monday Aug 21)

https://gerrit.wikimedia.org/r/950176

gerritbot added a comment.Aug 22 2023, 2:19 PM

Change 951508 had a related patch set uploaded (by Ssingh; author: Ssingh):

[operations/mediawiki-config@master] wmf-config: update new esams IP ranges

https://gerrit.wikimedia.org/r/951508

gerritbot added a comment.Aug 22 2023, 2:30 PM

Change 951508 merged by jenkins-bot:

[operations/mediawiki-config@master] wmf-config: update new esams IP ranges

https://gerrit.wikimedia.org/r/951508

Stashbot added a comment.Aug 22 2023, 2:30 PM

Mentioned in SAL (#wikimedia-operations) [2023-08-22T14:30:34Z] <taavi@deploy1002> Started scap: Backport for [[gerrit:951508|wmf-config: update new esams IP ranges (T329219)]]

Stashbot added a comment.Aug 22 2023, 2:32 PM

Mentioned in SAL (#wikimedia-operations) [2023-08-22T14:32:07Z] <taavi@deploy1002> taavi and sukhe: Backport for [[gerrit:951508|wmf-config: update new esams IP ranges (T329219)]] synced to the testservers mwdebug2001.codfw.wmnet, mwdebug2002.codfw.wmnet, mwdebug1001.eqiad.wmnet, mwdebug1002.eqiad.wmnet, and mw-debug kubernetes deployment (accessible via k8s-experimental XWD option)

Stashbot added a comment.Aug 22 2023, 2:40 PM

Mentioned in SAL (#wikimedia-operations) [2023-08-22T14:40:25Z] <taavi@deploy1002> Finished scap: Backport for [[gerrit:951508|wmf-config: update new esams IP ranges (T329219)]] (duration: 09m 50s)

cmooney updated the task description. (Show Details)Aug 22 2023, 10:26 PM
gerritbot added a comment.Aug 23 2023, 12:34 AM

Change 951591 had a related patch set uploaded (by Ssingh; author: Ssingh):

[operations/mediawiki-config@master] wmf-config: remove public subnets from reverse-proxy.php

https://gerrit.wikimedia.org/r/951591

MoritzMuehlenhoff closed subtask T344355: Replacement of esams VMs in knams Ganeti clusters as Resolved.Aug 23 2023, 6:54 AM
gerritbot added a comment.Aug 30 2023, 12:39 PM

Change 951591 merged by jenkins-bot:

[operations/mediawiki-config@master] wmf-config: remove public subnets from reverse-proxy.php

https://gerrit.wikimedia.org/r/951591

Stashbot added a comment.Aug 30 2023, 12:43 PM

Mentioned in SAL (#wikimedia-operations) [2023-08-30T12:43:34Z] <taavi@deploy1002> Started scap: Backport for [[gerrit:951591|wmf-config: remove public subnets from reverse-proxy.php (T344704 T329219)]]

Stashbot mentioned this in T344704: Blocked on English Wikipedia / Wikimedia thinks my IP is 10.80.1.11.Aug 30 2023, 12:43 PM
Stashbot added a comment.Aug 30 2023, 12:46 PM

Mentioned in SAL (#wikimedia-operations) [2023-08-30T12:46:50Z] <taavi@deploy1002> sukhe and taavi: Backport for [[gerrit:951591|wmf-config: remove public subnets from reverse-proxy.php (T344704 T329219)]] synced to the testservers mwdebug2002.codfw.wmnet, mwdebug1001.eqiad.wmnet, mwdebug1002.eqiad.wmnet, mwdebug2001.codfw.wmnet, and mw-debug kubernetes deployment (accessible via k8s-experimental XWD option)

Stashbot added a comment.Aug 30 2023, 12:55 PM

Mentioned in SAL (#wikimedia-operations) [2023-08-30T12:55:02Z] <taavi@deploy1002> Finished scap: Backport for [[gerrit:951591|wmf-config: remove public subnets from reverse-proxy.php (T344704 T329219)]] (duration: 11m 28s)

gerritbot added a comment.Sep 5 2023, 3:58 PM

Change 954965 had a related patch set uploaded (by Ssingh; author: Ssingh):

[operations/homer/public@master] asw1-b*27-esams: add durum300[34]

https://gerrit.wikimedia.org/r/954965

cmooney closed subtask T343214: New IP and Vlan allocations for esams knams move as Resolved.Sep 6 2023, 12:36 PM
gerritbot added a comment.Sep 6 2023, 1:20 PM

Change 954965 merged by Ssingh:

[operations/homer/public@master] asw1-b*27-esams: add durum300[34]

https://gerrit.wikimedia.org/r/954965

RobH closed subtask Unknown Object (Task) as Resolved.Sep 7 2023, 7:21 PM
Papaul closed subtask Unknown Object (Task) as Resolved.Sep 8 2023, 1:29 PM
gerritbot added a comment.Sep 8 2023, 1:55 PM

Change 955943 had a related patch set uploaded (by Ssingh; author: Ssingh):

[operations/dns@master] 27.35.198.in-addr.arpa: update PTR for 198.35.27.27

https://gerrit.wikimedia.org/r/955943

gerritbot added a comment.Sep 8 2023, 3:21 PM

Change 955961 had a related patch set uploaded (by Ssingh; author: Ssingh):

[operations/puppet@production] hiera: remove references to nsa.wikimedia.org

https://gerrit.wikimedia.org/r/955961

gerritbot added a comment.Sep 8 2023, 3:27 PM

Change 955943 merged by Ssingh:

[operations/dns@master] 27.35.198.in-addr.arpa: update PTR for 198.35.27.27

https://gerrit.wikimedia.org/r/955943

gerritbot added a comment.Sep 8 2023, 3:33 PM

Change 955962 had a related patch set uploaded (by Ssingh; author: Ssingh):

[operations/dns@master] wikimedia.org: remove nsa.wikimedia.org

https://gerrit.wikimedia.org/r/955962

gerritbot added a comment.Sep 12 2023, 1:50 PM

Change 955961 merged by Ssingh:

[operations/puppet@production] hiera: remove references to nsa.wikimedia.org

https://gerrit.wikimedia.org/r/955961

gerritbot added a comment.Sep 12 2023, 5:49 PM

Change 955962 merged by Ssingh:

[operations/dns@master] wikimedia.org: remove nsa.wikimedia.org

https://gerrit.wikimedia.org/r/955962

ayounsi closed subtask T331886: Q4/Q1:knams racking elevations & planning as Resolved.Oct 3 2023, 1:04 PM
Stashbot added a comment.Oct 12 2023, 1:43 PM

Mentioned in SAL (#wikimedia-operations) [2023-10-12T13:43:40Z] <sukhe> remove old ns2 IP 91.198.174.239/32 from /e/n/i on A:dns-rec: T329219

Vgutierrez mentioned this in T348446: CRs ECMP traffic to LVS VIPs despite higher MED on backup route.Oct 16 2023, 8:24 AM
ayounsi closed subtask Unknown Object (Task) as Resolved.Oct 30 2023, 4:35 PM
RobH closed subtask T344129: Update on-wiki documentation about esams as Resolved.Nov 6 2023, 7:48 PM
ayounsi reopened subtask T344129: Update on-wiki documentation about esams as Open.Nov 7 2023, 10:00 AM
RobH closed subtask T344129: Update on-wiki documentation about esams as Resolved.Nov 7 2023, 5:40 PM
gerritbot added a comment.Nov 21 2023, 1:14 PM

Change 976210 had a related patch set uploaded (by Ssingh; author: Ssingh):

[operations/software/pywmflib@master] constants: update ns2 IP address

https://gerrit.wikimedia.org/r/976210

gerritbot added a comment.Nov 21 2023, 1:23 PM

Change 976210 merged by Volans:

[operations/software/pywmflib@master] constants: update ns2 IP address

https://gerrit.wikimedia.org/r/976210

RobH closed subtask Unknown Object (Task) as Resolved.Nov 27 2023, 8:51 PM
wiki_willy closed subtask Unknown Object (Task) as Resolved.Dec 1 2023, 10:04 PM
Papaul reopened subtask Unknown Object (Task) as Open.Jan 22 2024, 11:53 PM
ssingh closed subtask T344363: Q1:unified decommission task for old esams hosts (knams migration) as Resolved.Jan 23 2024, 1:19 AM
Papaul closed subtask Unknown Object (Task) as Resolved.Jan 23 2024, 2:19 AM
RobH closed subtask Restricted Task as Resolved.Feb 20 2024, 3:10 PM
RobH closed this task as Resolved.Feb 20 2024, 3:29 PM
RobH removed wiki_willy as the assignee of this task.
RobH closed subtask Unknown Object (Task) as Resolved.

Only two sub-tasks open, T350621 and T342239 which are both being taken care of on their own tasks. As such a master tracking task is no longer required and is being resolved.

Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL