Page MenuHomePhabricator

ops-monitoring-bot (Operations Monitoring Bot)
UserBot

Projects

Today

  • Clear sailing ahead.

Tomorrow

  • Clear sailing ahead.

Friday

  • Clear sailing ahead.

User Details

User Since
Aug 12 2016, 1:45 PM (232 w, 4 d)
Roles
Bot
Availability
Available
LDAP User
Unknown
MediaWiki User
Unknown

Bot managed by SRE for automated interaction with Phabricator from monitoring tools.

Recent Activity

Today

ops-monitoring-bot created T273034: Degraded RAID on an-worker1099.
Wed, Jan 27, 9:36 AM · Analytics, SRE, ops-eqiad
ops-monitoring-bot added a comment to T245757: Upgrade MediaWiki clusters to Debian Buster (debian 10).

Completed auto-reimage of hosts:

['mw2295.codfw.wmnet', 'mw2296.codfw.wmnet']
Wed, Jan 27, 1:14 AM · User-jijiki, SRE, Release-Engineering-Team (Deployment services), Release-Engineering-Team-TODO, serviceops
ops-monitoring-bot added a comment to T245757: Upgrade MediaWiki clusters to Debian Buster (debian 10).

Script wmf-auto-reimage was launched by legoktm on cumin1001.eqiad.wmnet for hosts:

['mw2295.codfw.wmnet', 'mw2296.codfw.wmnet']

The log can be found in /var/log/wmf-auto-reimage/202101270030_legoktm_3434.log.

Wed, Jan 27, 12:30 AM · User-jijiki, SRE, Release-Engineering-Team (Deployment services), Release-Engineering-Team-TODO, serviceops
ops-monitoring-bot added a comment to T272713: Failing HTTP check on WDQS servers after latest deployment.

Icinga downtime set by ryankemper@cumin1001 for 2:00:00 1 host(s) and their services with reason: Enabling envoy for wdqs-internal

wdqs2008.codfw.wmnet
Wed, Jan 27, 12:16 AM · Patch-For-Review, Discovery-Search (Current work)
ops-monitoring-bot added a comment to T272713: Failing HTTP check on WDQS servers after latest deployment.

Icinga downtime set by ryankemper@cumin1001 for 2:00:00 1 host(s) and their services with reason: Enabling envoy for wdqs-internal

wdqs2005.codfw.wmnet
Wed, Jan 27, 12:15 AM · Patch-For-Review, Discovery-Search (Current work)
ops-monitoring-bot added a comment to T272713: Failing HTTP check on WDQS servers after latest deployment.

Icinga downtime set by ryankemper@cumin1001 for 2:00:00 1 host(s) and their services with reason: Enabling envoy for wdqs-internal

wdqs2006.codfw.wmnet
Wed, Jan 27, 12:15 AM · Patch-For-Review, Discovery-Search (Current work)
ops-monitoring-bot added a comment to T272713: Failing HTTP check on WDQS servers after latest deployment.

Icinga downtime set by ryankemper@cumin1001 for 2:00:00 1 host(s) and their services with reason: Enabling envoy for wdqs-internal

wdqs2004.codfw.wmnet
Wed, Jan 27, 12:15 AM · Patch-For-Review, Discovery-Search (Current work)
ops-monitoring-bot added a comment to T272713: Failing HTTP check on WDQS servers after latest deployment.

Icinga downtime set by ryankemper@cumin1001 for 2:00:00 1 host(s) and their services with reason: Enabling envoy for wdqs-internal

wdqs1011.eqiad.wmnet
Wed, Jan 27, 12:15 AM · Patch-For-Review, Discovery-Search (Current work)
ops-monitoring-bot added a comment to T272713: Failing HTTP check on WDQS servers after latest deployment.

Icinga downtime set by ryankemper@cumin1001 for 2:00:00 1 host(s) and their services with reason: Enabling envoy for wdqs-internal

wdqs1008.eqiad.wmnet
Wed, Jan 27, 12:15 AM · Patch-For-Review, Discovery-Search (Current work)
ops-monitoring-bot added a comment to T272713: Failing HTTP check on WDQS servers after latest deployment.

Icinga downtime set by ryankemper@cumin1001 for 2:00:00 1 host(s) and their services with reason: Enabling envoy for wdqs-internal

wdqs1003.eqiad.wmnet
Wed, Jan 27, 12:14 AM · Patch-For-Review, Discovery-Search (Current work)

Yesterday

ops-monitoring-bot added a comment to T245757: Upgrade MediaWiki clusters to Debian Buster (debian 10).

Completed auto-reimage of hosts:

['mw1264.eqiad.wmnet']
Tue, Jan 26, 11:17 PM · User-jijiki, SRE, Release-Engineering-Team (Deployment services), Release-Engineering-Team-TODO, serviceops
ops-monitoring-bot added a comment to T245757: Upgrade MediaWiki clusters to Debian Buster (debian 10).

Completed auto-reimage of hosts:

['mw2297.codfw.wmnet']
Tue, Jan 26, 10:45 PM · User-jijiki, SRE, Release-Engineering-Team (Deployment services), Release-Engineering-Team-TODO, serviceops
ops-monitoring-bot added a comment to T245757: Upgrade MediaWiki clusters to Debian Buster (debian 10).

Completed auto-reimage of hosts:

['mw2299.codfw.wmnet']
Tue, Jan 26, 10:40 PM · User-jijiki, SRE, Release-Engineering-Team (Deployment services), Release-Engineering-Team-TODO, serviceops
ops-monitoring-bot added a comment to T245757: Upgrade MediaWiki clusters to Debian Buster (debian 10).

Completed auto-reimage of hosts:

['mw2298.codfw.wmnet']
Tue, Jan 26, 10:40 PM · User-jijiki, SRE, Release-Engineering-Team (Deployment services), Release-Engineering-Team-TODO, serviceops
ops-monitoring-bot added a comment to T245757: Upgrade MediaWiki clusters to Debian Buster (debian 10).

Completed auto-reimage of hosts:

['mw2300.codfw.wmnet']
Tue, Jan 26, 10:20 PM · User-jijiki, SRE, Release-Engineering-Team (Deployment services), Release-Engineering-Team-TODO, serviceops
ops-monitoring-bot added a comment to T245757: Upgrade MediaWiki clusters to Debian Buster (debian 10).

Completed auto-reimage of hosts:

['mw2302.codfw.wmnet']
Tue, Jan 26, 10:12 PM · User-jijiki, SRE, Release-Engineering-Team (Deployment services), Release-Engineering-Team-TODO, serviceops
ops-monitoring-bot added a comment to T245757: Upgrade MediaWiki clusters to Debian Buster (debian 10).

Script wmf-auto-reimage was launched by dzahn on cumin1001.eqiad.wmnet for hosts:

mw2297.codfw.wmnet

The log can be found in /var/log/wmf-auto-reimage/202101262202_dzahn_1083_mw2297_codfw_wmnet.log.

Tue, Jan 26, 10:02 PM · User-jijiki, SRE, Release-Engineering-Team (Deployment services), Release-Engineering-Team-TODO, serviceops
ops-monitoring-bot added a comment to T245757: Upgrade MediaWiki clusters to Debian Buster (debian 10).

Script wmf-auto-reimage was launched by dzahn on cumin1001.eqiad.wmnet for hosts:

mw1264.eqiad.wmnet

The log can be found in /var/log/wmf-auto-reimage/202101262201_dzahn_813_mw1264_eqiad_wmnet.log.

Tue, Jan 26, 10:01 PM · User-jijiki, SRE, Release-Engineering-Team (Deployment services), Release-Engineering-Team-TODO, serviceops
ops-monitoring-bot added a comment to T245757: Upgrade MediaWiki clusters to Debian Buster (debian 10).

Script wmf-auto-reimage was launched by dzahn on cumin1001.eqiad.wmnet for hosts:

mw2298.codfw.wmnet

The log can be found in /var/log/wmf-auto-reimage/202101262157_dzahn_32427_mw2298_codfw_wmnet.log.

Tue, Jan 26, 9:57 PM · User-jijiki, SRE, Release-Engineering-Team (Deployment services), Release-Engineering-Team-TODO, serviceops
ops-monitoring-bot added a comment to T245757: Upgrade MediaWiki clusters to Debian Buster (debian 10).

Script wmf-auto-reimage was launched by dzahn on cumin1001.eqiad.wmnet for hosts:

mw2299.codfw.wmnet

The log can be found in /var/log/wmf-auto-reimage/202101262156_dzahn_32245_mw2299_codfw_wmnet.log.

Tue, Jan 26, 9:56 PM · User-jijiki, SRE, Release-Engineering-Team (Deployment services), Release-Engineering-Team-TODO, serviceops
ops-monitoring-bot added a comment to T245757: Upgrade MediaWiki clusters to Debian Buster (debian 10).

Completed auto-reimage of hosts:

['mw2304.codfw.wmnet']
Tue, Jan 26, 9:38 PM · User-jijiki, SRE, Release-Engineering-Team (Deployment services), Release-Engineering-Team-TODO, serviceops
ops-monitoring-bot added a comment to T245757: Upgrade MediaWiki clusters to Debian Buster (debian 10).

Script wmf-auto-reimage was launched by legoktm on cumin1001.eqiad.wmnet for hosts:

mw2300.codfw.wmnet

The log can be found in /var/log/wmf-auto-reimage/202101262136_legoktm_30392_mw2300_codfw_wmnet.log.

Tue, Jan 26, 9:37 PM · User-jijiki, SRE, Release-Engineering-Team (Deployment services), Release-Engineering-Team-TODO, serviceops
ops-monitoring-bot added a comment to T245757: Upgrade MediaWiki clusters to Debian Buster (debian 10).

Completed auto-reimage of hosts:

['mw2306.codfw.wmnet']
Tue, Jan 26, 9:34 PM · User-jijiki, SRE, Release-Engineering-Team (Deployment services), Release-Engineering-Team-TODO, serviceops
ops-monitoring-bot added a comment to T245757: Upgrade MediaWiki clusters to Debian Buster (debian 10).

Script wmf-auto-reimage was launched by dzahn on cumin1001.eqiad.wmnet for hosts:

mw2302.codfw.wmnet

The log can be found in /var/log/wmf-auto-reimage/202101262129_dzahn_24775_mw2302_codfw_wmnet.log.

Tue, Jan 26, 9:29 PM · User-jijiki, SRE, Release-Engineering-Team (Deployment services), Release-Engineering-Team-TODO, serviceops
ops-monitoring-bot added a comment to T245757: Upgrade MediaWiki clusters to Debian Buster (debian 10).

Completed auto-reimage of hosts:

['mw1337.eqiad.wmnet']
Tue, Jan 26, 9:29 PM · User-jijiki, SRE, Release-Engineering-Team (Deployment services), Release-Engineering-Team-TODO, serviceops
ops-monitoring-bot added a comment to T245757: Upgrade MediaWiki clusters to Debian Buster (debian 10).

Completed auto-reimage of hosts:

['mw1338.eqiad.wmnet']
Tue, Jan 26, 9:28 PM · User-jijiki, SRE, Release-Engineering-Team (Deployment services), Release-Engineering-Team-TODO, serviceops
ops-monitoring-bot added a comment to T272444: decommission relforge1001.eqiad.wmnet and relforge1002.eqiad.wmnet.

cookbooks.sre.hosts.decommission executed by ryankemper@cumin1001 for hosts: relforge1002.eqiad.wmnet

  • relforge1002.eqiad.wmnet (PASS)
    • Downtimed host on Icinga
    • Found physical host
    • Downtimed management interface on Icinga
    • Wiped bootloaders
    • Powered off
    • Set Netbox status to Decommissioning and deleted all non-mgmt interfaces and related IPs
    • Removed from DebMonitor
    • Removed from Puppet master and PuppetDB
Tue, Jan 26, 9:15 PM · SRE, ops-eqiad, Patch-For-Review, Discovery-Search (Current work), decommission-hardware
ops-monitoring-bot added a comment to T245757: Upgrade MediaWiki clusters to Debian Buster (debian 10).

Completed auto-reimage of hosts:

['mw2308.codfw.wmnet']
Tue, Jan 26, 9:14 PM · User-jijiki, SRE, Release-Engineering-Team (Deployment services), Release-Engineering-Team-TODO, serviceops
ops-monitoring-bot added a comment to T245757: Upgrade MediaWiki clusters to Debian Buster (debian 10).

Script wmf-auto-reimage was launched by dzahn on cumin1001.eqiad.wmnet for hosts:

mw2304.codfw.wmnet

The log can be found in /var/log/wmf-auto-reimage/202101262056_dzahn_14507_mw2304_codfw_wmnet.log.

Tue, Jan 26, 8:56 PM · User-jijiki, SRE, Release-Engineering-Team (Deployment services), Release-Engineering-Team-TODO, serviceops
ops-monitoring-bot added a comment to T245757: Upgrade MediaWiki clusters to Debian Buster (debian 10).

Script wmf-auto-reimage was launched by dzahn on cumin1001.eqiad.wmnet for hosts:

mw2306.codfw.wmnet

The log can be found in /var/log/wmf-auto-reimage/202101262052_dzahn_14030_mw2306_codfw_wmnet.log.

Tue, Jan 26, 8:52 PM · User-jijiki, SRE, Release-Engineering-Team (Deployment services), Release-Engineering-Team-TODO, serviceops
ops-monitoring-bot added a comment to T272444: decommission relforge1001.eqiad.wmnet and relforge1002.eqiad.wmnet.

cookbooks.sre.hosts.decommission executed by ryankemper@cumin1001 for hosts: relforge1001.eqiad.wmnet

  • relforge1001.eqiad.wmnet (PASS)
    • Downtimed host on Icinga
    • Found physical host
    • Downtimed management interface on Icinga
    • Wiped bootloaders
    • Powered off
    • Set Netbox status to Decommissioning and deleted all non-mgmt interfaces and related IPs
    • Removed from DebMonitor
    • Removed from Puppet master and PuppetDB
Tue, Jan 26, 8:52 PM · SRE, ops-eqiad, Patch-For-Review, Discovery-Search (Current work), decommission-hardware
ops-monitoring-bot added a comment to T245757: Upgrade MediaWiki clusters to Debian Buster (debian 10).

Completed auto-reimage of hosts:

['mw1413.eqiad.wmnet']
Tue, Jan 26, 8:49 PM · User-jijiki, SRE, Release-Engineering-Team (Deployment services), Release-Engineering-Team-TODO, serviceops
ops-monitoring-bot added a comment to T245757: Upgrade MediaWiki clusters to Debian Buster (debian 10).

Completed auto-reimage of hosts:

['mw1411.eqiad.wmnet']
Tue, Jan 26, 8:45 PM · User-jijiki, SRE, Release-Engineering-Team (Deployment services), Release-Engineering-Team-TODO, serviceops
ops-monitoring-bot added a comment to T245757: Upgrade MediaWiki clusters to Debian Buster (debian 10).

Script wmf-auto-reimage was launched by dzahn on cumin1001.eqiad.wmnet for hosts:

mw2308.codfw.wmnet

The log can be found in /var/log/wmf-auto-reimage/202101262031_dzahn_6640_mw2308_codfw_wmnet.log.

Tue, Jan 26, 8:31 PM · User-jijiki, SRE, Release-Engineering-Team (Deployment services), Release-Engineering-Team-TODO, serviceops
ops-monitoring-bot added a comment to T245757: Upgrade MediaWiki clusters to Debian Buster (debian 10).

Script wmf-auto-reimage was launched by dzahn on cumin1001.eqiad.wmnet for hosts:

mw1338.eqiad.wmnet

The log can be found in /var/log/wmf-auto-reimage/202101262016_dzahn_4545_mw1338_eqiad_wmnet.log.

Tue, Jan 26, 8:16 PM · User-jijiki, SRE, Release-Engineering-Team (Deployment services), Release-Engineering-Team-TODO, serviceops
ops-monitoring-bot added a comment to T245757: Upgrade MediaWiki clusters to Debian Buster (debian 10).

Script wmf-auto-reimage was launched by dzahn on cumin1001.eqiad.wmnet for hosts:

mw1337.eqiad.wmnet

The log can be found in /var/log/wmf-auto-reimage/202101262015_dzahn_4477_mw1337_eqiad_wmnet.log.

Tue, Jan 26, 8:15 PM · User-jijiki, SRE, Release-Engineering-Team (Deployment services), Release-Engineering-Team-TODO, serviceops
ops-monitoring-bot added a comment to T245757: Upgrade MediaWiki clusters to Debian Buster (debian 10).

Script wmf-auto-reimage was launched by dzahn on cumin1001.eqiad.wmnet for hosts:

mw1413.eqiad.wmnet

The log can be found in /var/log/wmf-auto-reimage/202101262009_dzahn_3710_mw1413_eqiad_wmnet.log.

Tue, Jan 26, 8:09 PM · User-jijiki, SRE, Release-Engineering-Team (Deployment services), Release-Engineering-Team-TODO, serviceops
ops-monitoring-bot added a comment to T245757: Upgrade MediaWiki clusters to Debian Buster (debian 10).

Script wmf-auto-reimage was launched by dzahn on cumin1001.eqiad.wmnet for hosts:

mw1411.eqiad.wmnet

The log can be found in /var/log/wmf-auto-reimage/202101262005_dzahn_3085_mw1411_eqiad_wmnet.log.

Tue, Jan 26, 8:05 PM · User-jijiki, SRE, Release-Engineering-Team (Deployment services), Release-Engineering-Team-TODO, serviceops
ops-monitoring-bot added a comment to T245757: Upgrade MediaWiki clusters to Debian Buster (debian 10).

Completed auto-reimage of hosts:

['mw2317.codfw.wmnet']
Tue, Jan 26, 7:41 PM · User-jijiki, SRE, Release-Engineering-Team (Deployment services), Release-Engineering-Team-TODO, serviceops
ops-monitoring-bot added a comment to T245757: Upgrade MediaWiki clusters to Debian Buster (debian 10).

Script wmf-auto-reimage was launched by legoktm on cumin1001.eqiad.wmnet for hosts:

mw2317.codfw.wmnet

The log can be found in /var/log/wmf-auto-reimage/202101261855_legoktm_14699_mw2317_codfw_wmnet.log.

Tue, Jan 26, 6:57 PM · User-jijiki, SRE, Release-Engineering-Team (Deployment services), Release-Engineering-Team-TODO, serviceops
ops-monitoring-bot added a comment to T238753: [OSM] Backport imposm3 to the debian channel.

Completed auto-reimage of hosts:

['maps1009.eqiad.wmnet']
Tue, Jan 26, 6:50 PM · Discovery-Search, serviceops, Maps, Product-Infrastructure-Team-Backlog
ops-monitoring-bot added a comment to T245757: Upgrade MediaWiki clusters to Debian Buster (debian 10).

Completed auto-reimage of hosts:

['mw1408.eqiad.wmnet']
Tue, Jan 26, 6:07 PM · User-jijiki, SRE, Release-Engineering-Team (Deployment services), Release-Engineering-Team-TODO, serviceops
ops-monitoring-bot added a comment to T245757: Upgrade MediaWiki clusters to Debian Buster (debian 10).

Completed auto-reimage of hosts:

['mw1409.eqiad.wmnet']
Tue, Jan 26, 6:06 PM · User-jijiki, SRE, Release-Engineering-Team (Deployment services), Release-Engineering-Team-TODO, serviceops
ops-monitoring-bot added a comment to T245757: Upgrade MediaWiki clusters to Debian Buster (debian 10).

Completed auto-reimage of hosts:

['mw1337.eqiad.wmnet']
Tue, Jan 26, 5:49 PM · User-jijiki, SRE, Release-Engineering-Team (Deployment services), Release-Engineering-Team-TODO, serviceops
ops-monitoring-bot added a comment to T245757: Upgrade MediaWiki clusters to Debian Buster (debian 10).

Completed auto-reimage of hosts:

['mw2321.codfw.wmnet']
Tue, Jan 26, 5:30 PM · User-jijiki, SRE, Release-Engineering-Team (Deployment services), Release-Engineering-Team-TODO, serviceops
ops-monitoring-bot added a comment to T245757: Upgrade MediaWiki clusters to Debian Buster (debian 10).

Script wmf-auto-reimage was launched by dzahn on cumin1001.eqiad.wmnet for hosts:

mw1408.eqiad.wmnet

The log can be found in /var/log/wmf-auto-reimage/202101261727_dzahn_17856_mw1408_eqiad_wmnet.log.

Tue, Jan 26, 5:27 PM · User-jijiki, SRE, Release-Engineering-Team (Deployment services), Release-Engineering-Team-TODO, serviceops
ops-monitoring-bot added a comment to T245757: Upgrade MediaWiki clusters to Debian Buster (debian 10).

Script wmf-auto-reimage was launched by dzahn on cumin1001.eqiad.wmnet for hosts:

mw1409.eqiad.wmnet

The log can be found in /var/log/wmf-auto-reimage/202101261726_dzahn_17778_mw1409_eqiad_wmnet.log.

Tue, Jan 26, 5:27 PM · User-jijiki, SRE, Release-Engineering-Team (Deployment services), Release-Engineering-Team-TODO, serviceops
ops-monitoring-bot added a comment to T245757: Upgrade MediaWiki clusters to Debian Buster (debian 10).

Completed auto-reimage of hosts:

['mw1408.eqiad.wmnet']
Tue, Jan 26, 5:19 PM · User-jijiki, SRE, Release-Engineering-Team (Deployment services), Release-Engineering-Team-TODO, serviceops
ops-monitoring-bot added a comment to T245757: Upgrade MediaWiki clusters to Debian Buster (debian 10).

Completed auto-reimage of hosts:

['mw1409.eqiad.wmnet']
Tue, Jan 26, 5:18 PM · User-jijiki, SRE, Release-Engineering-Team (Deployment services), Release-Engineering-Team-TODO, serviceops
ops-monitoring-bot added a comment to T245757: Upgrade MediaWiki clusters to Debian Buster (debian 10).

Script wmf-auto-reimage was launched by dzahn on cumin1001.eqiad.wmnet for hosts:

mw2321.codfw.wmnet

The log can be found in /var/log/wmf-auto-reimage/202101261645_dzahn_17234_mw2321_codfw_wmnet.log.

Tue, Jan 26, 4:45 PM · User-jijiki, SRE, Release-Engineering-Team (Deployment services), Release-Engineering-Team-TODO, serviceops
ops-monitoring-bot added a comment to T245757: Upgrade MediaWiki clusters to Debian Buster (debian 10).

Completed auto-reimage of hosts:

['mw2321.codfw.wmnet']
Tue, Jan 26, 4:45 PM · User-jijiki, SRE, Release-Engineering-Team (Deployment services), Release-Engineering-Team-TODO, serviceops
ops-monitoring-bot added a comment to T245757: Upgrade MediaWiki clusters to Debian Buster (debian 10).

Script wmf-auto-reimage was launched by dzahn on cumin1001.eqiad.wmnet for hosts:

mw2321.codfw.wmnet

The log can be found in /var/log/wmf-auto-reimage/202101261645_dzahn_16624_mw2321_codfw_wmnet.log.

Tue, Jan 26, 4:45 PM · User-jijiki, SRE, Release-Engineering-Team (Deployment services), Release-Engineering-Team-TODO, serviceops
ops-monitoring-bot added a comment to T245757: Upgrade MediaWiki clusters to Debian Buster (debian 10).

Script wmf-auto-reimage was launched by dzahn on cumin1001.eqiad.wmnet for hosts:

mw1337.eqiad.wmnet

The log can be found in /var/log/wmf-auto-reimage/202101261643_dzahn_14848_mw1337_eqiad_wmnet.log.

Tue, Jan 26, 4:43 PM · User-jijiki, SRE, Release-Engineering-Team (Deployment services), Release-Engineering-Team-TODO, serviceops
ops-monitoring-bot added a comment to T245757: Upgrade MediaWiki clusters to Debian Buster (debian 10).

Script wmf-auto-reimage was launched by dzahn on cumin1001.eqiad.wmnet for hosts:

mw1408.eqiad.wmnet

The log can be found in /var/log/wmf-auto-reimage/202101261640_dzahn_12287_mw1408_eqiad_wmnet.log.

Tue, Jan 26, 4:40 PM · User-jijiki, SRE, Release-Engineering-Team (Deployment services), Release-Engineering-Team-TODO, serviceops
ops-monitoring-bot added a comment to T245757: Upgrade MediaWiki clusters to Debian Buster (debian 10).

Script wmf-auto-reimage was launched by dzahn on cumin1001.eqiad.wmnet for hosts:

mw1409.eqiad.wmnet

The log can be found in /var/log/wmf-auto-reimage/202101261638_dzahn_10409_mw1409_eqiad_wmnet.log.

Tue, Jan 26, 4:39 PM · User-jijiki, SRE, Release-Engineering-Team (Deployment services), Release-Engineering-Team-TODO, serviceops
ops-monitoring-bot added a comment to T238753: [OSM] Backport imposm3 to the debian channel.

Script wmf-auto-reimage was launched by hnowlan on cumin1001.eqiad.wmnet for hosts:

['maps1009.eqiad.wmnet']

The log can be found in /var/log/wmf-auto-reimage/202101261627_hnowlan_28505.log.

Tue, Jan 26, 4:27 PM · Discovery-Search, serviceops, Maps, Product-Infrastructure-Team-Backlog
ops-monitoring-bot added a comment to T238753: [OSM] Backport imposm3 to the debian channel.

Completed auto-reimage of hosts:

['maps1009.eqiad.wmnet']
Tue, Jan 26, 2:55 PM · Discovery-Search, serviceops, Maps, Product-Infrastructure-Team-Backlog
ops-monitoring-bot added a comment to T238753: [OSM] Backport imposm3 to the debian channel.

Script wmf-auto-reimage was launched by hnowlan on cumin1001.eqiad.wmnet for hosts:

['maps1009.eqiad.wmnet']

The log can be found in /var/log/wmf-auto-reimage/202101261443_hnowlan_19435.log.

Tue, Jan 26, 2:43 PM · Discovery-Search, serviceops, Maps, Product-Infrastructure-Team-Backlog
ops-monitoring-bot added a comment to T267932: decommission analytics10[42-57].

cookbooks.sre.hosts.decommission executed by elukey@cumin1001 for hosts: analytics1053.eqiad.wmnet

  • analytics1053.eqiad.wmnet (FAIL)
    • Failed downtime host on Icinga (likely already removed)
    • Host steps raised exception: Invalid management FQDN analytics1053.mgmt.eqiad.wmnet for analytics1053.eqiad.wmnet
Tue, Jan 26, 11:47 AM · decommission-hardware
ops-monitoring-bot added a comment to T260445: (Need By: TBD) rack/setup/install an-worker11[18-41].

Completed auto-reimage of hosts:

['an-worker1131.eqiad.wmnet', 'an-worker1119.eqiad.wmnet']
Tue, Jan 26, 8:35 AM · Analytics-Clusters, SRE, ops-eqiad, DC-Ops
ops-monitoring-bot added a comment to T258361: Productionize db1155-db1175 and refresh and decommission db1074-db1095 (22 servers).

Completed auto-reimage of hosts:

['db1160.eqiad.wmnet']
Tue, Jan 26, 8:26 AM · Patch-For-Review, SRE, DBA
ops-monitoring-bot added a comment to T260445: (Need By: TBD) rack/setup/install an-worker11[18-41].

Script wmf-auto-reimage was launched by elukey on cumin1001.eqiad.wmnet for hosts:

['an-worker1119.eqiad.wmnet', 'an-worker1131.eqiad.wmnet']

The log can be found in /var/log/wmf-auto-reimage/202101260812_elukey_31698.log.

Tue, Jan 26, 8:13 AM · Analytics-Clusters, SRE, ops-eqiad, DC-Ops
ops-monitoring-bot added a comment to T258361: Productionize db1155-db1175 and refresh and decommission db1074-db1095 (22 servers).

Script wmf-auto-reimage was launched by marostegui on cumin1001.eqiad.wmnet for hosts:

['db1160.eqiad.wmnet']

The log can be found in /var/log/wmf-auto-reimage/202101260805_marostegui_24756.log.

Tue, Jan 26, 8:05 AM · Patch-For-Review, SRE, DBA

Mon, Jan 25

ops-monitoring-bot added a comment to T245757: Upgrade MediaWiki clusters to Debian Buster (debian 10).

Completed auto-reimage of hosts:

['mw2318.codfw.wmnet']
Mon, Jan 25, 11:31 PM · User-jijiki, SRE, Release-Engineering-Team (Deployment services), Release-Engineering-Team-TODO, serviceops
ops-monitoring-bot added a comment to T245757: Upgrade MediaWiki clusters to Debian Buster (debian 10).

Completed auto-reimage of hosts:

['mw2319.codfw.wmnet']
Mon, Jan 25, 11:30 PM · User-jijiki, SRE, Release-Engineering-Team (Deployment services), Release-Engineering-Team-TODO, serviceops
ops-monitoring-bot added a comment to T245757: Upgrade MediaWiki clusters to Debian Buster (debian 10).

Completed auto-reimage of hosts:

['mw2320.codfw.wmnet']
Mon, Jan 25, 11:25 PM · User-jijiki, SRE, Release-Engineering-Team (Deployment services), Release-Engineering-Team-TODO, serviceops
ops-monitoring-bot added a comment to T245757: Upgrade MediaWiki clusters to Debian Buster (debian 10).

Completed auto-reimage of hosts:

['mw2331.codfw.wmnet']
Mon, Jan 25, 11:24 PM · User-jijiki, SRE, Release-Engineering-Team (Deployment services), Release-Engineering-Team-TODO, serviceops
ops-monitoring-bot added a comment to T245757: Upgrade MediaWiki clusters to Debian Buster (debian 10).

Script wmf-auto-reimage was launched by dzahn on cumin1001.eqiad.wmnet for hosts:

mw2318.codfw.wmnet

The log can be found in /var/log/wmf-auto-reimage/202101252247_dzahn_20078_mw2318_codfw_wmnet.log.

Mon, Jan 25, 10:47 PM · User-jijiki, SRE, Release-Engineering-Team (Deployment services), Release-Engineering-Team-TODO, serviceops
ops-monitoring-bot added a comment to T245757: Upgrade MediaWiki clusters to Debian Buster (debian 10).

Script wmf-auto-reimage was launched by dzahn on cumin1001.eqiad.wmnet for hosts:

mw2319.codfw.wmnet

The log can be found in /var/log/wmf-auto-reimage/202101252245_dzahn_19861_mw2319_codfw_wmnet.log.

Mon, Jan 25, 10:46 PM · User-jijiki, SRE, Release-Engineering-Team (Deployment services), Release-Engineering-Team-TODO, serviceops
ops-monitoring-bot added a comment to T245757: Upgrade MediaWiki clusters to Debian Buster (debian 10).

Script wmf-auto-reimage was launched by dzahn on cumin1001.eqiad.wmnet for hosts:

mw2331.codfw.wmnet

The log can be found in /var/log/wmf-auto-reimage/202101252241_dzahn_19428_mw2331_codfw_wmnet.log.

Mon, Jan 25, 10:41 PM · User-jijiki, SRE, Release-Engineering-Team (Deployment services), Release-Engineering-Team-TODO, serviceops
ops-monitoring-bot added a comment to T245757: Upgrade MediaWiki clusters to Debian Buster (debian 10).

Completed auto-reimage of hosts:

['mw2321.codfw.wmnet']
Mon, Jan 25, 10:41 PM · User-jijiki, SRE, Release-Engineering-Team (Deployment services), Release-Engineering-Team-TODO, serviceops
ops-monitoring-bot added a comment to T245757: Upgrade MediaWiki clusters to Debian Buster (debian 10).

Script wmf-auto-reimage was launched by dzahn on cumin1001.eqiad.wmnet for hosts:

mw2321.codfw.wmnet

The log can be found in /var/log/wmf-auto-reimage/202101252241_dzahn_19369_mw2321_codfw_wmnet.log.

Mon, Jan 25, 10:41 PM · User-jijiki, SRE, Release-Engineering-Team (Deployment services), Release-Engineering-Team-TODO, serviceops
ops-monitoring-bot added a comment to T245757: Upgrade MediaWiki clusters to Debian Buster (debian 10).

Script wmf-auto-reimage was launched by dzahn on cumin1001.eqiad.wmnet for hosts:

mw2320.codfw.wmnet

The log can be found in /var/log/wmf-auto-reimage/202101252240_dzahn_19303_mw2320_codfw_wmnet.log.

Mon, Jan 25, 10:40 PM · User-jijiki, SRE, Release-Engineering-Team (Deployment services), Release-Engineering-Team-TODO, serviceops
ops-monitoring-bot added a comment to T245757: Upgrade MediaWiki clusters to Debian Buster (debian 10).

Completed auto-reimage of hosts:

['mw2320.codfw.wmnet']
Mon, Jan 25, 10:39 PM · User-jijiki, SRE, Release-Engineering-Team (Deployment services), Release-Engineering-Team-TODO, serviceops
ops-monitoring-bot added a comment to T245757: Upgrade MediaWiki clusters to Debian Buster (debian 10).

Script wmf-auto-reimage was launched by dzahn on cumin2001.codfw.wmnet for hosts:

mw2320.codfw.wmnet

The log can be found in /var/log/wmf-auto-reimage/202101252238_dzahn_31834_mw2320_codfw_wmnet.log.

Mon, Jan 25, 10:39 PM · User-jijiki, SRE, Release-Engineering-Team (Deployment services), Release-Engineering-Team-TODO, serviceops
ops-monitoring-bot added a comment to T245757: Upgrade MediaWiki clusters to Debian Buster (debian 10).

Completed auto-reimage of hosts:

['mw2320.codfw.wmnet']
Mon, Jan 25, 10:38 PM · User-jijiki, SRE, Release-Engineering-Team (Deployment services), Release-Engineering-Team-TODO, serviceops
ops-monitoring-bot added a comment to T245757: Upgrade MediaWiki clusters to Debian Buster (debian 10).

Script wmf-auto-reimage was launched by dzahn on cumin1001.eqiad.wmnet for hosts:

mw2320.codfw.wmnet

The log can be found in /var/log/wmf-auto-reimage/202101252238_dzahn_19183_mw2320_codfw_wmnet.log.

Mon, Jan 25, 10:38 PM · User-jijiki, SRE, Release-Engineering-Team (Deployment services), Release-Engineering-Team-TODO, serviceops
ops-monitoring-bot added a comment to T245757: Upgrade MediaWiki clusters to Debian Buster (debian 10).

Completed auto-reimage of hosts:

['mw2320.codfw.wmnet']
Mon, Jan 25, 10:36 PM · User-jijiki, SRE, Release-Engineering-Team (Deployment services), Release-Engineering-Team-TODO, serviceops
ops-monitoring-bot added a comment to T245757: Upgrade MediaWiki clusters to Debian Buster (debian 10).

Script wmf-auto-reimage was launched by dzahn on cumin1001.eqiad.wmnet for hosts:

mw2320.codfw.wmnet

The log can be found in /var/log/wmf-auto-reimage/202101252235_dzahn_19041_mw2320_codfw_wmnet.log.

Mon, Jan 25, 10:35 PM · User-jijiki, SRE, Release-Engineering-Team (Deployment services), Release-Engineering-Team-TODO, serviceops
ops-monitoring-bot added a comment to T245757: Upgrade MediaWiki clusters to Debian Buster (debian 10).

Completed auto-reimage of hosts:

['mw2321.codfw.wmnet']
Mon, Jan 25, 10:35 PM · User-jijiki, SRE, Release-Engineering-Team (Deployment services), Release-Engineering-Team-TODO, serviceops
ops-monitoring-bot added a comment to T245757: Upgrade MediaWiki clusters to Debian Buster (debian 10).

Script wmf-auto-reimage was launched by dzahn on cumin1001.eqiad.wmnet for hosts:

mw2321.codfw.wmnet

The log can be found in /var/log/wmf-auto-reimage/202101252235_dzahn_18999_mw2321_codfw_wmnet.log.

Mon, Jan 25, 10:35 PM · User-jijiki, SRE, Release-Engineering-Team (Deployment services), Release-Engineering-Team-TODO, serviceops
ops-monitoring-bot added a comment to T245757: Upgrade MediaWiki clusters to Debian Buster (debian 10).

Completed auto-reimage of hosts:

['mw1338.eqiad.wmnet']
Mon, Jan 25, 9:53 PM · User-jijiki, SRE, Release-Engineering-Team (Deployment services), Release-Engineering-Team-TODO, serviceops
ops-monitoring-bot added a comment to T271590: (Need By: TBD) rack/setup/install cloudgw2002-dev.codfw.wmnet.

Completed auto-reimage of hosts:

['cloudgw2002-dev.codfw.wmnet']
Mon, Jan 25, 9:19 PM · cloud-services-team (Kanban), ops-codfw, SRE, DC-Ops
ops-monitoring-bot added a comment to T245757: Upgrade MediaWiki clusters to Debian Buster (debian 10).

Completed auto-reimage of hosts:

['mw2323.codfw.wmnet']
Mon, Jan 25, 8:52 PM · User-jijiki, SRE, Release-Engineering-Team (Deployment services), Release-Engineering-Team-TODO, serviceops
ops-monitoring-bot added a comment to T271590: (Need By: TBD) rack/setup/install cloudgw2002-dev.codfw.wmnet.

Script wmf-auto-reimage was launched by pt1979 on cumin2001.codfw.wmnet for hosts:

cloudgw2002-dev.codfw.wmnet

The log can be found in /var/log/wmf-auto-reimage/202101252052_pt1979_12785_cloudgw2002-dev_codfw_wmnet.log.

Mon, Jan 25, 8:52 PM · cloud-services-team (Kanban), ops-codfw, SRE, DC-Ops
ops-monitoring-bot added a comment to T245757: Upgrade MediaWiki clusters to Debian Buster (debian 10).

Completed auto-reimage of hosts:

['mw2322.codfw.wmnet']
Mon, Jan 25, 8:50 PM · User-jijiki, SRE, Release-Engineering-Team (Deployment services), Release-Engineering-Team-TODO, serviceops
ops-monitoring-bot added a comment to T245757: Upgrade MediaWiki clusters to Debian Buster (debian 10).

Completed auto-reimage of hosts:

['mw2326.codfw.wmnet']
Mon, Jan 25, 8:46 PM · User-jijiki, SRE, Release-Engineering-Team (Deployment services), Release-Engineering-Team-TODO, serviceops
ops-monitoring-bot added a comment to T245757: Upgrade MediaWiki clusters to Debian Buster (debian 10).

Script wmf-auto-reimage was launched by dzahn on cumin1001.eqiad.wmnet for hosts:

mw1338.eqiad.wmnet

The log can be found in /var/log/wmf-auto-reimage/202101252044_dzahn_23847_mw1338_eqiad_wmnet.log.

Mon, Jan 25, 8:45 PM · User-jijiki, SRE, Release-Engineering-Team (Deployment services), Release-Engineering-Team-TODO, serviceops
ops-monitoring-bot added a comment to T245757: Upgrade MediaWiki clusters to Debian Buster (debian 10).

Completed auto-reimage of hosts:

['mw1410.eqiad.wmnet']
Mon, Jan 25, 8:35 PM · User-jijiki, SRE, Release-Engineering-Team (Deployment services), Release-Engineering-Team-TODO, serviceops
ops-monitoring-bot added a comment to T245757: Upgrade MediaWiki clusters to Debian Buster (debian 10).

Script wmf-auto-reimage was launched by dzahn on cumin1001.eqiad.wmnet for hosts:

mw2323.codfw.wmnet

The log can be found in /var/log/wmf-auto-reimage/202101252003_dzahn_12169_mw2323_codfw_wmnet.log.

Mon, Jan 25, 8:04 PM · User-jijiki, SRE, Release-Engineering-Team (Deployment services), Release-Engineering-Team-TODO, serviceops
ops-monitoring-bot added a comment to T245757: Upgrade MediaWiki clusters to Debian Buster (debian 10).

Script wmf-auto-reimage was launched by dzahn on cumin1001.eqiad.wmnet for hosts:

mw2322.codfw.wmnet

The log can be found in /var/log/wmf-auto-reimage/202101252002_dzahn_11968_mw2322_codfw_wmnet.log.

Mon, Jan 25, 8:02 PM · User-jijiki, SRE, Release-Engineering-Team (Deployment services), Release-Engineering-Team-TODO, serviceops
ops-monitoring-bot added a comment to T245757: Upgrade MediaWiki clusters to Debian Buster (debian 10).

Completed auto-reimage of hosts:

['mw2326.codfw.wmnet']
Mon, Jan 25, 8:01 PM · User-jijiki, SRE, Release-Engineering-Team (Deployment services), Release-Engineering-Team-TODO, serviceops
ops-monitoring-bot added a comment to T245757: Upgrade MediaWiki clusters to Debian Buster (debian 10).

Script wmf-auto-reimage was launched by dzahn on cumin1001.eqiad.wmnet for hosts:

mw2326.codfw.wmnet

The log can be found in /var/log/wmf-auto-reimage/202101252001_dzahn_11846_mw2326_codfw_wmnet.log.

Mon, Jan 25, 8:01 PM · User-jijiki, SRE, Release-Engineering-Team (Deployment services), Release-Engineering-Team-TODO, serviceops
ops-monitoring-bot added a comment to T245757: Upgrade MediaWiki clusters to Debian Buster (debian 10).

Script wmf-auto-reimage was launched by dzahn on cumin1001.eqiad.wmnet for hosts:

mw2326.codfw.wmnet

The log can be found in /var/log/wmf-auto-reimage/202101251957_dzahn_11387_mw2326_codfw_wmnet.log.

Mon, Jan 25, 7:58 PM · User-jijiki, SRE, Release-Engineering-Team (Deployment services), Release-Engineering-Team-TODO, serviceops
ops-monitoring-bot added a comment to T245757: Upgrade MediaWiki clusters to Debian Buster (debian 10).

Completed auto-reimage of hosts:

['mw2326.codfw.wmnet']
Mon, Jan 25, 7:57 PM · User-jijiki, SRE, Release-Engineering-Team (Deployment services), Release-Engineering-Team-TODO, serviceops
ops-monitoring-bot added a comment to T245757: Upgrade MediaWiki clusters to Debian Buster (debian 10).

Script wmf-auto-reimage was launched by dzahn on cumin1001.eqiad.wmnet for hosts:

mw2326.codfw.wmnet

The log can be found in /var/log/wmf-auto-reimage/202101251957_dzahn_11290_mw2326_codfw_wmnet.log.

Mon, Jan 25, 7:57 PM · User-jijiki, SRE, Release-Engineering-Team (Deployment services), Release-Engineering-Team-TODO, serviceops
ops-monitoring-bot added a comment to T245757: Upgrade MediaWiki clusters to Debian Buster (debian 10).

Script wmf-auto-reimage was launched by dzahn on cumin1001.eqiad.wmnet for hosts:

mw1410.eqiad.wmnet

The log can be found in /var/log/wmf-auto-reimage/202101251956_dzahn_11179_mw1410_eqiad_wmnet.log.

Mon, Jan 25, 7:56 PM · User-jijiki, SRE, Release-Engineering-Team (Deployment services), Release-Engineering-Team-TODO, serviceops
ops-monitoring-bot added a comment to T245757: Upgrade MediaWiki clusters to Debian Buster (debian 10).

Completed auto-reimage of hosts:

['mw2324.codfw.wmnet']
Mon, Jan 25, 7:15 PM · User-jijiki, SRE, Release-Engineering-Team (Deployment services), Release-Engineering-Team-TODO, serviceops
ops-monitoring-bot added a comment to T245757: Upgrade MediaWiki clusters to Debian Buster (debian 10).

Completed auto-reimage of hosts:

['mw2326.codfw.wmnet']
Mon, Jan 25, 7:14 PM · User-jijiki, SRE, Release-Engineering-Team (Deployment services), Release-Engineering-Team-TODO, serviceops
ops-monitoring-bot added a comment to T245757: Upgrade MediaWiki clusters to Debian Buster (debian 10).

Completed auto-reimage of hosts:

['mw1412.eqiad.wmnet']
Mon, Jan 25, 6:58 PM · User-jijiki, SRE, Release-Engineering-Team (Deployment services), Release-Engineering-Team-TODO, serviceops