Page MenuHomePhabricator
Create Task
Maniphest T246604

Install 1 buster+10.4 host per section
Closed, ResolvedPublic
Actions

Description

  • s1
    • db1107
    • db2085:3311
  • s2
    • db1103:3312
    • db2125
  • s3
    • db1078
    • db2109
  • s4
    • db1103:3314
    • db2084:3314
  • s5
    • db1096:3315
    • db2084:3315
  • s6
    • db1096:3316
    • db1098:3316
    • db2114
  • s7
    • db1098:3317
    • db2121
  • s8
    • db1111
    • db2085:3318
  • x1
    • db1137
    • db2115
  • pc2
    • pc1008
    • pc2008

Details

SubjectRepoBranchLines +/-
install_server: Allow reimage db1137operations/puppetproduction+1 -1
install_server: Allow reimage db2121operations/puppetproduction+1 -1
install_server: Reimage db2121 to busteroperations/puppetproduction+0 -1
install_server: Allow reimage of db2125operations/puppetproduction+1 -1
install_server: Reimage db2125 to busteroperations/puppetproduction+0 -1
install_server: Allow reimage of db2126operations/puppetproduction+1 -1
install_server: Reimage db2126 to busteroperations/puppetproduction+0 -1
install_server: Allow reimage db2114operations/puppetproduction+1 -1
install_server: Reimage db2114 to busteroperations/puppetproduction+0 -1
install_server: Allow reimage db2084operations/puppetproduction+1 -1
db2084: Reimage to busteroperations/puppetproduction+0 -1
install_server: Allow reimage of db2085operations/puppetproduction+1 -1
db2085: Reimage to busteroperations/puppetproduction+0 -1
mariadb: Set 10.4 as default for busteroperations/puppetproduction+1 -1
install_server: Revert to original no-srv-format lineoperations/puppetproduction+1 -1
install_server: Allow reimage db1078 and db2109operations/puppetproduction+1 -0
install_server: Reimage db1078 and db2109operations/puppetproduction+0 -2
install_server: Allow reimage db1103operations/puppetproduction+1 -1
install_server: Reimage db1103 with busteroperations/puppetproduction+0 -2
db1098: Enable notificationsoperations/puppetproduction+0 -1
install_server: Allow manual reimage db109[6-9]operations/puppetproduction+1 -2
mariadb: Reimage db1098operations/puppetproduction+1 -1
db1096: Disable notificationsoperations/puppetproduction+1 -0
Show related patches Customize query in gerrit

Related Objects
Search...

StatusSubtypeAssignedTask
 StalledNoneT302086 Set scap minimum python version to 3.7
 ResolvedNoneT247045 Migrate all of production metal and VMs to Buster or later
 ResolvedMarosteguiT250666 Upgrade WMF database-and-backup-related hosts to buster
 ResolvedMarosteguiT244696 Remove deprecated status options from grafana in mariadb 10.4
 ResolvedMarosteguiT242702 Test MariaDB 10.4 in production
 ResolvedMarosteguiT246604 Install 1 buster+10.4 host per section
 ResolvedMarosteguiT245489 Possibly disable optimizer flag: rowid_filter on 10.4
 ResolvedMarosteguiT246069 Slow query on 10.4: SpecialRecentChanges::doMainQuery
 ResolvedMarosteguiT247728 Events set to SLAVESIDE_DISABLED when upgrading from 10.1 to 10.4
 DeclinedMarosteguiT249188 Reimage labsdb1011 to Buster and MariaDB 10.4
 ResolvedMarosteguiT248843 Upgrade wmf-pt-kill package for Debian Buster
 ResolvedJclark-ctrT251481 Recreate RAID on labsdb1011
 ResolvedKormatT252182 Upgrade parsercache to Buster and MariaDB 10.4
 ResolvedKormatT252761 Research performance changes on prometheus-mysqld-exporter after buster/mariadb upgrade
 ResolvedMarosteguiT254556 Upgrade m1 to Buster and Mariadb 10.4
 ResolvedMarosteguiT254870 Upgrade analytics dbstore databases to Buster and Mariadb 10.4
 ResolvedMarosteguiT254871 Upgrade x1 databases to Buster and Mariadb 10.4
 ResolvedMarosteguiT255408 Upgrade dbproxyXXXX to Buster
 ResolvedMarosteguiT255755 Switchover es5 master from es1023 to es1024
 ResolvedKormatT257284 Upgrade es4 to debian buster + mariadb 10.4
 ResolvedKormatT257847 Switchover es4 master from es1020 to es1021
 ResolvedMarosteguiT257540 Upgrade m2 to Buster and Mariadb 10.4
 ResolvedjcrespoT257928 Create a parallel OTRS database with a frozen snapshot of the production one
 ResolvedMarosteguiT259589 Upgrade m3 to Buster and MariaDB 10.4
 ResolvedMarosteguiT260324 Upgrade m5 to Buster and MariaDB 10.4
 ResolvedMarosteguiT254688 SpecialWhatLinksHere::showIndirectLinks on wikidatawiki needs optimizing
 ResolvedtaaviT268628 Upgrade deployment-prep-db hosts to buster/MariaDB 10.4
 ResolvedNoneT276968 deployment-db05 needs replacing following disk corruption
 ResolvedzeljkofilipinT277044 selenium-daily-beta(commons)-MediaWiki fails with `readonly: The wiki is currently in read-only mode.`
 ResolvedtaaviT277070 Beta cluster master switchover to deployment-db07
 ResolvedMarosteguiT268742 Test upgrading sanitarium hosts to Buster + 10.4
 ResolvedMarosteguiT272008 Move wikireplicas under the new sanitarium hosts (db1154, db1155)
 ResolvedCmjohnsonT272125 Memory errors on clouddb1019
 ResolveddcaroT272127 2021-01-15: ** PROBLEM alert - labstore1004/Ensure mysql credential creation for tools users is running is CRITICAL **
 ResolvedMarosteguiT280492 Upgrade all sanitarium masters to 10.4 and Buster
 ResolvedRequestwiki_willyT281794 decommission db1082.eqiad.wmnet
 ResolvedRequestCmjohnsonT281959 decommission db1074.eqiad.wmnet
 ResolvedRequestCmjohnsonT282079 decommission db1079.eqiad.wmnet
 ResolvedRequestCmjohnsonT282093 decommission db1087.eqiad.wmnet
 ResolvedRequestCmjohnsonT282096 decommission db1085.eqiad.wmnet
 ResolvedMoritzMuehlenhoffT224589 Migrate dbmonitor hosts to Buster
 ResolvedMarosteguiT249085 Convert Tendril TokuDB tables to InnoDB
 ResolvedMarosteguiT275112 Migrate codfw sanitarium hosts (db2094/db2095) to Buster and 10.4
 DuplicateNoneT280315 Migrate sanitarium masters to 10.4 and Buster
 ResolvedKormatT280751 Upgrade s6 to Debian Buster and MariaDB 10.4
 ResolvedKormatT282124 Switchover s6 from db1131 to db1173
 ResolvedsgrabarczukT282144 Read-only window needed for s6 (frwiki, jawiki, ruwiki)
 ResolvedjcrespoT280979 Upgrade pending stretch backup hosts to buster
 ResolvedjcrespoT281094 xtrabackup --prepare hits open_files_limit on buster
 ResolvedjcrespoT284980 Put db2100 back into service after hardware maintenance
 ResolvedKormatT288244 Upgrade s7 to Debian Buster and MariaDB 10.4
 ResolvedKormatT289129 Switchover s7 from db2118 to db2121
 ResolvedsgrabarczukT289130 Read-only window needed for s7
 ResolvedKormatT289856 Restore db2118

Event Timeline

There are a very large number of changes, so older changes are hidden. Show Older Changes
Stashbot added a comment.Mar 6 2020, 7:50 AM

Mentioned in SAL (#wikimedia-operations) [2020-03-06T07:50:18Z] <marostegui> Stop MySQL on db2085:3311, db2085:3318 for reimage to buster T246604

ops-monitoring-bot added a comment.Mar 6 2020, 7:55 AM

Script wmf-auto-reimage was launched by marostegui on cumin1001.eqiad.wmnet for hosts:

['db2085.codfw.wmnet']

The log can be found in /var/log/wmf-auto-reimage/202003060755_marostegui_257799.log.

Maintenance_bot removed a project: Patch-For-Review.Mar 6 2020, 8:10 AM
ops-monitoring-bot added a comment.Mar 6 2020, 8:16 AM

Completed auto-reimage of hosts:

['db2085.codfw.wmnet']

and were ALL successful.

Stashbot added a comment.Mar 6 2020, 8:25 AM

Mentioned in SAL (#wikimedia-operations) [2020-03-06T08:25:49Z] <marostegui@cumin1001> dbctl commit (dc=all): 'Slowly repool db1078 T246604', diff saved to https://phabricator.wikimedia.org/P10637 and previous config saved to /var/cache/conftool/dbconfig/20200306-082549-marostegui.json

Stashbot added a comment.Mar 6 2020, 8:28 AM

Mentioned in SAL (#wikimedia-operations) [2020-03-06T08:28:59Z] <marostegui@cumin1001> dbctl commit (dc=all): 'Repool db2085:3311, db2085:3318 after reimage to buster - T246604', diff saved to https://phabricator.wikimedia.org/P10638 and previous config saved to /var/cache/conftool/dbconfig/20200306-082858-marostegui.json

Stashbot added a comment.Mar 6 2020, 8:41 AM

Mentioned in SAL (#wikimedia-operations) [2020-03-06T08:41:41Z] <marostegui@cumin1001> dbctl commit (dc=all): 'Fully repool db1078 T246604', diff saved to https://phabricator.wikimedia.org/P10639 and previous config saved to /var/cache/conftool/dbconfig/20200306-084141-marostegui.json

Marostegui updated the task description. (Show Details)Mar 6 2020, 8:42 AM
gerritbot added a comment.Mar 6 2020, 9:18 AM

Change 577518 had a related patch set uploaded (by Marostegui; owner: Marostegui):
[operations/puppet@production] install_server: Allow reimage db2084

https://gerrit.wikimedia.org/r/577518

gerritbot added a project: Patch-For-Review.Mar 6 2020, 9:18 AM

Change 577518 merged by Marostegui:
[operations/puppet@production] install_server: Allow reimage db2084

https://gerrit.wikimedia.org/r/577518

Stashbot added a comment.Mar 6 2020, 9:21 AM

Mentioned in SAL (#wikimedia-operations) [2020-03-06T09:21:04Z] <marostegui@cumin1001> dbctl commit (dc=all): 'Depool db2084:3314, db2084:3315 for reimage to buster - T246604', diff saved to https://phabricator.wikimedia.org/P10645 and previous config saved to /var/cache/conftool/dbconfig/20200306-092103-marostegui.json

Stashbot added a comment.Mar 6 2020, 9:21 AM

Mentioned in SAL (#wikimedia-operations) [2020-03-06T09:21:36Z] <marostegui> Stop MySQL on db2084:3315, db2084:3314 for reimage T246604

gerritbot added a comment.Mar 6 2020, 9:22 AM

Change 577520 had a related patch set uploaded (by Marostegui; owner: Marostegui):
[operations/puppet@production] db2084: Reimage to buster

https://gerrit.wikimedia.org/r/577520

gerritbot added a comment.Mar 6 2020, 9:24 AM

Change 577520 merged by Marostegui:
[operations/puppet@production] db2084: Reimage to buster

https://gerrit.wikimedia.org/r/577520

ops-monitoring-bot added a comment.Mar 6 2020, 9:28 AM

Script wmf-auto-reimage was launched by marostegui on cumin1001.eqiad.wmnet for hosts:

['db2084.codfw.wmnet']

The log can be found in /var/log/wmf-auto-reimage/202003060928_marostegui_13048.log.

ops-monitoring-bot added a comment.Mar 6 2020, 9:48 AM

Completed auto-reimage of hosts:

['db2084.codfw.wmnet']

and were ALL successful.

Stashbot added a comment.Mar 6 2020, 9:54 AM

Mentioned in SAL (#wikimedia-operations) [2020-03-06T09:54:07Z] <marostegui@cumin1001> dbctl commit (dc=all): 'Repool db2084:3314, db2084:3315 after reimage to buster - T246604', diff saved to https://phabricator.wikimedia.org/P10647 and previous config saved to /var/cache/conftool/dbconfig/20200306-095407-marostegui.json

Maintenance_bot removed a project: Patch-For-Review.Mar 6 2020, 10:10 AM
Marostegui updated the task description. (Show Details)Mar 6 2020, 10:14 AM
gerritbot added a comment.Mar 9 2020, 6:58 AM

Change 578172 had a related patch set uploaded (by Marostegui; owner: Marostegui):
[operations/puppet@production] install_server: Allow reimage db2114

https://gerrit.wikimedia.org/r/578172

gerritbot added a project: Patch-For-Review.Mar 9 2020, 6:58 AM
gerritbot added a comment.Mar 9 2020, 7:04 AM

Change 578172 merged by Marostegui:
[operations/puppet@production] install_server: Allow reimage db2114

https://gerrit.wikimedia.org/r/578172

Stashbot added a comment.Mar 9 2020, 7:09 AM

Mentioned in SAL (#wikimedia-operations) [2020-03-09T07:09:38Z] <marostegui@cumin1001> dbctl commit (dc=all): 'Depool db2114 for reimage to buster - T246604', diff saved to https://phabricator.wikimedia.org/P10654 and previous config saved to /var/cache/conftool/dbconfig/20200309-070937-marostegui.json

Maintenance_bot removed a project: Patch-For-Review.Mar 9 2020, 7:10 AM
gerritbot added a comment.Mar 9 2020, 7:10 AM

Change 578178 had a related patch set uploaded (by Marostegui; owner: Marostegui):
[operations/puppet@production] install_server: Reimage db2114 to buster

https://gerrit.wikimedia.org/r/578178

gerritbot added a project: Patch-For-Review.Mar 9 2020, 7:10 AM

Change 578178 merged by Marostegui:
[operations/puppet@production] install_server: Reimage db2114 to buster

https://gerrit.wikimedia.org/r/578178

ops-monitoring-bot added a comment.Mar 9 2020, 7:15 AM

Script wmf-auto-reimage was launched by marostegui on cumin1001.eqiad.wmnet for hosts:

['db2114.codfw.wmnet']

The log can be found in /var/log/wmf-auto-reimage/202003090715_marostegui_180669.log.

ops-monitoring-bot added a comment.Mar 9 2020, 7:35 AM

Completed auto-reimage of hosts:

['db2114.codfw.wmnet']

and were ALL successful.

Stashbot added a comment.Mar 9 2020, 7:46 AM

Mentioned in SAL (#wikimedia-operations) [2020-03-09T07:46:30Z] <marostegui@cumin1001> dbctl commit (dc=all): 'Repool db2114 after reimage to buster - T246604', diff saved to https://phabricator.wikimedia.org/P10655 and previous config saved to /var/cache/conftool/dbconfig/20200309-074629-marostegui.json

Marostegui updated the task description. (Show Details)Mar 9 2020, 7:46 AM
gerritbot added a comment.Mar 9 2020, 8:19 AM

Change 578280 had a related patch set uploaded (by Marostegui; owner: Marostegui):
[operations/puppet@production] install_server: Allow reimage of db2126

https://gerrit.wikimedia.org/r/578280

gerritbot added a comment.Mar 9 2020, 8:20 AM

Change 578280 merged by Marostegui:
[operations/puppet@production] install_server: Allow reimage of db2126

https://gerrit.wikimedia.org/r/578280

Stashbot added a comment.Mar 9 2020, 8:21 AM

Mentioned in SAL (#wikimedia-operations) [2020-03-09T08:21:19Z] <marostegui@cumin1001> dbctl commit (dc=all): 'Depool db2126 for reimage to buster - T246604', diff saved to https://phabricator.wikimedia.org/P10656 and previous config saved to /var/cache/conftool/dbconfig/20200309-082118-marostegui.json

gerritbot added a comment.Mar 9 2020, 8:23 AM

Change 578281 had a related patch set uploaded (by Marostegui; owner: Marostegui):
[operations/puppet@production] install_server: Reimage db2126 to buster

https://gerrit.wikimedia.org/r/578281

gerritbot added a comment.Mar 9 2020, 8:25 AM

Change 578281 merged by Marostegui:
[operations/puppet@production] install_server: Reimage db2126 to buster

https://gerrit.wikimedia.org/r/578281

Marostegui added a comment.Mar 9 2020, 8:30 AM

db2126 is the sanitarium master for s2, so I am not going to re-image it. Will pick another one for s2

gerritbot added a comment.Mar 9 2020, 8:36 AM

Change 578285 had a related patch set uploaded (by Marostegui; owner: Marostegui):
[operations/puppet@production] install_server: Allow reimage of db2125

https://gerrit.wikimedia.org/r/578285

Stashbot added a comment.Mar 9 2020, 8:37 AM

Mentioned in SAL (#wikimedia-operations) [2020-03-09T08:37:12Z] <marostegui@cumin1001> dbctl commit (dc=all): 'Depool db2125 for reimage to buster - T246604', diff saved to https://phabricator.wikimedia.org/P10658 and previous config saved to /var/cache/conftool/dbconfig/20200309-083711-marostegui.json

gerritbot added a comment.Mar 9 2020, 8:38 AM

Change 578285 merged by Marostegui:
[operations/puppet@production] install_server: Allow reimage of db2125

https://gerrit.wikimedia.org/r/578285

gerritbot added a comment.Mar 9 2020, 8:40 AM

Change 578287 had a related patch set uploaded (by Marostegui; owner: Marostegui):
[operations/puppet@production] install_server: Reimage db2125 to buster

https://gerrit.wikimedia.org/r/578287

gerritbot added a comment.Mar 9 2020, 8:42 AM

Change 578287 merged by Marostegui:
[operations/puppet@production] install_server: Reimage db2125 to buster

https://gerrit.wikimedia.org/r/578287

ops-monitoring-bot added a comment.Mar 9 2020, 8:45 AM

Script wmf-auto-reimage was launched by marostegui on cumin1001.eqiad.wmnet for hosts:

['db2125.codfw.wmnet']

The log can be found in /var/log/wmf-auto-reimage/202003090845_marostegui_196714.log.

ops-monitoring-bot added a comment.Mar 9 2020, 9:13 AM

Completed auto-reimage of hosts:

['db2125.codfw.wmnet']

and were ALL successful.

Marostegui updated the task description. (Show Details)Mar 9 2020, 9:14 AM
Marostegui updated the task description. (Show Details)Mar 9 2020, 9:20 AM
Marostegui updated the task description. (Show Details)Mar 9 2020, 9:27 AM
Stashbot added a comment.Mar 9 2020, 3:24 PM

Mentioned in SAL (#wikimedia-operations) [2020-03-09T15:24:28Z] <marostegui@cumin1001> dbctl commit (dc=all): 'Repool db2125 - T246604', diff saved to https://phabricator.wikimedia.org/P10666 and previous config saved to /var/cache/conftool/dbconfig/20200309-152427-marostegui.json

gerritbot added a comment.Mar 10 2020, 7:58 AM

Change 578472 had a related patch set uploaded (by Marostegui; owner: Marostegui):
[operations/puppet@production] install_server: Allow reimage db2121

https://gerrit.wikimedia.org/r/578472

gerritbot added a comment.Mar 10 2020, 8:01 AM

Change 578472 merged by Marostegui:
[operations/puppet@production] install_server: Allow reimage db2121

https://gerrit.wikimedia.org/r/578472

gerritbot added a comment.Mar 10 2020, 8:05 AM

Change 578473 had a related patch set uploaded (by Marostegui; owner: Marostegui):
[operations/puppet@production] install_server: Reimage db2121 to buster

https://gerrit.wikimedia.org/r/578473

gerritbot added a comment.Mar 10 2020, 8:19 AM

Change 578473 merged by Marostegui:
[operations/puppet@production] install_server: Reimage db2121 to buster

https://gerrit.wikimedia.org/r/578473

Maintenance_bot removed a project: Patch-For-Review.Mar 10 2020, 9:10 AM
Stashbot added a comment.Mar 10 2020, 1:46 PM

Mentioned in SAL (#wikimedia-operations) [2020-03-10T13:46:48Z] <marostegui@cumin1001> dbctl commit (dc=all): 'Depool db2121 for reimage to buster - T246604', diff saved to https://phabricator.wikimedia.org/P10676 and previous config saved to /var/cache/conftool/dbconfig/20200310-134648-marostegui.json

Stashbot added a comment.Mar 10 2020, 1:52 PM

Mentioned in SAL (#wikimedia-operations) [2020-03-10T13:52:31Z] <marostegui> Stop mysql on db2121 for reimage to buster T246604

ops-monitoring-bot added a comment.Mar 10 2020, 1:55 PM

Script wmf-auto-reimage was launched by marostegui on cumin1001.eqiad.wmnet for hosts:

['db2121.codfw.wmnet']

The log can be found in /var/log/wmf-auto-reimage/202003101355_marostegui_227323.log.

ops-monitoring-bot added a comment.Mar 10 2020, 2:22 PM

Completed auto-reimage of hosts:

['db2121.codfw.wmnet']

and were ALL successful.

Stashbot added a comment.Mar 10 2020, 2:48 PM

Mentioned in SAL (#wikimedia-operations) [2020-03-10T14:48:17Z] <marostegui@cumin1001> dbctl commit (dc=all): 'Repool db2121 - T246604', diff saved to https://phabricator.wikimedia.org/P10677 and previous config saved to /var/cache/conftool/dbconfig/20200310-144817-root.json

Dzahn added a parent task: T247045: Migrate all of production metal and VMs to Buster or later.Mar 14 2020, 12:19 AM
Marostegui updated the task description. (Show Details)Mar 16 2020, 8:19 AM
Marostegui added a comment.Mar 16 2020, 8:22 AM

Some of these hosts had events disabled due to T247728
I have checked and enabled the ones missing.

Marostegui closed this task as Resolved.Mar 18 2020, 9:40 AM
Marostegui updated the task description. (Show Details)

This is done

Marostegui mentioned this in T247978: Quarry query became work much slower.Mar 20 2020, 10:24 AM
gerritbot added a comment.Mar 25 2020, 7:17 AM

Change 583211 had a related patch set uploaded (by Marostegui; owner: Marostegui):
[operations/puppet@production] install_server: Allow reimage db1137

https://gerrit.wikimedia.org/r/583211

gerritbot added a project: Patch-For-Review.Mar 25 2020, 7:17 AM
gerritbot added a comment.Mar 25 2020, 8:29 AM

Change 583211 merged by Marostegui:
[operations/puppet@production] install_server: Allow reimage db1137

https://gerrit.wikimedia.org/r/583211

ops-monitoring-bot added a comment.Mar 25 2020, 8:40 AM

Script wmf-auto-reimage was launched by marostegui on cumin1001.eqiad.wmnet for hosts:

['db1137.eqiad.wmnet']

The log can be found in /var/log/wmf-auto-reimage/202003250839_marostegui_81114.log.

ops-monitoring-bot added a comment.Mar 25 2020, 8:59 AM

Completed auto-reimage of hosts:

['db1137.eqiad.wmnet']

and were ALL successful.

ops-monitoring-bot added a comment.Mar 25 2020, 12:47 PM

Script wmf-auto-reimage was launched by marostegui on cumin1001.eqiad.wmnet for hosts:

['db2115.codfw.wmnet']

The log can be found in /var/log/wmf-auto-reimage/202003251247_marostegui_113904.log.

ops-monitoring-bot added a comment.Mar 25 2020, 1:04 PM

Completed auto-reimage of hosts:

['db2115.codfw.wmnet']

Of which those FAILED:

['db2115.codfw.wmnet']
ops-monitoring-bot added a comment.Mar 25 2020, 1:36 PM

Script wmf-auto-reimage was launched by marostegui on cumin1001.eqiad.wmnet for hosts:

['db2115.codfw.wmnet']

The log can be found in /var/log/wmf-auto-reimage/202003251336_marostegui_119447.log.

Maintenance_bot removed a project: Patch-For-Review.Mar 25 2020, 2:10 PM
ops-monitoring-bot added a comment.Mar 25 2020, 2:13 PM

Completed auto-reimage of hosts:

['db2115.codfw.wmnet']

and were ALL successful.

Marostegui mentioned this in T248333: Schema change: Make page.page_restrictions column NULL.Mar 27 2020, 9:44 AM
Marostegui updated the task description. (Show Details)
ops-monitoring-bot added a comment.Apr 9 2020, 5:39 AM

Script wmf-auto-reimage was launched by marostegui on cumin1001.eqiad.wmnet for hosts:

['pc2008.codfw.wmnet']

The log can be found in /var/log/wmf-auto-reimage/202004090539_marostegui_55860.log.

ops-monitoring-bot added a comment.Apr 9 2020, 5:47 AM

Script wmf-auto-reimage was launched by marostegui on cumin1001.eqiad.wmnet for hosts:

['pc2008.codfw.wmnet']

The log can be found in /var/log/wmf-auto-reimage/202004090547_marostegui_56325.log.

ops-monitoring-bot added a comment.Apr 9 2020, 6:26 AM

Script wmf-auto-reimage was launched by marostegui on cumin1001.eqiad.wmnet for hosts:

['pc2008.codfw.wmnet']

The log can be found in /var/log/wmf-auto-reimage/202004090626_marostegui_61258.log.

ops-monitoring-bot added a comment.Apr 9 2020, 7:06 AM

Completed auto-reimage of hosts:

['pc2008.codfw.wmnet']

and were ALL successful.

Marostegui updated the task description. (Show Details)Apr 9 2020, 7:09 AM
Marostegui added a comment.Apr 9 2020, 8:27 AM

pc2008 is now running buster and 10.4
pt-heartbeat seems to be also running without issues.

ops-monitoring-bot added a comment.Apr 10 2020, 6:03 AM

Script wmf-auto-reimage was launched by marostegui on cumin1001.eqiad.wmnet for hosts:

['pc1008.eqiad.wmnet']

The log can be found in /var/log/wmf-auto-reimage/202004100603_marostegui_235860.log.

ops-monitoring-bot added a comment.Apr 10 2020, 6:27 AM

Completed auto-reimage of hosts:

['pc1008.eqiad.wmnet']

and were ALL successful.

Marostegui updated the task description. (Show Details)Apr 10 2020, 9:29 AM
Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL