Page MenuHomePhabricator
Create Task
Maniphest T204311

Upgrade all core (mediawiki) database servers to mariadb 10.1
Closed, ResolvedPublic
Actions

Description

Finish the upgrade to MariaDB 10.1.

  • db1061 blocked on T204493
  • db1062 blocked on T204302
  • db1068
  • db1070
  • db1071
  • db1075

Details

SubjectRepoBranchLines +/-
mariadb: Disallow reimage to all hosts except the test dboperations/puppetproduction+2 -2
mariadb: Disable notifications on db1061operations/puppetproduction+1 -0
mariadb: Disable notifications for db1071operations/puppetproduction+1 -0
mariadb: Reimage db1071 to stretchoperations/puppetproduction+0 -2
mariadb: Reimage db1061 to stretchoperations/puppetproduction+0 -2
mariadb: Disable notifications on db1068operations/puppetproduction+1 -0
mariadb: Reimage db1068 to stretchoperations/puppetproduction+0 -2
Customize query in gerrit

Related Objects
Search...

Event Timeline

• jcrespo triaged this task as Medium priority.Sep 14 2018, 10:03 AM
• jcrespo created this task.
Restricted Application removed a project: Patch-For-Review. · View Herald TranscriptSep 14 2018, 10:03 AM
Marostegui updated the task description. (Show Details)Sep 14 2018, 10:05 AM
Marostegui moved this task from Triage to In progress on the DBA board.
ops-monitoring-bot subscribed.Sep 14 2018, 10:05 AM

Script wmf-auto-reimage was launched by banyek on neodymium.eqiad.wmnet for hosts:

['db1070.eqiad.wmnet']

The log can be found in /var/log/wmf-auto-reimage/201809141004_banyek_11275.log.

Marostegui removed a project: Epic.Sep 14 2018, 10:05 AM
Marostegui updated the task description. (Show Details)
Marostegui updated the task description. (Show Details)Sep 14 2018, 10:09 AM
ops-monitoring-bot added a comment.Sep 14 2018, 10:58 AM

Completed auto-reimage of hosts:

['db1070.eqiad.wmnet']

and were ALL successful.

• jcrespo updated the task description. (Show Details)Sep 14 2018, 10:59 AM
• jcrespo claimed this task.Sep 14 2018, 1:02 PM
• jcrespo added a subtask: T204302: db1062 management interface busy (no sessions allowed).Sep 14 2018, 1:32 PM
• Cmjohnson closed subtask T204302: db1062 management interface busy (no sessions allowed) as Resolved.Sep 14 2018, 3:20 PM
• jcrespo added a comment.Sep 14 2018, 4:02 PM

db1090 took a long time to recover replication lag after db1062 initial maintenance, even more than dbstore1002- need to check why next week.

gerritbot added a comment.Sep 17 2018, 8:30 AM

Change 460857 had a related patch set uploaded (by Jcrespo; owner: Jcrespo):
[operations/puppet@production] mariadb: Reimage db1068 to stretch

https://gerrit.wikimedia.org/r/460857

gerritbot added a project: Patch-For-Review.Sep 17 2018, 8:30 AM

Change 460858 had a related patch set uploaded (by Jcrespo; owner: Jcrespo):
[operations/puppet@production] mariadb: Disable notifications on db1068

https://gerrit.wikimedia.org/r/460858

gerritbot added a comment.Sep 17 2018, 8:54 AM

Change 460857 merged by Jcrespo:
[operations/puppet@production] mariadb: Reimage db1068 to stretch

https://gerrit.wikimedia.org/r/460857

gerritbot added a comment.Sep 17 2018, 8:54 AM

Change 460858 merged by Jcrespo:
[operations/puppet@production] mariadb: Disable notifications on db1068

https://gerrit.wikimedia.org/r/460858

ops-monitoring-bot added a comment.Sep 17 2018, 9:22 AM

Script wmf-auto-reimage was launched by jynus on neodymium.eqiad.wmnet for hosts:

['db1068.eqiad.wmnet']

The log can be found in /var/log/wmf-auto-reimage/201809170922_jynus_16750.log.

ops-monitoring-bot added a comment.Sep 17 2018, 10:10 AM

Completed auto-reimage of hosts:

['db1068.eqiad.wmnet']

and were ALL successful.

Marostegui updated the task description. (Show Details)Sep 17 2018, 10:19 AM
• jcrespo updated the task description. (Show Details)Sep 17 2018, 11:19 AM
gerritbot added a comment.Sep 17 2018, 11:21 AM

Change 460884 had a related patch set uploaded (by Jcrespo; owner: Jcrespo):
[operations/puppet@production] mariadb: Reimage db1061 to stretch

https://gerrit.wikimedia.org/r/460884

gerritbot added a comment.Sep 17 2018, 11:22 AM

Change 460885 had a related patch set uploaded (by Jcrespo; owner: Jcrespo):
[operations/puppet@production] mariadb: Disable notifications on db1061

https://gerrit.wikimedia.org/r/460885

gerritbot added a comment.Sep 17 2018, 11:23 AM

Change 460884 merged by Jcrespo:
[operations/puppet@production] mariadb: Reimage db1061 to stretch

https://gerrit.wikimedia.org/r/460884

gerritbot added a comment.Sep 17 2018, 11:23 AM

Change 460885 merged by Jcrespo:
[operations/puppet@production] mariadb: Disable notifications on db1061

https://gerrit.wikimedia.org/r/460885

• jcrespo updated the task description. (Show Details)Sep 17 2018, 11:53 AM
gerritbot added a comment.Sep 17 2018, 11:56 AM

Change 460888 had a related patch set uploaded (by Jcrespo; owner: Jcrespo):
[operations/puppet@production] mariadb: Disable notifications for db1071

https://gerrit.wikimedia.org/r/460888

gerritbot added a comment.Sep 17 2018, 11:58 AM

Change 460889 had a related patch set uploaded (by Jcrespo; owner: Jcrespo):
[operations/puppet@production] mariadb: Reimage db1071 to stretch

https://gerrit.wikimedia.org/r/460889

gerritbot added a comment.Sep 17 2018, 11:59 AM

Change 460888 merged by Jcrespo:
[operations/puppet@production] mariadb: Disable notifications for db1071

https://gerrit.wikimedia.org/r/460888

gerritbot added a comment.Sep 17 2018, 11:59 AM

Change 460889 merged by Jcrespo:
[operations/puppet@production] mariadb: Reimage db1071 to stretch

https://gerrit.wikimedia.org/r/460889

gerritbot added a comment.Sep 17 2018, 12:04 PM

Change 460890 had a related patch set uploaded (by Jcrespo; owner: Jcrespo):
[operations/puppet@production] mariadb: Disallow reimage to all hosts except the test db

https://gerrit.wikimedia.org/r/460890

ops-monitoring-bot added a comment.Sep 17 2018, 12:13 PM

Script wmf-auto-reimage was launched by jynus on neodymium.eqiad.wmnet for hosts:

['db1071.eqiad.wmnet']

The log can be found in /var/log/wmf-auto-reimage/201809171213_jynus_20206.log.

ops-monitoring-bot added a comment.Sep 17 2018, 1:14 PM

Completed auto-reimage of hosts:

['db1071.eqiad.wmnet']

and were ALL successful.

• jcrespo updated the task description. (Show Details)Sep 17 2018, 1:15 PM
• Cmjohnson closed subtask T204493: db1061 management interface busy (no sessions allowed) as Resolved.Sep 17 2018, 3:51 PM
ops-monitoring-bot added a comment.Sep 17 2018, 5:02 PM

Script wmf-auto-reimage was launched by jynus on neodymium.eqiad.wmnet for hosts:

['db1061.eqiad.wmnet']

The log can be found in /var/log/wmf-auto-reimage/201809171702_jynus_18299.log.

ops-monitoring-bot added a comment.Sep 17 2018, 5:38 PM

Completed auto-reimage of hosts:

['db1061.eqiad.wmnet']

and were ALL successful.

• jcrespo closed this task as Resolved.Sep 17 2018, 6:05 PM
• jcrespo updated the task description. (Show Details)
Marostegui awarded a token.Sep 17 2018, 6:12 PM
gerritbot added a comment.Sep 18 2018, 8:04 AM

Change 460890 merged by Jcrespo:
[operations/puppet@production] mariadb: Disallow reimage to all hosts except the test db

https://gerrit.wikimedia.org/r/460890

Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL · Credits