Page MenuHomePhabricator

Reimage dbstore2002
Closed, ResolvedPublic

Description

dbstore2002 needs to be reimaged - it is a trusty server.
Once it is reimaged, clone data from dbstore2001 or from its snapshot (dbstore2001:/srv/tmp/dbstore2002.tar.gz)

Details

Related Gerrit Patches:
operations/puppet : productionmariadb: Install jessie on dbstore2002

Event Timeline

Change 319859 had a related patch set uploaded (by Marostegui):
mariadb: Install jessie on dbstore2002

https://gerrit.wikimedia.org/r/319859

Change 319859 merged by Marostegui:
mariadb: Install jessie on dbstore2002

https://gerrit.wikimedia.org/r/319859

Mentioned in SAL (#wikimedia-operations) [2016-11-04T15:35:47Z] <marostegui> reimage dbstore2002 - T150017

Script wmf_auto_reimage was launched by marostegui on neodymium.eqiad.wmnet for hosts:

['dbstore2002.codfw.wmnet']

The log can be found in /var/log/wmf-auto-reimage/201611041538_marostegui_738.log.

Completed auto-reimage of hosts:

['dbstore2002.codfw.wmnet']

and were ALL successful.

root@dbstore2002:/srv/sqldata# lsb_release -a
No LSB modules are available.
Distributor ID:	Debian
Description:   	Debian GNU/Linux 8.6 (jessie)
Release:       	8.6
Codename:      	jessie

I am now transferring back the snapshot

dbstore2002 is now running 10.0.28, mysql_upgrade went fine and tokuDB engine is loaded. The slaves are catching up too.

root@dbstore2002:/opt/wmf-mariadb10/bin# mysql --skip-ssl -e "select version();"
+-----------------+
| version()       |
+-----------------+
| 10.0.28-MariaDB |
+-----------------+
root@dbstore2002:/opt/wmf-mariadb10/bin# mysql --skip-ssl -e "show engines" | grep -i toku
TokuDB 	YES    	Percona TokuDB Storage Engine with Fractal Tree(tm) Technology 	YES    	YES    	YES

root@dbstore2002:/opt/wmf-mariadb10/bin# mysql --skip-ssl -e "show all slaves status\G" | egrep -i "Connection|Seconds"
              Connection_name: s1
        Seconds_Behind_Master: 31721
              Connection_name: s3
        Seconds_Behind_Master: 31537
              Connection_name: s4
        Seconds_Behind_Master: 31470
Marostegui closed this task as Resolved.Nov 4 2016, 8:31 PM