Perform the tweaks necessary on puppet, packaging and other operations-related tasks to make sure mysql/mariadb hosts work well on stretch.
Description
Details
Status | Subtype | Assigned | Task | ||
---|---|---|---|---|---|
Invalid | None | T168494 tracking task: jessie -> stretch | |||
Resolved | jcrespo | T168356 Prepare mysql hosts for stretch | |||
Resolved | jcrespo | T116903 Adapt wmf-mariadb101 package for stretch and adapt its service to systemd | |||
Resolved | jcrespo | T100501 mysql user and group should be a system user/group | |||
Resolved | jcrespo | T165625 Evaluate future of wmf puppet module "mysql" | |||
Restricted Task | |||||
Resolved | jcrespo | T183249 Reimage and upgrade to stretch all dbproxies |
Event Timeline
Change 360167 had a related patch set uploaded (by Jcrespo; owner: Jcrespo):
[operations/puppet@production] install_server: reimage db2072 as stretch
Change 360172 had a related patch set uploaded (by Jcrespo; owner: Jcrespo):
[operations/puppet@production] mariadb: move db2072 to s1 shard (enwiki)
Change 360167 merged by Jcrespo:
[operations/puppet@production] install_server: reimage db2072 as stretch
Change 360172 merged by Jcrespo:
[operations/puppet@production] mariadb: move db2072 to s1 shard (enwiki)
Change 360318 had a related patch set uploaded (by Marostegui; owner: Marostegui):
[operations/software@master] s1.hosts: Add db2072 to s1
Change 360318 merged by jenkins-bot:
[operations/software@master] s1.hosts: Add db2072 to s1
Change 360845 had a related patch set uploaded (by Jcrespo; owner: Jcrespo):
[operations/puppet@production] mariadb: Initial stretch support for wmf package with systemd
Change 360845 merged by Jcrespo:
[operations/puppet@production] mariadb: Initial stretch support for wmf package with systemd
Change 360859 had a related patch set uploaded (by Jcrespo; owner: Jcrespo):
[operations/puppet@production] mariadb: Remove installation of percona-xtrabackup on stretch
Change 360859 merged by Jcrespo:
[operations/puppet@production] mariadb: Remove installation of percona-xtrabackup on stretch
Change 360883 had a related patch set uploaded (by Jcrespo; owner: Jcrespo):
[operations/puppet@production] mariadb-core: Test systemd and stretch support
Change 360883 merged by Jcrespo:
[operations/puppet@production] mariadb-core: Test systemd and stretch support
Aside from socket, datadir, basedir configurable on hiera: T148507 we need to create user systemd customizable templates (e.g. to increase the number of max file connections).
Change 361456 had a related patch set uploaded (by Jcrespo; owner: Jcrespo):
[operations/puppet@production] mariadb: Add basedir support and change default socket location
Change 361456 merged by Jcrespo:
[operations/puppet@production] mariadb: refactor option support and move it to hiera
Change 361824 had a related patch set uploaded (by Jcrespo; owner: Jcrespo):
[operations/puppet@production] mariadb: Followup to gerrit:361456
Change 361824 merged by Jcrespo:
[operations/puppet@production] mariadb: Followup to gerrit:361456
Change 361831 had a related patch set uploaded (by Jcrespo; owner: Jcrespo):
[operations/puppet@production] Add basedir option to all templates; restore option on init.d
Change 361831 merged by Jcrespo:
[operations/puppet@production] Add basedir option to all templates; restore option on init.d
Change 361836 had a related patch set uploaded (by Jcrespo; owner: Jcrespo):
[operations/puppet@production] mariadb: Change init.d template variable to avoid defaults changes
Change 361836 merged by Jcrespo:
[operations/puppet@production] mariadb: Change init.d template variable to avoid defaults changes
Change 361838 had a related patch set uploaded (by Jcrespo; owner: Jcrespo):
[operations/puppet@production] mariadb: Service followup to gerrit:361836
Change 361838 merged by Jcrespo:
[operations/puppet@production] mariadb: Service followup to gerrit:361836
Change 361841 had a related patch set uploaded (by Jcrespo; owner: Jcrespo):
[operations/puppet@production] labsdb-replica: Change default basedir to the 10.1 package
Change 361841 merged by Jcrespo:
[operations/puppet@production] labsdb-replica: Change default basedir to the 10.1 package
Change 361846 had a related patch set uploaded (by Jcrespo; owner: Jcrespo):
[operations/puppet@production] mariadb: Avoid the usage of undef or '' due to its falsey nature
Change 361846 merged by Jcrespo:
[operations/puppet@production] mariadb: patch mariadb.service to include the basedir
Change 361857 had a related patch set uploaded (by Jcrespo; owner: Jcrespo):
[operations/puppet@production] mysql-hiera: Add hosts for codfw:s2, which were missing
Change 361857 merged by Jcrespo:
[operations/puppet@production] mysql-hiera: Add hosts for codfw:s2, which were missing
With the new puppet refactoring, hosts just work- that doesn't mean the puppet structure is ideal- we need to change many things such as multi-instance support and fix the hiera bits, but the basic support for core is already there for stretch. The last bit missing here is to allow for custom systemd subunits mostly to set the ulimits for max allowed open files, which has to be customized for s3 hosts, dbstores, labs and other large databases.
Change 362156 had a related patch set uploaded (by Jcrespo; owner: Jcrespo):
[operations/puppet@production] mariadb: handle service for systemd -autostart and overrides
Change 362204 had a related patch set uploaded (by Jcrespo; owner: Jcrespo):
[operations/puppet@production] mariadb: Set default limits for systemd core databases
Change 362156 merged by Jcrespo:
[operations/puppet@production] mariadb: handle service for systemd -autostart and overrides
Change 362204 merged by Jcrespo:
[operations/puppet@production] mariadb: Set default limits for systemd core databases
Change 362353 had a related patch set uploaded (by Jcrespo; owner: Jcrespo):
[operations/puppet@production] mariadb: Followup to Set default limits for systemd core databases
Change 362353 merged by Jcrespo:
[operations/puppet@production] mariadb: Followup to Set default limits for systemd core databases
This is in no way a closed issue, but the initial scope is covered- pending tidying up puppet and hiera code. But the support is working, at least as good as for trusty and jessie on the module. misc services will have to transition on the role slowly.
Change 364466 had a related patch set uploaded (by Jcrespo; owner: Jcrespo):
[operations/puppet@production] mariadb: Fix default package installation for stretch
Change 364466 merged by Jcrespo:
[operations/puppet@production] mariadb: Fix default package installation for stretch
Change 364671 had a related patch set uploaded (by Jcrespo; owner: Jcrespo):
[operations/puppet@production] mariadb: Delete override- changed default on package
Change 364671 merged by Jcrespo:
[operations/puppet@production] mariadb: Delete override- changed default on package