Page MenuHomePhabricator
Create Task
Maniphest T193226

Test MySQL 8.0 with production data and evaluate its fit for WMF databases
Closed, ResolvedPublic
Actions

Description

Testing 8.0 package- it will be likely quite immature at this point, but we need to identify blockers as soon as possible.

Details

Related Changes in Gerrit:
SubjectRepoBranchLines +/-
mysql80: Add first stable mysql packageoperations/softwaremaster+1 -1
prometheus-mysqld-exporter: Add s1-test (db1118) to prometheusoperations/puppetproduction+5 -0
mariadb: Cleaup plugin load configurationoperations/puppetproduction+6 -9
mysql: Add auth_socket support to MySQL, equivalent to unix_socket on mariadboperations/puppetproduction+1 -0
mariadb: Use mysql-specific template for non-mariadb test hostoperations/puppetproduction+8 -3
mariadb: Convert db1118 into an s1 test hosts with MySQL 8.0operations/puppetproduction+8 -0
Customize query in gerrit

Related Objects
Search...

Event Timeline

jcrespo created this task.Apr 27 2018, 9:33 AM
jcrespo triaged this task as Low priority.
Restricted Application added a subscriber: Aklapper. · View Herald TranscriptApr 27 2018, 9:33 AM
jcrespo raised the priority of this task from Low to Medium.Apr 27 2018, 9:33 AM
gerritbot subscribed.Apr 27 2018, 9:34 AM

Change 429388 had a related patch set uploaded (by Jcrespo; owner: Jcrespo):
[operations/puppet@production] mariadb: Convert db1118 into an s1 test hosts with MySQL 8.0

https://gerrit.wikimedia.org/r/429388

gerritbot added a project: Patch-For-Review.Apr 27 2018, 9:34 AM
Marostegui moved this task from Triage to In progress on the DBA board.Apr 27 2018, 9:42 AM
gerritbot added a comment.Apr 27 2018, 11:11 AM

Change 429388 merged by Jcrespo:
[operations/puppet@production] mariadb: Convert db1118 into an s1 test hosts with MySQL 8.0

https://gerrit.wikimedia.org/r/429388

gerritbot added a comment.Apr 27 2018, 11:34 AM

Change 429401 had a related patch set uploaded (by Jcrespo; owner: Jcrespo):
[operations/puppet@production] mariadb: Use mysql-specific template for non-mariadb test host

https://gerrit.wikimedia.org/r/429401

gerritbot added a comment.Apr 27 2018, 11:42 AM

Change 429401 merged by Jcrespo:
[operations/puppet@production] mariadb: Use mysql-specific template for non-mariadb test host

https://gerrit.wikimedia.org/r/429401

gerritbot added a comment.Apr 27 2018, 12:22 PM

Change 429408 had a related patch set uploaded (by Jcrespo; owner: Jcrespo):
[operations/puppet@production] mysql: Add auth_socket support to MySQL, equivalent to unix_socket on mariadb

https://gerrit.wikimedia.org/r/429408

gerritbot added a comment.Apr 27 2018, 12:36 PM

Change 429408 merged by Jcrespo:
[operations/puppet@production] mysql: Add auth_socket support to MySQL, equivalent to unix_socket on mariadb

https://gerrit.wikimedia.org/r/429408

gerritbot added a comment.Apr 27 2018, 12:56 PM

Change 429411 had a related patch set uploaded (by Jcrespo; owner: Jcrespo):
[operations/puppet@production] mariadb: Cleaup plugin load configuration

https://gerrit.wikimedia.org/r/429411

gerritbot added a comment.Apr 27 2018, 1:26 PM

Change 429411 merged by Jcrespo:
[operations/puppet@production] mariadb: Cleaup plugin load configuration

https://gerrit.wikimedia.org/r/429411

Marostegui awarded a token.Apr 27 2018, 2:20 PM
gerritbot added a comment.Apr 27 2018, 2:46 PM

Change 429425 had a related patch set uploaded (by Jcrespo; owner: Jcrespo):
[operations/puppet@production] prometheus-mysqld-exporter: Add s1-test (db1118) to prometheus

https://gerrit.wikimedia.org/r/429425

gerritbot added a comment.Apr 27 2018, 2:47 PM

Change 429425 merged by Jcrespo:
[operations/puppet@production] prometheus-mysqld-exporter: Add s1-test (db1118) to prometheus

https://gerrit.wikimedia.org/r/429425

jcrespo added a comment.Apr 29 2018, 6:26 PM

pymysql version 0.8 or later is required as with the default collation, a newly added one, an exception is rised on connection. It may require a backport from buster: https://packages.debian.org/buster/python3-pymysql

gerritbot added a comment.Apr 30 2018, 2:23 PM

Change 429811 had a related patch set uploaded (by Jcrespo; owner: Jcrespo):
[operations/software@master] mysql80: Add first stable mysql package

https://gerrit.wikimedia.org/r/429811

gerritbot added a comment.Apr 30 2018, 2:25 PM

Change 429811 merged by Jcrespo:
[operations/software@master] mysql80: Add first stable mysql package

https://gerrit.wikimedia.org/r/429811

jcrespo added a subscriber: Volans.Apr 30 2018, 4:58 PM

@Volans T193226#4166726

Volans added a comment.Apr 30 2018, 5:01 PM

@jcrespo ack, no blocker for me, I'm actually not using it.

• Vvjjkkii renamed this task from Test MySQL 8.0 with production data and evaluate its fit for WMF databases to x3daaaaaaa.Jul 1 2018, 1:14 AM
• Vvjjkkii removed jcrespo as the assignee of this task.
• Vvjjkkii raised the priority of this task from Medium to High.
• Vvjjkkii added projects: CheckUser, Connected-Open-Heritage-Batch-uploads (RAÄ-KMB_1_2017-02), Tamil-Sites, Gamepress, Hashtags, Jade, KartoEditor, Language-2018-Apr-June, New-Editor-Experiences, Mail, TCB-Team (now WMDE-TechWish).
• Vvjjkkii updated the task description. (Show Details)
• Vvjjkkii removed subscribers: gerritbot, Aklapper.
AntiCompositeNumber renamed this task from x3daaaaaaa to Test MySQL 8.0 with production data and evaluate its fit for WMF databases.Jul 1 2018, 4:04 AM
AntiCompositeNumber assigned this task to jcrespo.
AntiCompositeNumber lowered the priority of this task from High to Medium.
AntiCompositeNumber removed projects: TCB-Team (now WMDE-TechWish), Mail, New-Editor-Experiences, Language-2018-Apr-June, KartoEditor, Jade, Hashtags, Gamepress, Tamil-Sites, Connected-Open-Heritage-Batch-uploads (RAÄ-KMB_1_2017-02), CheckUser.
AntiCompositeNumber updated the task description. (Show Details)
AntiCompositeNumber added subscribers: gerritbot, Aklapper.
jcrespo changed the task status from Open to Stalled.Jul 13 2018, 8:39 AM

This is stalled until we implement a way to mix different GTID implementation on the same section: e.g. T172497#4309959

jcrespo removed jcrespo as the assignee of this task.Sep 18 2018, 11:03 AM
jcrespo moved this task from In progress to Blocked external/Not db team on the DBA board.
Ladsgroup subscribed.Dec 23 2018, 12:40 PM
jcrespo added a parent task: T213527: Prepare our base system layer for Debian buster.Jan 11 2019, 9:44 AM
jcrespo removed a parent task: T213527: Prepare our base system layer for Debian buster.
jcrespo closed this task as Resolved.Apr 20 2020, 9:19 AM
jcrespo claimed this task.

There was limited testing on db1114- replication worked for a long time, and in general data storage. It will require further testing at a later time of production read queries due to T193226#4421996.

Maintenance_bot removed a project: Patch-For-Review.Apr 20 2020, 10:10 AM
Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL · Credits