Page MenuHomePhabricator
Create Task
Maniphest T307546

Migrate a wikidata DB to MariaDB 10.6
Closed, ResolvedPublic
Actions

Description

Tests on enwiki are looking promising apart from some queries (T305427)
It would be interesting to see 10.6 working with a different set of data like wikidatawiki one.

Migrated host: db1172

Details

SubjectRepoBranchLines +/-
db1172: Migrate to mariadb 10.6operations/puppetproduction+1 -0
db1172: Disable notificationsoperations/puppetproduction+1 -0
Customize query in gerrit

Related Objects
Search...

Event Timeline

Marostegui created this task.May 4 2022, 7:52 AM
Restricted Application added a subscriber: Aklapper. · View Herald TranscriptMay 4 2022, 7:52 AM
Marostegui renamed this task from Migrate a wikidata DB to 10.6 to Migrate a wikidata DB to MariaDB 10.6.May 4 2022, 7:52 AM
Marostegui triaged this task as Medium priority.
Marostegui moved this task from Triage to In progress on the DBA board.
Marostegui mentioned this in T305427: Slow recentchanges DB queries on 10.6.
Marostegui added a parent task: T305427: Slow recentchanges DB queries on 10.6.
Marostegui mentioned this in T307082: Investigate spikes on db1132 (mariadb 10.6 host).May 4 2022, 1:30 PM
gerritbot added a comment.May 9 2022, 5:12 AM

Change 790158 had a related patch set uploaded (by Marostegui; author: Marostegui):

[operations/puppet@production] db1172: Disable notifications

https://gerrit.wikimedia.org/r/790158

gerritbot added a project: Patch-For-Review.May 9 2022, 5:12 AM
Marostegui added a comment.May 9 2022, 5:12 AM

db1172 will be the one

gerritbot added a comment.May 9 2022, 5:14 AM

Change 790158 merged by Marostegui:

[operations/puppet@production] db1172: Disable notifications

https://gerrit.wikimedia.org/r/790158

Maintenance_bot removed a project: Patch-For-Review.May 9 2022, 5:30 AM
Marostegui added a comment.May 9 2022, 5:47 AM

db1172 is now running mariadb 10.6 - I am going to start testing and analyzing queries there.

Stashbot added a comment.May 9 2022, 5:48 AM

Mentioned in SAL (#wikimedia-operations) [2022-05-09T05:48:24Z] <marostegui@cumin1001> dbctl commit (dc=all): 'Repool db1172 with minimal weight to test 10.6 T307546', diff saved to https://phabricator.wikimedia.org/P27762 and previous config saved to /var/cache/conftool/dbconfig/20220509-054823-marostegui.json

Stashbot added a comment.May 9 2022, 7:04 AM

Mentioned in SAL (#wikimedia-operations) [2022-05-09T07:04:30Z] <marostegui@cumin1001> dbctl commit (dc=all): 'Repool db1172 with minimal weight to test 10.6 T307546', diff saved to https://phabricator.wikimedia.org/P27763 and previous config saved to /var/cache/conftool/dbconfig/20220509-070430-marostegui.json

Marostegui added a comment.May 9 2022, 7:26 AM

Enabled slow query log on db1172 to log every query slower than 5 seconds.

Stashbot added a comment.May 9 2022, 7:32 AM

Mentioned in SAL (#wikimedia-operations) [2022-05-09T07:32:01Z] <marostegui@cumin1001> dbctl commit (dc=all): 'Increase traffic on db1172 to test 10.6 T307546', diff saved to https://phabricator.wikimedia.org/P27764 and previous config saved to /var/cache/conftool/dbconfig/20220509-073200-marostegui.json

Stashbot added a comment.May 9 2022, 8:05 AM

Mentioned in SAL (#wikimedia-operations) [2022-05-09T08:05:21Z] <marostegui@cumin1001> dbctl commit (dc=all): 'Increase traffic on db1172 to test 10.6 T307546', diff saved to https://phabricator.wikimedia.org/P27765 and previous config saved to /var/cache/conftool/dbconfig/20220509-080521-marostegui.json

Stashbot added a comment.May 9 2022, 9:30 AM

Mentioned in SAL (#wikimedia-operations) [2022-05-09T09:30:33Z] <marostegui@cumin1001> dbctl commit (dc=all): 'Increase traffic on db1172 to test 10.6 T307546', diff saved to https://phabricator.wikimedia.org/P27768 and previous config saved to /var/cache/conftool/dbconfig/20220509-093032-marostegui.json

gerritbot added a comment.May 9 2022, 12:27 PM

Change 790354 had a related patch set uploaded (by Marostegui; author: Marostegui):

[operations/puppet@production] db1172: Migrate to mariadb 10.6

https://gerrit.wikimedia.org/r/790354

gerritbot added a project: Patch-For-Review.May 9 2022, 12:27 PM

Change 790354 merged by Marostegui:

[operations/puppet@production] db1172: Migrate to mariadb 10.6

https://gerrit.wikimedia.org/r/790354

Maintenance_bot removed a project: Patch-For-Review.May 9 2022, 12:31 PM
Marostegui added a comment.May 10 2022, 5:14 AM

So far, db1172 hasn't had any slow query that's not reported already on 10.4 so I am going to keep increasing its weight so it can get more traffic.

Stashbot added a comment.May 10 2022, 5:14 AM

Mentioned in SAL (#wikimedia-operations) [2022-05-10T05:14:29Z] <marostegui@cumin1001> dbctl commit (dc=all): 'Increase traffic on db1172 to test 10.6 T307546', diff saved to https://phabricator.wikimedia.org/P27775 and previous config saved to /var/cache/conftool/dbconfig/20220510-051429-marostegui.json

Stashbot added a comment.May 10 2022, 9:18 AM

Mentioned in SAL (#wikimedia-operations) [2022-05-10T09:18:13Z] <marostegui@cumin1001> dbctl commit (dc=all): 'Increase traffic on db1172 to test 10.6 T307546', diff saved to https://phabricator.wikimedia.org/P27776 and previous config saved to /var/cache/conftool/dbconfig/20220510-091812-marostegui.json

Stashbot added a comment.May 11 2022, 5:34 AM

Mentioned in SAL (#wikimedia-operations) [2022-05-11T05:34:19Z] <marostegui@cumin1001> dbctl commit (dc=all): 'Increase traffic on db1172 to test 10.6 T307546', diff saved to https://phabricator.wikimedia.org/P27780 and previous config saved to /var/cache/conftool/dbconfig/20220511-053418-marostegui.json

Stashbot added a comment.May 11 2022, 10:54 AM

Mentioned in SAL (#wikimedia-operations) [2022-05-11T10:54:17Z] <marostegui@cumin1001> dbctl commit (dc=all): 'Increase traffic on db1172 to test 10.6 T307546', diff saved to https://phabricator.wikimedia.org/P27782 and previous config saved to /var/cache/conftool/dbconfig/20220511-105416-marostegui.json

Stashbot added a comment.May 11 2022, 12:42 PM

Mentioned in SAL (#wikimedia-operations) [2022-05-11T12:42:27Z] <marostegui@cumin1001> dbctl commit (dc=all): 'Increase traffic on db1172 to test 10.6 T307546', diff saved to https://phabricator.wikimedia.org/P27786 and previous config saved to /var/cache/conftool/dbconfig/20220511-124226-marostegui.json

Stashbot added a comment.May 11 2022, 3:00 PM

Mentioned in SAL (#wikimedia-operations) [2022-05-11T15:00:39Z] <marostegui@cumin1001> dbctl commit (dc=all): 'Increase traffic on db1172 to test 10.6 T307546', diff saved to https://phabricator.wikimedia.org/P27789 and previous config saved to /var/cache/conftool/dbconfig/20220511-150038-marostegui.json

Marostegui added a comment.May 11 2022, 3:03 PM

db1172 is now fully pooled on s8 and so far so good. I haven't observed any specific 10.6 slow query (and there's nothing outstanding reported on logstash either)

Marostegui updated the task description. (Show Details)May 12 2022, 6:12 AM
Marostegui closed this task as Resolved.May 13 2022, 6:55 AM

I am going to consider this fixed as the host is serving traffic with its normal LB weight.

Maintenance_bot moved this task from In progress to Done on the DBA board.May 13 2022, 7:29 AM
Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL · Credits