Page MenuHomePhabricator

Corrupt index on db2150
Closed, ResolvedPublic

Description

PROBLEM - MariaDB Replica SQL: s7 #page on db2150 is CRITICAL: CRITICAL slave_sql_state Slave_SQL_Running: No, Errno: 1034, Errmsg: Error Index for table recentchanges is corrupt: try to repair it on query. Default database: metawiki.

Event Timeline

ABran-WMF triaged this task as High priority.
ABran-WMF moved this task from Triage to In progress on the DBA board.
ABran-WMF subscribed.

index rebuilt:

arnaudb@db2150:~ $ sudo -Es
root@db2150:~ $ mysql metawiki
Reading table information for completion of table and column names
You can turn off this feature to get a quicker startup with -A

Welcome to the MariaDB monitor.  Commands end with ; or \g.
Your MariaDB connection id is 1961197531
Server version: 10.6.17-MariaDB-log MariaDB Server

Copyright (c) 2000, 2018, Oracle, MariaDB Corporation Ab and others.

Type 'help;' or '\h' for help. Type '\c' to clear the current input statement.

mysql:root@localhost [metawiki]> set session sql_log_bin=0; alter table recentchanges engine=innodb,force;
Query OK, 0 rows affected (0.000 sec)

Query OK, 0 rows affected (9.684 sec)
Records: 0  Duplicates: 0  Warnings: 0

Will repool

Mentioned in SAL (#wikimedia-operations) [2024-11-18T12:36:19Z] <arnaudb@cumin1002> START - Cookbook sre.mysql.pool db2150 slowly with 10 steps - slow repool db2150 T380117

silence removed, host is repooling in slow motion

Mentioned in SAL (#wikimedia-operations) [2024-11-18T14:52:17Z] <arnaudb@cumin1002> END (PASS) - Cookbook sre.mysql.pool (exit_code=0) db2150 slowly with 10 steps - slow repool db2150 T380117