Done
- Queries
- All Stories
- Search
- Advanced Search
- Transactions
- Transaction Logs
Advanced Search
Thu, Jun 13
Old 500
Wed, Jun 12
Works for me!
Thank you all
Any chances the query can be written in a different way like:
cumin2024@dbstore1008.eqiad.wmnet[metawiki]> EXPLAIN SELECT rc_id, rc_timestamp, rc_namespace, rc_title, rc_minor, rc_bot, rc_new, rc_cur_id, rc_this_oldid, rc_last_oldid, rc_type, rc_source, rc_patrolled, rc_ip, rc_old_len, rc_new_len, rc_deleted, rc_logid, rc_log_type, rc_log_action, rc_params, rc_actor, recentchanges_actor.actor_user AS `rc_user`, recentchanges_actor.actor_name AS `rc_user_text`, comment_rc_comment.comment_text AS `rc_comment_text`, comment_rc_comment.comment_data AS `rc_comment_data`, comment_rc_comment.comment_id AS `rc_comment_cid`, rc_title, rc_namespace, wl_user, wl_notificationtimestamp, we_expiry, page_latest, (SELECT GROUP_CONCAT(ctd_name SEPARATOR ',') FROM `change_tag` JOIN `change_tag_def` ON (ct_tag_id = ctd_id) WHERE ct_rc_id = rc_id) AS `ts_tags` FROM `recentchanges` STRAIGHT_JOIN `actor` `recentchanges_actor` ON (actor_id = rc_actor) LEFT JOIN `comment` `comment_rc_comment` ON (comment_id = rc_comment_id) LEFT JOIN `watchlist` ON (wl_user = 2134281 AND wl_title = rc_title AND wl_namespace = rc_namespace) LEFT JOIN `watchlist_expiry` ON (wl_id = we_item) LEFT JOIN `page` ON (rc_cur_id = page_id) WHERE actor_user IS NOT NULL AND rc_bot = 0 AND rc_type != 6 AND rc_source != 'wb' AND rc_namespace NOT IN (1198, 1199, 866, 867) AND rc_timestamp >= '20240601170235' AND rc_new IN (0, 1) ORDER BY rc_timestamp DESC LIMIT 50; +------+--------------------+---------------------+--------+-----------------------------------------------------------------------------------------------------------------------+--------------+---------+---------------------------------------------------------------------------+--------+-------------+ | id | select_type | table | type | possible_keys | key | key_len | ref | rows | Extra | +------+--------------------+---------------------+--------+-----------------------------------------------------------------------------------------------------------------------+--------------+---------+---------------------------------------------------------------------------+--------+-------------+ | 1 | PRIMARY | recentchanges | range | rc_timestamp,rc_name_type_patrolled_timestamp,rc_ns_actor,rc_actor,rc_namespace_title_timestamp,rc_new_name_timestamp | rc_timestamp | 14 | NULL | 160905 | Using where | | 1 | PRIMARY | comment_rc_comment | eq_ref | PRIMARY | PRIMARY | 8 | metawiki.recentchanges.rc_comment_id | 1 | | | 1 | PRIMARY | watchlist | eq_ref | wl_user,wl_user_notificationtimestamp,wl_namespace_title | wl_user | 265 | const,metawiki.recentchanges.rc_namespace,metawiki.recentchanges.rc_title | 1 | | | 1 | PRIMARY | watchlist_expiry | eq_ref | PRIMARY | PRIMARY | 4 | metawiki.watchlist.wl_id | 1 | Using where | | 1 | PRIMARY | page | eq_ref | PRIMARY | PRIMARY | 4 | metawiki.recentchanges.rc_cur_id | 1 | | | 1 | PRIMARY | recentchanges_actor | eq_ref | PRIMARY,actor_user | PRIMARY | 8 | metawiki.recentchanges.rc_actor | 1 | Using where | | 2 | DEPENDENT SUBQUERY | change_tag | ref | ct_rc_tag_id,ct_tag_id_id | ct_rc_tag_id | 9 | metawiki.recentchanges.rc_id | 1 | Using index | | 2 | DEPENDENT SUBQUERY | change_tag_def | eq_ref | PRIMARY | PRIMARY | 4 | metawiki.change_tag.ct_tag_id | 1 | | +------+--------------------+---------------------+--------+-----------------------------------------------------------------------------------------------------------------------+--------------+---------+---------------------------------------------------------------------------+--------+-------------+ 8 rows in set (0.003 sec)
db1227 is the only host where the optimizer is fine and the query runs perfectly fast:
In T363812#9883450, @jcrespo wrote:@Marostegui, in order to resolve this ticket, now that read activity I assume is lower, do you think I could get a host from es4 and es5 on both dcs depooled for a day and with exclusive usage in order to take a final, archivable, full backup of those sections? Doesn't have to happen at the same time on the 4 hosts:
From the logs (UTC):
Jun 11 11:51:23 db1240 mysqld[2665119]: 2024-06-11 11:51:23 7512754 [ERROR] InnoDB: We detected index corruption in an InnoDB type table. You have to dump + drop + reimport the table or, in a case of widespread corruption, dump all InnoDB tables and recreate the whole ta> Jun 11 11:51:23 db1240 mysqld[2665119]: 2024-06-11 11:51:23 7512754 [ERROR] mysqld: Index for table 'recentchanges' is corrupt; try to repair it Jun 11 11:51:23 db1240 mysqld[2665119]: 2024-06-11 11:51:23 7512754 [ERROR] Slave SQL: Error 'Index for table 'recentchanges' is corrupt; try to repair it' on query. Default database: 'cywiki'. Query: 'INSERT /* RecentChange::save */ INTO `recentchanges` (rc_type,rc_min> Jun 11 11:51:23 db1240 mysqld[2665119]: 2024-06-11 11:51:23 7512754 [Warning] Slave: Index for table 'recentchanges' is corrupt; try to repair it Error_code: 1034
This is done
Old 400
Tue, Jun 11
Removing Schema-change-in-production in production as this is not ready for DBAs to execute.
This is done
Old 300
vslow, dump 100
Installed 10.11 on db1153 (non used x2 replica) - will test here for a few weeks.
All done - also upgraded the host.
It is repooling now
This is fixed. I am going to rebuild it in all the databases just in case.
Which host is this?
This is done
Old 500
This is done
Old 500
Mon, Jun 10
Be careful when increasing weights. Some of those hosts got those new weights because they got overloaded with "normal" weights for some reason.
This is done
Dropping in s3 with sleep in between the drops. It will take around 25 minutes.
Done