[toolsdb] Migrate "s54518__mw" db to Trove
Closed, ResolvedPublic
Actions

Assigned To

Authored By

	fnegri
	Feb 2 2023, 6:50 PM

Description

During the migration of ToolsDB to a new VM (T301949) I had to exclude the database s54518__mw from replication because MariaDB could not replicate some transactions. Given it's a small database, and it had similar replication issues in the past, I will try to move it to a dedicated Trove instance so we can debug these issues without affecting the rest of ToolsDB.

First I need to understand what data is contained in this db, and which tools are using it.

UPDATE: no need to migrate this db, as the tool is no longer maintained and can be deleted. See the comments below for more details.

Details

	Subject	Repo	Branch	Lines +/-
	ToolsDB: remove replication filters	operations/puppet	production	+0 -3

Customize query in gerrit

Related Objects
Search...

Status	Assigned	Task
Resolved	• Bstorm	T216208 ToolsDB overload and cleanup
Resolved	• Bstorm	T216441 Evaluate transferring the non-replicated tables to the new toolsdb server
Resolved	fnegri	T236101 Find a way to remove non-replicated tables from ToolsDB
Resolved	dcaro	T301951 toolsdb: full disk on clouddb1001 broke clouddb1002 (secondary) replication
Open	None	T301967 toolsdb: evaluate storage usage by some tools
Open	fnegri	T291782 Migrate largest ToolsDB users to Trove
Resolved	None	T306061 Cloud VPS "clouddb-services" project Stretch deprecation
Resolved	None	T313984 cloudvirt1019: hpssacli not found
Resolved	fnegri	T301949 ToolsDB upgrade => Bullseye, MariaDB 10.4
Resolved	fnegri	T328693 [toolsdb] Migrate "s54518__mw" db to Trove

Event Timeline

fnegri created this task.Feb 2 2023, 6:50 PM

Restricted Application added a subscriber: Aklapper. · View Herald TranscriptFeb 2 2023, 6:50 PM

fnegri mentioned this in T301949: ToolsDB upgrade => Bullseye, MariaDB 10.4.Feb 2 2023, 6:51 PM

fnegri added a parent task: T291782: Migrate largest ToolsDB users to Trove.Feb 2 2023, 6:57 PM

This DB is one of many owned by the 'wb' tool, maintained by @Symantec51.

@Symantec51, is there any chance we can just switch off that database entirely? If not, can you advise about how much downtime is OK and if you need it scheduled ahead of time?

fnegri mentioned this in T329970: [toolsdb] set up tools-db-1 to replicate from clouddb1001.Feb 17 2023, 6:10 PM

fnegri triaged this task as High priority.Mar 6 2023, 8:57 AM

sent today:

Hello again!

So far we have not gotten any response from you, either via email or on phabricator. Unless you respond and are willing to coordinate with us we will stop your tool and drop your data soon.

-Andrew


On 3/8/23 9:26 AM, Andrew Bogott wrote:
> Hello!
>
> We're running into a few snags with the database used by one of your services, the 'mw' service in the 'wb' tool account. Can you please check in on https://phabricator.wikimedia.org/T328693 and/or respond to this email and let us know if that tool is still important? There are various options, the easiest of which is for you to say that you don't need wb anymore and we can shut it down and delete the database 😄
>
> Thanks!
>
> -Andrew

I did some further checks, and it appears that the table that caused problems in the past (T301949#8578950, T266587, T322039) is a MEMORY table, and that can cause problems with replication.