The following tables:
echo_email_batch echo_event echo_notification echo_target_page
Are used in x1 but not on local wikis (check this for the proof on dbstore2001: T54921#2880996) and then should be dropped from local wikis.
The following database on the other hand DO NOT USE x1, and need to be EXCLUDED from the list of wikis from where the tables need to be dropped.
mediawikiwiki metawiki officewiki labswiki
| Subject | Repo | Branch | Lines +/- | |
|---|---|---|---|---|
| db-codfw.php: Depool db2057 | operations/mediawiki-config | master | +7 -7 |
| Status | Subtype | Assigned | Task | |
|---|---|---|---|---|
| · · · | ||||
| Resolved | LSobanski | T54921 Database tables to be dropped on Wikimedia wikis and other WMF databases (tracking) | ||
| Declined | None | T119154 Move echo tables from local wiki databases onto extension1 cluster for mediawikiwiki, metawiki, and officewiki | ||
| Resolved | • Marostegui | T51593 Rename two indexes in the Echo extension | ||
| Resolved | • Marostegui | T153638 Drop echo tables from local wiki databases | ||
| Resolved | Ladsgroup | T104459 Detect object, schema and data drifts between mediawiki HEAD, production masters and replicas | ||
| · · · |
I will start by making sure they are indeed not written.
An easy test without messing up with production (and which is needed anyways to export x1 to dbstore2001 T151552)) will be to rename all those tables in dbstore2001 before dropping them, just to make sure RBR doesn't break because they are written somehow.
Note wikitech is not a database itself, in this context it is a database list containg labswiki and labtestwiki, hosted on silver and labtestweb2001 respectively
I want to start working on this slowly in the background as doing T136428 was confusing and painful with so many echo tables that were all over the shards and not really needed.
in db2057 (s3) I have renamed all the echo tables to:
T153638_echo_xxxx
Just to make sure replication doesn't break, I will leave it like that for a few days before dropping them (after taking a backup)
This bite us today when changing some indexes, so I am going to start deleting these tables in core. They were renamed at T153638#3097450 and nothing broken, and nothing has broken since codfw is active.
So I am going to slowly start dropping those tables in all the wikis apart from the following wikis:
// Use extension1 db for all wikis
'wmgEchoCluster' => [
'default' => 'extension1',
// The following wikis should be using extension1 db but started with
// the application main database, stick with the current setting
'wikitech' => false,
'mediawikiwiki' => false,
'metawiki' => false,
'officewiki' => false,
],An example that these tables aren't in use in s3 (apart from the wikis above) is that a new wiki (T167715) doesn't have them:
root@db2057:/srv/sqldata/atjwiki# ls -lh | grep -i echo root@db2057:/srv/sqldata/atjwiki#
From s3 the following wikis will need to get the table deleted:
Servers:
From s7: kowiki
Servers:
The rest of sections are clean (apart from the places where it is really used as described in T153638#4592556
Mentioned in SAL (#wikimedia-operations) [2018-09-18T09:37:38Z] <marostegui> Drop T153638_echo_XXX tables from db2057 - T153638
Mentioned in SAL (#wikimedia-operations) [2018-09-18T10:01:02Z] <marostegui> Rename echo_XXX tables on dbstore2002:3313 - T153638
Mentioned in SAL (#wikimedia-operations) [2018-09-18T10:09:26Z] <marostegui> Drop T153638_echo_XXX tables from dbstore2002:3313 - T153638
Mentioned in SAL (#wikimedia-operations) [2018-09-18T10:24:53Z] <marostegui> Rename echo_XXX tables on db1077 and db1078 - T153638
Mentioned in SAL (#wikimedia-operations) [2018-09-18T13:10:20Z] <marostegui> Drop T153638_echo_XXX tables from db1077 - T153638
Mentioned in SAL (#wikimedia-operations) [2018-09-18T13:24:16Z] <marostegui> Drop T153638_echo_XXX tables from db1078 - T153638
Mentioned in SAL (#wikimedia-operations) [2018-09-18T14:02:50Z] <marostegui> Drop T153638_echo_XXX tables from db1095:3313 - T153638
Change 461270 had a related patch set uploaded (by Marostegui; owner: Marostegui):
[operations/mediawiki-config@master] db-codfw.php: Depool db2057
Change 461270 merged by jenkins-bot:
[operations/mediawiki-config@master] db-codfw.php: Depool db2057
Mentioned in SAL (#wikimedia-operations) [2018-09-19T05:19:16Z] <marostegui> Drop echo tables from s7:kowiki - T153638
Mentioned in SAL (#wikimedia-operations) [2018-09-19T05:31:55Z] <marostegui> Drop echo tables from s3 db2074 - T153638