After wikidatawiki was moved to its own replica set (s8), s5 has very little load and disk usage.
We should move some wikis to it, probably from s3. Based on size (which is not the only indicator- a wiki could have a lot of load but be smaller):
enwikivoyage, cebwiki, shwiki, srwiki & mgwiktionary (labswiki at a later time)
dbstore1001:/srv/backups$ ls -lhS *wik*-*.sql.gz | head -n 100 -rw-r----- 1 root root 95G Jan 10 17:45 enwiki-201801100205.sql.gz -rw-r----- 1 root root 95G Jan 3 17:46 enwiki-201801030205.sql.gz -rw-r----- 1 root root 95G Dec 27 17:56 enwiki-201712270205.sql.gz -rw-r----- 1 root root 83G Jan 10 17:59 commonswiki-201801100205.sql.gz -rw-r----- 1 root root 83G Jan 3 16:22 commonswiki-201801030205.sql.gz -rw-r----- 1 root root 83G Dec 27 16:19 commonswiki-201712270205.sql.gz -rw-r----- 1 root root 68G Jan 11 06:09 wikidatawiki-201801100205.sql.gz -rw-r----- 1 root root 68G Jan 4 02:04 wikidatawiki-201801030205.sql.gz -rw-r----- 1 root root 68G Dec 28 01:34 wikidatawiki-201712270205.sql.gz -rw-r----- 1 root root 46G Jan 10 07:54 dewiki-201801100205.sql.gz -rw-r----- 1 root root 46G Jan 3 07:17 dewiki-201801030205.sql.gz -rw-r----- 1 root root 46G Dec 27 07:17 dewiki-201712270205.sql.gz -rw-r----- 1 root root 29G Jan 10 18:58 ruwiki-201801100205.sql.gz -rw-r----- 1 root root 29G Jan 3 16:00 ruwiki-201801030205.sql.gz -rw-r----- 1 root root 29G Dec 27 17:11 ruwiki-201712270205.sql.gz -rw-r----- 1 root root 24G Jan 10 10:20 frwiki-201801100205.sql.gz -rw-r----- 1 root root 24G Jan 3 08:36 frwiki-201801030205.sql.gz -rw-r----- 1 root root 24G Dec 27 08:46 frwiki-201712270205.sql.gz -rw-r----- 1 root root 16G Jan 11 09:26 plwiki-201801100205.sql.gz -rw-r----- 1 root root 16G Jan 4 05:38 plwiki-201801030205.sql.gz -rw-r----- 1 root root 16G Dec 28 06:37 plwiki-201712270205.sql.gz -rw-r----- 1 root root 14G Jan 10 20:16 itwiki-201801100205.sql.gz -rw-r----- 1 root root 14G Jan 3 16:07 itwiki-201801030205.sql.gz -rw-r----- 1 root root 14G Dec 27 14:56 itwiki-201712270205.sql.gz -rw-r----- 1 root root 13G Jan 10 04:51 enwikivoyage-201801100205.sql.gz -rw-r----- 1 root root 13G Jan 3 04:36 enwikivoyage-201801030205.sql.gz -rw-r----- 1 root root 13G Dec 27 04:51 enwikivoyage-201712270205.sql.gz -rw-r----- 1 root root 12G Jan 10 07:56 eswiki-201801100205.sql.gz -rw-r----- 1 root root 12G Jan 3 06:51 eswiki-201801030205.sql.gz -rw-r----- 1 root root 12G Dec 27 07:08 eswiki-201712270205.sql.gz -rw-r----- 1 root root 10G Jan 10 03:06 arwiki-201801100205.sql.gz -rw-r----- 1 root root 10G Jan 10 20:12 nlwiki-201801100205.sql.gz -rw-r----- 1 root root 10G Dec 27 17:19 nlwiki-201712270205.sql.gz -rw-r----- 1 root root 10G Jan 3 18:09 nlwiki-201801030205.sql.gz -rw-r----- 1 root root 10G Jan 3 03:25 arwiki-201801030205.sql.gz -rw-r----- 1 root root 9.9G Dec 27 04:27 arwiki-201712270205.sql.gz -rw-r----- 1 root root 8.2G Jan 11 14:54 zhwiki-201801100205.sql.gz -rw-r----- 1 root root 8.1G Jan 4 07:28 zhwiki-201801030205.sql.gz -rw-r----- 1 root root 8.1G Dec 28 08:31 zhwiki-201712270205.sql.gz -rw-r----- 1 root root 8.1G Jan 10 06:00 cebwiki-201801100205.sql.gz -rw-r----- 1 root root 8.1G Jan 3 05:58 cebwiki-201801030205.sql.gz -rw-r----- 1 root root 8.1G Dec 27 06:13 cebwiki-201712270205.sql.gz -rw-r----- 1 root root 7.6G Jan 11 08:22 ptwiki-201801100205.sql.gz -rw-r----- 1 root root 7.6G Jan 4 02:09 ptwiki-201801030205.sql.gz -rw-r----- 1 root root 7.6G Dec 28 02:16 ptwiki-201712270205.sql.gz -rw-r----- 1 root root 7.6G Jan 10 10:37 jawiki-201801100205.sql.gz -rw-r----- 1 root root 7.5G Jan 3 09:01 jawiki-201801030205.sql.gz -rw-r----- 1 root root 7.5G Dec 27 09:07 jawiki-201712270205.sql.gz -rw-r----- 1 root root 7.1G Jan 10 11:54 metawiki-201801100205.sql.gz -rw-r----- 1 root root 7.0G Jan 3 10:00 metawiki-201801030205.sql.gz -rw-r----- 1 root root 6.9G Jan 10 08:35 huwiki-201801100205.sql.gz -rw-r----- 1 root root 6.9G Dec 27 10:16 metawiki-201712270205.sql.gz -rw-r----- 1 root root 6.9G Jan 3 07:04 huwiki-201801030205.sql.gz -rw-r----- 1 root root 6.9G Dec 27 07:45 huwiki-201712270205.sql.gz -rw-r----- 1 root root 5.9G Jan 11 00:40 svwiki-201801100205.sql.gz -rw-r----- 1 root root 5.9G Dec 27 22:55 svwiki-201712270205.sql.gz -rw-r----- 1 root root 5.9G Jan 3 23:23 svwiki-201801030205.sql.gz -rw-r----- 1 root root 5.6G Jan 10 22:28 ukwiki-201801100205.sql.gz -rw-r----- 1 root root 5.5G Jan 3 18:50 ukwiki-201801030205.sql.gz -rw-r----- 1 root root 5.5G Dec 27 18:59 ukwiki-201712270205.sql.gz -rw-r----- 1 root root 5.4G Jan 10 18:30 enwiktionary-201801100205.sql.gz -rw-r----- 1 root root 5.4G Jan 3 10:37 enwiktionary-201801030205.sql.gz -rw-r----- 1 root root 5.4G Dec 27 13:43 enwiktionary-201712270205.sql.gz -rw-r----- 1 root root 4.9G Jan 10 23:14 viwiki-201801100205.sql.gz -rw-r----- 1 root root 4.9G Jan 3 18:53 viwiki-201801030205.sql.gz -rw-r----- 1 root root 4.9G Dec 27 18:32 viwiki-201712270205.sql.gz -rw-r----- 1 root root 4.5G Jan 10 07:32 hewiki-201801100205.sql.gz -rw-r----- 1 root root 4.5G Jan 3 06:17 hewiki-201801030205.sql.gz -rw-r----- 1 root root 4.5G Dec 27 06:30 hewiki-201712270205.sql.gz -rw-r----- 1 root root 4.3G Jan 11 00:09 trwiki-201801100205.sql.gz -rw-r----- 1 root root 4.3G Jan 3 21:20 trwiki-201801030205.sql.gz -rw-r----- 1 root root 4.3G Dec 27 21:01 trwiki-201712270205.sql.gz -rw-r----- 1 root root 3.8G Jan 11 01:09 wikishared-201801100205.sql.gz -rw-r----- 1 root root 3.7G Jan 3 20:22 wikishared-201801030205.sql.gz -rw-r----- 1 root root 3.7G Dec 27 20:09 wikishared-201712270205.sql.gz -rw-r----- 1 root root 3.5G Jan 10 18:54 shwiki-201801100205.sql.gz -rw-r----- 1 root root 3.5G Jan 3 16:18 shwiki-201801030205.sql.gz -rw-r----- 1 root root 3.5G Dec 27 16:47 shwiki-201712270205.sql.gz -rw-r----- 1 root root 3.3G Jan 10 11:53 mediawikiwiki-201801100205.sql.gz -rw-r----- 1 root root 3.3G Jan 3 10:00 mediawikiwiki-201801030205.sql.gz -rw-r----- 1 root root 3.3G Dec 27 10:13 mediawikiwiki-201712270205.sql.gz -rw-r----- 1 root root 3.1G Jan 10 05:48 fawiki-201801100205.sql.gz -rw-r----- 1 root root 3.1G Jan 3 05:03 fawiki-201801030205.sql.gz -rw-r----- 1 root root 3.1G Dec 27 05:19 fawiki-201712270205.sql.gz -rw-r----- 1 root root 3.1G Jan 3 15:08 nowiki-201801030205.sql.gz -rw-r----- 1 root root 3.1G Jan 10 17:00 nowiki-201801100205.sql.gz -rw-r----- 1 root root 3.1G Dec 27 14:05 nowiki-201712270205.sql.gz -rw-r----- 1 root root 2.9G Jan 10 13:08 idwiki-201801100205.sql.gz -rw-r----- 1 root root 2.9G Jan 3 11:35 idwiki-201801030205.sql.gz -rw-r----- 1 root root 2.9G Dec 27 11:21 idwiki-201712270205.sql.gz -rw-r----- 1 root root 2.9G Jan 10 09:01 fiwiki-201801100205.sql.gz -rw-r----- 1 root root 2.9G Jan 3 07:40 fiwiki-201801030205.sql.gz -rw-r----- 1 root root 2.9G Dec 27 07:22 fiwiki-201712270205.sql.gz -rw-r----- 1 root root 2.9G Jan 3 02:57 cawiki-201801030205.sql.gz -rw-r----- 1 root root 2.9G Dec 27 03:51 cawiki-201712270205.sql.gz -rw-r----- 1 root root 2.8G Jan 10 03:01 cawiki-201801100205.sql.gz -rw-r----- 1 root root 2.4G Jan 10 06:29 frwiktionary-201801100205.sql.gz -rw-r----- 1 root root 2.4G Jan 3 05:27 frwiktionary-201801030205.sql.gz -rw-r----- 1 root root 2.4G Dec 27 05:37 frwiktionary-201712270205.sql.gz -rw-r----- 1 root root 2.4G Jan 10 21:25 srwiki-201801100205.sql.gz
The plan:
s3 -> s5 wiki movement planning
- Disable alerts on s5 eqiad and on a slave on s3 eqiad
- Stop replication on a s3 eqiad slave
- From s3 codfw slave: mydumper enwikivoyage, cebwiki, shwiki, srwiki & mgwiktionary - it might be worth to do a dry run before that to see how many time it takes
- On db1070: myloader all those wikis - and we should dry run the loading too
- Set up multi-source on db1070 but DON'T START SLAVE: change master 's3' to master_host=db1075
- Set up replication filters on db1070 for s3 replication channel
- db1070: start slave
- Prepare patch for db-eqiad.php
- Once we are read only on both DCs
- Rename tables on s3 codfw/eqiad master so if any writes arrive, they will fail
- Once we are completely sure all is good, rename tables on eqiad slaves to make sure if something read from it, fails and we can check logs
- Leave ^ for a few days before dropping tables on eqiad/codfw