labsdb1004 is crashing due to:
170303 20:04:26 [ERROR] InnoDB: Table s51412__data/book in the InnoDB data dictionary has tablespace id 48786, but tablespace with that id or name does not exist. Have you deleted or moved .ibd files? This may also be a table created with CREATE TEMPORARY TABLE whose .ibd and .frm files MySQL automatically removed, but the table still exists in the InnoDB internal data dictionary. InnoDB: Please refer to InnoDB: http://dev.mysql.com/doc/refman/5.6/en/innodb-troubleshooting-datadict.html InnoDB: for how to resolve the issue. 170303 20:04:26 [ERROR] InnoDB: Table s51412__data/dewiki_book in the InnoDB data dictionary has tablespace id 48790, but tablespace with that id or name does not exist. Have you deleted or moved .ibd files? This may also be a table created with CREATE TEMPORARY TABLE whose .ibd and .frm files MySQL automatically removed, but the table still exists in the InnoDB internal data dictionary. InnoDB: Please refer to InnoDB: http://dev.mysql.com/doc/refman/5.6/en/innodb-troubleshooting-datadict.html InnoDB: for how to resolve the issue. 170303 20:04:26 [ERROR] InnoDB: Table s51412__data/dewiki_external_beacon in the InnoDB data dictionary has tablespace id 48792, but tablespace with that id or name does not exist. Have you deleted or moved .ibd files? This may also be a table created with CREATE TEMPORARY TABLE whose .ibd and .frm files MySQL automatically removed, but the table still exists in the InnoDB internal data dictionary. InnoDB: Please refer to InnoDB: http://dev.mysql.com/doc/refman/5.6/en/innodb-troubleshooting-datadict.html InnoDB: for how to resolve the issue. 170303 20:04:26 [ERROR] InnoDB: Table s51412__data/dewiki_image in the InnoDB data dictionary has tablespace id 48791, but tablespace with that id or name does not exist. Have you deleted or moved .ibd files? This may also be a table created with CREATE TEMPORARY TABLE whose .ibd and .frm files MySQL automatically removed, but the table still exists in the InnoDB internal data dictionary. InnoDB: Please refer to InnoDB: http://dev.mysql.com/doc/refman/5.6/en/innodb-troubleshooting-datadict.html InnoDB: for how to resolve the issue. 170303 20:04:26 [ERROR] InnoDB: Table s51412__data/dewiki_normdaten in the InnoDB data dictionary has tablespace id 48793, but tablespace with that id or name does not exist. Have you deleted or moved .ibd files? This may also be a table created with CREATE TEMPORARY TABLE whose .ibd and .frm files MySQL automatically removed, but the table still exists in the InnoDB internal data dictionary. InnoDB: Please refer to InnoDB: http://dev.mysql.com/doc/refman/5.6/en/innodb-troubleshooting-datadict.html InnoDB: for how to resolve the issue. 170303 20:04:26 [ERROR] InnoDB: Table s51412__data/dewiki_pd_aemter in the InnoDB data dictionary has tablespace id 48794, but tablespace with that id or name does not exist. Have you deleted or moved .ibd files? This may also be a table created with CREATE TEMPORARY TABLE whose .ibd and .frm files MySQL automatically removed, but the table still exists in the InnoDB internal data dictionary. InnoDB: Please refer to InnoDB: http://dev.mysql.com/doc/refman/5.6/en/innodb-troubleshooting-datadict.html InnoDB: for how to resolve the issue. 170303 20:04:26 [ERROR] InnoDB: Table s51412__data/dewiki_spiegel in the InnoDB data dictionary has tablespace id 48795, but tablespace with that id or name does not exist. Have you deleted or moved .ibd files? This may also be a table created with CREATE TEMPORARY TABLE whose .ibd and .frm files MySQL automatically removed, but the table still exists in the InnoDB internal data dictionary. InnoDB: Please refer to InnoDB: http://dev.mysql.com/doc/refman/5.6/en/innodb-troubleshooting-datadict.html InnoDB: for how to resolve the issue. 170303 20:04:26 [ERROR] InnoDB: Table s51412__data/dewiki_templatedata in the InnoDB data dictionary has tablespace id 48803, but tablespace with that id or name does not exist. Have you deleted or moved .ibd files? This may also be a table created with CREATE TEMPORARY TABLE whose .ibd and .frm files MySQL automatically removed, but the table still exists in the InnoDB internal data dictionary. InnoDB: Please refer to InnoDB: http://dev.mysql.com/doc/refman/5.6/en/innodb-troubleshooting-datadict.html InnoDB: for how to resolve the issue. 170303 20:04:26 [ERROR] InnoDB: Table s51412__data/dewiki_templatedata_pages in the InnoDB data dictionary has tablespace id 48797, but tablespace with that id or name does not exist. Have you deleted or moved .ibd files? This may also be a table created with CREATE TEMPORARY TABLE whose .ibd and .frm files MySQL automatically removed, but the table still exists in the InnoDB internal data dictionary. InnoDB: Please refer to InnoDB: http://dev.mysql.com/doc/refman/5.6/en/innodb-troubleshooting-datadict.html InnoDB: for how to resolve the issue. 170303 20:04:26 [ERROR] InnoDB: Table s51412__data/dewiki_wartung_bkl_in_pd in the InnoDB data dictionary has tablespace id 48798, but tablespace with that id or name does not exist. Have you deleted or moved .ibd files? This may also be a table created with CREATE TEMPORARY TABLE whose .ibd and .frm files MySQL automatically removed, but the table still exists in the InnoDB internal data dictionary. InnoDB: Please refer to InnoDB: http://dev.mysql.com/doc/refman/5.6/en/innodb-troubleshooting-datadict.html InnoDB: for how to resolve the issue. 170303 20:04:26 [ERROR] InnoDB: Table s51412__data/log in the InnoDB data dictionary has tablespace id 48799, but tablespace with that id or name does not exist. Have you deleted or moved .ibd files? This may also be a table created with CREATE TEMPORARY TABLE whose .ibd and .frm files MySQL automatically removed, but the table still exists in the InnoDB internal data dictionary. InnoDB: Please refer to InnoDB: http://dev.mysql.com/doc/refman/5.6/en/innodb-troubleshooting-datadict.html InnoDB: for how to resolve the issue. 170303 20:04:26 [ERROR] InnoDB: Table s51412__data/misc_data in the InnoDB data dictionary has tablespace id 48800, but tablespace with that id or name does not exist. Have you deleted or moved .ibd files? This may also be a table created with CREATE TEMPORARY TABLE whose .ibd and .frm files MySQL automatically removed, but the table still exists in the InnoDB internal data dictionary.
I have seen this:
mysql:root@localhost [s51412__data]> show tables; ERROR 1018 (HY000): Can't read dir of './s51412__data/' (errno: 13 "Permission denied")
root@labsdb1004:/srv/labsdb/data# ls -lh | grep s51412__data drwx------ 2 root root 4.0K Dec 16 10:40 s51412__data
I am not completely aware of why this database is owned by root, so I won't touch them on a Friday evening.
@jcrespo @chasemp or @yuvipanda might have more context and know if it is safe to given them back to mysql user?