We are seeing lots of errors related with the following output (https://logstash.wikimedia.org/goto/f8ec4b3e22a8b3d5a8ad0143a4f8982f):
``````lines=10
{
"_index": "logstash-2018.08.22",
"_type": "mediawiki",
"_id": "AWVgIepq8VFZOIjHYi4M",
"_version": 1,
"_score": null,
"_source": {
"server": "www.mediawiki.org",
"unique_id": "W3z2PwpAAEUAADLO8AUAAAAR",
"db_server": "10.64.32.136",
"method": "Wikimedia\\Rdbms\\DatabaseMysqlBase::open",
"level": "ERROR",
"ip": "10.64.48.103",
"wiki": "mediawikiwiki",
"channel": "DBConnection",
"mwversion": "1.32.0-wmf.18",
"message": "Error connecting to 10.64.32.136: Unknown database 'wikidatawiki'",
"type": "mediawiki",
"error": "Unknown database 'wikidatawiki'",
"normalized_message": "Error connecting to {db_server}: {error}",
"url": "/wiki/Special:MyLanguage/Help:Logging_in",
"tags": [
"syslog",
"es",
"es"
],
"reqId": "W3z2PwpAAEUAADLO8AUAAAAR",
"referrer": "http://hydrodictyon.eeb.uconn.edu/eebedia/index.php?title=Special:UserLogin&returnto=Main+Page",
"@timestamp": "2018-08-22T05:36:00.000Z",
"http_method": "GET",
"db_name": "wikidatawiki",
"db_user": "wikiuser",
"@version": 1,
"host": "mw1274",
"shard": "s3"
},
"fields": {
"@timestamp": [
1534916160000
]
},
"sort": [
1534916160000
]
server:www.mediawiki.org unique_id:W3z0zApAICkAAFWf3DoAAAAH db_server:10.64.48.35 method:Wikimedia\Rdbms\DatabaseMysqlBase::open level:ERROR ip:10.64.48.103 wiki:mediawikiwiki channel:DBConnection mwversion:1.32.0-wmf.18 message:Error connecting to 10.64.48.35: Unknown database 'wikidatawiki' type:mediawiki error:Unknown database 'wikidatawiki' normalized_message:Error connecting to {db_server}: {error} url:/wiki/Special:MyLanguage/Help:Logging_in tags:syslog, es, es reqId:W3z0zApAICkAAFWf3DoAAAAH referrer:http://wiki.wcpl.info/w/index.php?title=Special:UserLogin&returnto=Main+Page @timestamp:2018-08-22T05:29:48 http_method:GET db_name:wikidatawiki db_user:wikiuser @version:1 host:mw1320 shard:s3 _id:AWVgHD8JoOODFPKvaCfH _type:mediawiki _index:logstash-2018.08.22 _score: -}
```
The interesting bits are:
```
server:www.mediawiki.org
method:Wikimedia\Rdbms\DatabaseMysqlBase::open
wiki:mediawikiwiki
message:Error connecting to 10.64.48.35: Unknown database 'wikidatawiki' type:mediawiki error:Unknown database 'wikidatawiki'
shard:s3
```
wikidatawiki isn't on s3, but on s8.
Everything is coming from www.mediawiki.org apparently, and it is indeed causing an error:
https://www.mediawiki.org/wiki/Help:Logging_in returns:
```
Internal error
[W3z2OgpAIDAAAKUJ1hIAAABY] 2018-08-22 05:35:54: Fatal exception of type "Wikibase\DataModel\Services\Lookup\EntityLookupException"
```