While doing s7 primary database failover T238044 (which apart from a few wikis, it also includes centralauth), we had to put the database on read only (for around 45 seconds), we observed the following errors: https://logstash.wikimedia.org/goto/8cdeea98921fbe0d1ee284fafa4b8bcd
@timestamp 2019-11-26T06:02:31
t @version 1
t _id AW6mTeA1arkxubcmWzbD
t _index logstash-deploy-2019.11.26
# _score -
t _type mediawiki
t caught_by mwe_handler
t channel error
t exception.class ErrorException
t exception.code 0
t exception.file /srv/mediawiki/php-1.35.0-wmf.5/includes/media/FormatMetadata.php:1432
t exception.message PHP Notice: A non well formed numeric value encountered
t exception.trace #0 /srv/mediawiki/php-1.35.0-wmf.5/includes/media/FormatMetadata.php(1432): MWExceptionHandler::handleError(integer, string, string, integer, array)
#1 /srv/mediawiki/php-1.35.0-wmf.5/includes/media/FormatMetadata.php(698): FormatMetadata->formatCoords(string, string)
#2 /srv/mediawiki/php-1.35.0-wmf.5/includes/media/FormatMetadata.php(88): FormatMetadata->makeFormattedData(array)
#3 /srv/mediawiki/php-1.35.0-wmf.5/includes/media/MediaHandler.php(500): FormatMetadata::getFormattedData(array, RequestContext)
#4 /srv/mediawiki/php-1.35.0-wmf.5/includes/media/ExifBitmapHandler.php(136): MediaHandler->formatMetadataHelper(array, RequestContext)
#5 /srv/mediawiki/php-1.35.0-wmf.5/includes/filerepo/file/File.php(1853): ExifBitmapHandler->formatMetadata(ForeignDBFile, RequestContext)
#6 /srv/mediawiki/php-1.35.0-wmf.5/includes/page/ImagePage.php(124): File->formatMetadata(RequestContext)
#7 /srv/mediawiki/php-1.35.0-wmf.5/includes/actions/ViewAction.php(63): ImagePage->view()
#8 /srv/mediawiki/php-1.35.0-wmf.5/includes/MediaWiki.php(514): ViewAction->show()
#9 /srv/mediawiki/php-1.35.0-wmf.5/includes/MediaWiki.php(304): MediaWiki->performAction(ImagePage, Title)
#10 /srv/mediawiki/php-1.35.0-wmf.5/includes/MediaWiki.php(967): MediaWiki->performRequest()
#11 /srv/mediawiki/php-1.35.0-wmf.5/includes/MediaWiki.php(530): MediaWiki->main()
#12 /srv/mediawiki/php-1.35.0-wmf.5/index.php(46): MediaWiki->run()
#13 /srv/mediawiki/w/index.php(3): require(string)
#14 {main}
t exception_id Xdy-9wpAAD8AAE0-JncAAAEC
t exception_url /wiki/%D7%A7%D7%95%D7%91%D7%A5:Pluvianus_aegyptius_3_Luc_Viatour.jpg
t facility user
t host mw1268
t http_method GET
t ip 10.64.0.63
t level ERROR
t logsource mw1268
t message [Xdy-9wpAAD8AAE0-JncAAAEC] /wiki/%D7%A7%D7%95%D7%91%D7%A5:Pluvianus_aegyptius_3_Luc_Viatour.jpg ErrorException from line 1432 of /srv/mediawiki/php-1.35.0-wmf.5/includes/media/FormatMetadata.php: PHP Notice: A non well formed numeric value encountered
t mwversion 1.35.0-wmf.5
t normalized_message [{exception_id}] {exception_url} ErrorException from line 1432 of /srv/mediawiki/php-1.35.0-wmf.5/includes/media/FormatMetadata.php: PHP Notice: A non well formed numeric value encountered
t phpversion 7.2.24-1+0~20191026.31+debian9~1.gbpbbacde+wmf1
t program mediawiki
t referrer -
t reqId Xdy-9wpAAD8AAE0-JncAAAEC
t server he.wikiquote.org
t severity err
t shard s3
t tags input-kafka-rsyslog-udp-localhost, rsyslog-udp-localhost, kafka, es
t timestamp 2019-11-26T08:02:31+00:00
t type mediawiki
t unique_id Xdy-9wpAAD8AAE0-JncAAAEC
t url /wiki/%D7%A7%D7%95%D7%91%D7%A5:Pluvianus_aegyptius_3_Luc_Viatour.jpg
t wiki hewikiquoteLooks like this is not limited to the failover time, and it is happening more often (500 errors per day)