Page MenuHomePhabricator
Create Task
Maniphest T250555

test.wikimedia.beta.wmflabs.org pages not loading: Unknown database 'testwikidatawiki'
Closed, ResolvedPublic
Actions

Description

I searched, but I couldn't find a report besides T230672 and T235970.

Expected: visiting https://test.wikimedia.beta.wmflabs.org/wiki/Main_Page shows the main page for testwiki

What happens instead: https://test.wikimedia.beta.wmflabs.org/wiki/Main_Page shows

MediaWiki internal error.

Original exception: [XprwKKwQBHcAADjf0@kAAAAQ] /wiki/Main_Page Wikimedia\Rdbms\DBQueryError from line 1619 of /srv/mediawiki/php-master/includes/libs/rdbms/database/Database.php: A database query error has occurred. Did you forget to run your application's database schema updater after upgrading?
Query: USE `testwikidatawiki`
Function: Wikimedia\Rdbms\DatabaseMysqlBase::doSelectDomain
Error: 1049 Unknown database 'testwikidatawiki' (172.16.4.147:3306)

Backtrace:
#0 /srv/mediawiki/php-master/includes/libs/rdbms/database/Database.php(1603): Wikimedia\Rdbms\Database->getQueryException(string, integer, string, string)
#1 /srv/mediawiki/php-master/includes/libs/rdbms/database/Database.php(1580): Wikimedia\Rdbms\Database->getQueryExceptionAndLog(string, integer, string, string)
#2 /srv/mediawiki/php-master/includes/libs/rdbms/database/DatabaseMysqlBase.php(205): Wikimedia\Rdbms\Database->reportQueryError(string, integer, string, string)
#3 /srv/mediawiki/php-master/includes/libs/rdbms/database/Database.php(2594): Wikimedia\Rdbms\DatabaseMysqlBase->doSelectDomain(Wikimedia\Rdbms\DatabaseDomain)
#4 /srv/mediawiki/php-master/includes/libs/rdbms/loadbalancer/LoadBalancer.php(1188): Wikimedia\Rdbms\Database->selectDomain(Wikimedia\Rdbms\DatabaseDomain)
#5 /srv/mediawiki/php-master/includes/libs/rdbms/loadbalancer/LoadBalancer.php(930): Wikimedia\Rdbms\LoadBalancer->getForeignConnection(integer, string, integer)
#6 /srv/mediawiki/php-master/includes/libs/rdbms/loadbalancer/LoadBalancer.php(901): Wikimedia\Rdbms\LoadBalancer->getServerConnection(integer, string, integer)
#7 /srv/mediawiki/php-master/includes/libs/rdbms/loadbalancer/LoadBalancer.php(1031): Wikimedia\Rdbms\LoadBalancer->getConnection(integer, array, string, integer)
#8 /srv/mediawiki/php-master/includes/dao/DBAccessBase.php(63): Wikimedia\Rdbms\LoadBalancer->getConnectionRef(integer, array, string)
#9 /srv/mediawiki/php-master/extensions/Wikibase/lib/includes/Store/Sql/SiteLinkTable.php(259): DBAccessBase->getConnection(integer)
#10 /srv/mediawiki/php-master/extensions/Wikibase/lib/includes/Store/CachingSiteLinkLookup.php(147): Wikibase\Lib\Store\Sql\SiteLinkTable->getItemIdForLink(string, string)
#11 /srv/mediawiki/php-master/extensions/Wikibase/lib/includes/Store/CachingSiteLinkLookup.php(75): Wikibase\Lib\Store\CachingSiteLinkLookup->getAndCacheItemIdForLink(string, string)
#12 /srv/mediawiki/php-master/extensions/Wikibase/client/includes/LangLinkHandler.php(101): Wikibase\Lib\Store\CachingSiteLinkLookup->getItemIdForLink(string, string)
#13 /srv/mediawiki/php-master/extensions/Wikibase/client/includes/LangLinkHandler.php(332): Wikibase\Client\LangLinkHandler->getEntityLinks(Title)
#14 /srv/mediawiki/php-master/extensions/Wikibase/client/includes/LangLinkHandler.php(353): Wikibase\Client\LangLinkHandler->getEffectiveRepoLinks(Title, ParserOutput)
#15 /srv/mediawiki/php-master/extensions/Wikibase/client/includes/Hooks/ParserOutputUpdateHookHandlers.php(97): Wikibase\Client\LangLinkHandler->addLinksFromRepository(Title, ParserOutput)
#16 /srv/mediawiki/php-master/extensions/Wikibase/client/includes/Hooks/ParserOutputUpdateHookHandlers.php(65): Wikibase\Client\Hooks\ParserOutputUpdateHookHandlers->doContentAlterParserOutput(Title, ParserOutput)
#17 /srv/mediawiki/php-master/includes/HookRunner/HookContainer.php(275): Wikibase\Client\Hooks\ParserOutputUpdateHookHandlers::onContentAlterParserOutput(WikitextContent, Title, ParserOutput)
#18 /srv/mediawiki/php-master/includes/HookRunner/HookContainer.php(126): MediaWiki\HookRunner\HookContainer->callLegacyHook(string, array, array, array)
#19 /srv/mediawiki/php-master/includes/Hooks.php(135): MediaWiki\HookRunner\HookContainer->run(string, array, array)
#20 /srv/mediawiki/php-master/includes/content/AbstractContent.php(569): Hooks::run(string, array)
#21 /srv/mediawiki/php-master/includes/Revision/RenderedRevision.php(267): AbstractContent->getParserOutput(Title, integer, ParserOptions, boolean)
#22 /srv/mediawiki/php-master/includes/Revision/RenderedRevision.php(236): MediaWiki\Revision\RenderedRevision->getSlotParserOutputUncached(WikitextContent, boolean)
#23 /srv/mediawiki/php-master/includes/Revision/RevisionRenderer.php(215): MediaWiki\Revision\RenderedRevision->getSlotParserOutput(string)
#24 /srv/mediawiki/php-master/includes/Revision/RevisionRenderer.php(152): MediaWiki\Revision\RevisionRenderer->combineSlotOutput(MediaWiki\Revision\RenderedRevision, array)
#25 [internal function]: MediaWiki\Revision\RevisionRenderer->MediaWiki\Revision\{closure}(MediaWiki\Revision\RenderedRevision, array)
#26 /srv/mediawiki/php-master/includes/Revision/RenderedRevision.php(198): call_user_func(Closure, MediaWiki\Revision\RenderedRevision, array)
#27 /srv/mediawiki/php-master/includes/poolcounter/PoolWorkArticleView.php(196): MediaWiki\Revision\RenderedRevision->getRevisionParserOutput()
#28 /srv/mediawiki/php-master/includes/poolcounter/PoolCounterWork.php(128): PoolWorkArticleView->doWork()
#29 /srv/mediawiki/php-master/includes/page/Article.php(787): PoolCounterWork->execute()
#30 /srv/mediawiki/php-master/includes/actions/ViewAction.php(66): Article->view()
#31 /srv/mediawiki/php-master/includes/MediaWiki.php(519): ViewAction->show()
#32 /srv/mediawiki/php-master/includes/MediaWiki.php(305): MediaWiki->performAction(Article, Title)
#33 /srv/mediawiki/php-master/includes/MediaWiki.php(973): MediaWiki->performRequest()
#34 /srv/mediawiki/php-master/includes/MediaWiki.php(535): MediaWiki->main()
#35 /srv/mediawiki/php-master/index.php(47): MediaWiki->run()
#36 /srv/mediawiki/w/index.php(3): require(string)
#37 {main}

Exception caught inside exception handler: [XprwKKwQBHcAADjf0@kAAAAQ] /wiki/Main_Page Wikimedia\Rdbms\DBTransactionStateError from line 1426 of /srv/mediawiki/php-master/includes/libs/rdbms/database/Database.php: Cannot execute query from GlobalPreferences\Storage::loadFromDB while transaction status is ERROR
Backtrace:
#0 /srv/mediawiki/php-master/includes/libs/rdbms/database/Database.php(1152): Wikimedia\Rdbms\Database->assertQueryIsCurrentlyAllowed(string, string)
#1 /srv/mediawiki/php-master/includes/libs/rdbms/database/Database.php(1819): Wikimedia\Rdbms\Database->query(string, string)
#2 /srv/mediawiki/php-master/includes/libs/rdbms/database/DBConnRef.php(68): Wikimedia\Rdbms\Database->select(string, array, array, string)
#3 /srv/mediawiki/php-master/includes/libs/rdbms/database/DBConnRef.php(313): Wikimedia\Rdbms\DBConnRef->__call(string, array)
#4 /srv/mediawiki/php-master/extensions/GlobalPreferences/includes/Storage.php(72): Wikimedia\Rdbms\DBConnRef->select(string, array, array, string)
#5 /srv/mediawiki/php-master/extensions/GlobalPreferences/includes/Storage.php(51): GlobalPreferences\Storage->loadFromDB()
#6 /srv/mediawiki/php-master/extensions/GlobalPreferences/includes/GlobalPreferencesFactory.php(504): GlobalPreferences\Storage->load(boolean)
#7 /srv/mediawiki/php-master/extensions/ContentTranslation/includes/PreferenceHelper.php(89): GlobalPreferences\GlobalPreferencesFactory->getGlobalPreferencesValues(boolean)
#8 /srv/mediawiki/php-master/extensions/ContentTranslation/includes/Hooks.php(173): ContentTranslation\PreferenceHelper::getGlobalPreference(User, string)
#9 /srv/mediawiki/php-master/includes/HookRunner/HookContainer.php(275): ContentTranslation\Hooks::addModules(OutputPage, SkinVector)
#10 /srv/mediawiki/php-master/includes/HookRunner/HookContainer.php(126): MediaWiki\HookRunner\HookContainer->callLegacyHook(string, array, array, array)
#11 /srv/mediawiki/php-master/includes/Hooks.php(153): MediaWiki\HookRunner\HookContainer->run(string, array, array)
#12 /srv/mediawiki/php-master/includes/OutputPage.php(2597): Hooks::runWithoutAbort(string, array)
#13 /srv/mediawiki/php-master/includes/exception/MWExceptionRenderer.php(153): OutputPage->output()
#14 /srv/mediawiki/php-master/includes/exception/MWExceptionRenderer.php(65): MWExceptionRenderer::reportHTML(Wikimedia\Rdbms\DBQueryError)
#15 /srv/mediawiki/php-master/includes/exception/MWExceptionHandler.php(103): MWExceptionRenderer::output(Wikimedia\Rdbms\DBQueryError, integer)
#16 /srv/mediawiki/php-master/includes/exception/MWExceptionHandler.php(177): MWExceptionHandler::report(Wikimedia\Rdbms\DBQueryError)
#17 /srv/mediawiki/php-master/includes/MediaWiki.php(568): MWExceptionHandler::handleException(Wikimedia\Rdbms\DBQueryError)
#18 /srv/mediawiki/php-master/index.php(47): MediaWiki->run()
#19 /srv/mediawiki/w/index.php(3): require(string)
#20 {main}

Details

Related Changes in Gerrit:
SubjectAuthorRepoBranchLines +/-
betacluster: Disallow wikidataclient-test leaking overMajavahoperations/mediawiki-configmaster+16 -5
Customize query in gerrit

Related Objects

Event Timeline

AlexisJazz created this task.Apr 18 2020, 12:23 PM
Restricted Application added a subscriber: Aklapper. · View Herald TranscriptApr 18 2020, 12:23 PM
AlexisJazz added a comment.Apr 18 2020, 12:24 PM

It JUST changed:

Sorry! This site is experiencing technical difficulties.

Try waiting a few minutes and reloading.

(Cannot access the database: Cannot access the database: Unknown error (172.16.4.147:3306))

Backtrace:

#0 /srv/mediawiki/php-master/includes/libs/rdbms/loadbalancer/LoadBalancer.php(934): Wikimedia\Rdbms\LoadBalancer->reportConnectionError()
#1 /srv/mediawiki/php-master/includes/libs/rdbms/loadbalancer/LoadBalancer.php(901): Wikimedia\Rdbms\LoadBalancer->getServerConnection(1, 'testwikidatawik...', 0)
#2 /srv/mediawiki/php-master/includes/libs/rdbms/loadbalancer/LoadBalancer.php(1031): Wikimedia\Rdbms\LoadBalancer->getConnection(-1, Array, 'testwikidatawik...', 0)
#3 /srv/mediawiki/php-master/includes/dao/DBAccessBase.php(63): Wikimedia\Rdbms\LoadBalancer->getConnectionRef(-1, Array, 'testwikidatawik...')
#4 /srv/mediawiki/php-master/extensions/Wikibase/lib/includes/Store/Sql/SiteLinkTable.php(259): DBAccessBase->getConnection(-1)
#5 /srv/mediawiki/php-master/extensions/Wikibase/lib/includes/Store/CachingSiteLinkLookup.php(147): Wikibase\Lib\Store\Sql\SiteLinkTable->getItemIdForLink('testwiki', 'Main Page')
#6 /srv/mediawiki/php-master/extensions/Wikibase/lib/includes/Store/CachingSiteLinkLookup.php(75): Wikibase\Lib\Store\CachingSiteLinkLookup->getAndCacheItemIdForLink('testwiki', 'Main Page')
#7 /srv/mediawiki/php-master/extensions/Wikibase/client/includes/LangLinkHandler.php(101): Wikibase\Lib\Store\CachingSiteLinkLookup->getItemIdForLink('testwiki', 'Main Page')
#8 /srv/mediawiki/php-master/extensions/Wikibase/client/includes/LangLinkHandler.php(332): Wikibase\Client\LangLinkHandler->getEntityLinks(Object(Title))
#9 /srv/mediawiki/php-master/extensions/Wikibase/client/includes/LangLinkHandler.php(353): Wikibase\Client\LangLinkHandler->getEffectiveRepoLinks(Object(Title), Object(ParserOutput))
#10 /srv/mediawiki/php-master/extensions/Wikibase/client/includes/Hooks/ParserOutputUpdateHookHandlers.php(97): Wikibase\Client\LangLinkHandler->addLinksFromRepository(Object(Title), Object(ParserOutput))
#11 /srv/mediawiki/php-master/extensions/Wikibase/client/includes/Hooks/ParserOutputUpdateHookHandlers.php(65): Wikibase\Client\Hooks\ParserOutputUpdateHookHandlers->doContentAlterParserOutput(Object(Title), Object(ParserOutput))
#12 /srv/mediawiki/php-master/includes/HookRunner/HookContainer.php(275): Wikibase\Client\Hooks\ParserOutputUpdateHookHandlers::onContentAlterParserOutput(Object(WikitextContent), Object(Title), Object(ParserOutput))
#13 /srv/mediawiki/php-master/includes/HookRunner/HookContainer.php(126): MediaWiki\HookRunner\HookContainer->callLegacyHook('ContentAlterPar...', Array, Array, Array)
#14 /srv/mediawiki/php-master/includes/Hooks.php(135): MediaWiki\HookRunner\HookContainer->run('ContentAlterPar...', Array, Array)
#15 /srv/mediawiki/php-master/includes/content/AbstractContent.php(569): Hooks::run('ContentAlterPar...', Array)
#16 /srv/mediawiki/php-master/includes/Revision/RenderedRevision.php(267): AbstractContent->getParserOutput(Object(Title), 2196, Object(ParserOptions), true)
#17 /srv/mediawiki/php-master/includes/Revision/RenderedRevision.php(236): MediaWiki\Revision\RenderedRevision->getSlotParserOutputUncached(Object(WikitextContent), true)
#18 /srv/mediawiki/php-master/includes/Revision/RevisionRenderer.php(215): MediaWiki\Revision\RenderedRevision->getSlotParserOutput('main')
#19 /srv/mediawiki/php-master/includes/Revision/RevisionRenderer.php(152): MediaWiki\Revision\RevisionRenderer->combineSlotOutput(Object(MediaWiki\Revision\RenderedRevision), Array)
#20 [internal function]: MediaWiki\Revision\RevisionRenderer->MediaWiki\Revision\{closure}(Object(MediaWiki\Revision\RenderedRevision), Array)
#21 /srv/mediawiki/php-master/includes/Revision/RenderedRevision.php(198): call_user_func(Object(Closure), Object(MediaWiki\Revision\RenderedRevision), Array)
#22 /srv/mediawiki/php-master/includes/poolcounter/PoolWorkArticleView.php(196): MediaWiki\Revision\RenderedRevision->getRevisionParserOutput()
#23 /srv/mediawiki/php-master/includes/poolcounter/PoolCounterWork.php(128): PoolWorkArticleView->doWork()
#24 /srv/mediawiki/php-master/includes/page/Article.php(787): PoolCounterWork->execute()
#25 /srv/mediawiki/php-master/includes/actions/ViewAction.php(66): Article->view()
#26 /srv/mediawiki/php-master/includes/MediaWiki.php(519): ViewAction->show()
#27 /srv/mediawiki/php-master/includes/MediaWiki.php(305): MediaWiki->performAction(Object(Article), Object(Title))
#28 /srv/mediawiki/php-master/includes/MediaWiki.php(973): MediaWiki->performRequest()
#29 /srv/mediawiki/php-master/includes/MediaWiki.php(535): MediaWiki->main()
#30 /srv/mediawiki/php-master/index.php(47): MediaWiki->run()
#31 /srv/mediawiki/w/index.php(3): require('/srv/mediawiki/...')
#32 {main}
AlexisJazz added a comment.Apr 18 2020, 12:25 PM

https://test.wikimedia.beta.wmflabs.org/w/index.php?title=Category:Steam_locomotives&action=edit still shows the "Error: 1049 Unknown database 'testwikidatawiki' (172.16.4.147:3306)" though.

AlexisJazz added a project: Beta-Cluster-Infrastructure.Apr 18 2020, 12:26 PM
AlexisJazz added a project: DBA.Apr 18 2020, 12:29 PM
Reedy added projects: WMF-General-or-Unknown, Wikidata-Campsite.Apr 18 2020, 12:50 PM
Reedy subscribed.

There's no testwikidatawiki in beta. I'm guessing some production config is leaking

Restricted Application added a project: Wikidata. · View Herald TranscriptApr 18 2020, 12:50 PM
Marostegui removed a project: DBA.Apr 18 2020, 12:51 PM
AlexisJazz mentioned this in T236341: Decouple UploadWizardConfig.maxUploads and maxUploads for Flickr imports.Apr 21 2020, 7:24 PM
• Mholloway subscribed.Jun 15 2020, 8:21 PM
taavi subscribed.Jun 19 2020, 6:42 PM

Hmh. This is caused by wmf-config/config/testwiki.yaml inheriting wikidataclient-test, which configures Wikibase to use testwikidatawiki instead of wikidatawiki. I'm not sure if it's possible to exclude that tag from Beta cluster.

Krinkle subscribed.Jun 19 2020, 7:00 PM
In T250555#6241257, @Majavah wrote:

Hmh. This is caused by wmf-config/config/testwiki.yaml inheriting wikidataclient-test, which configures Wikibase to use testwikidatawiki instead of wikidatawiki. I'm not sure if it's possible to exclude that tag from Beta cluster.

Not really. But we can configure the same setting unconditionally in InitialiseSettings-labs.php to be the same for all wikis there, which should achieve the same end result :)

taavi claimed this task.Jun 19 2020, 7:12 PM
Restricted Application added a project: User-Majavah. · View Herald TranscriptJun 19 2020, 7:12 PM
gerritbot added a comment.Jun 19 2020, 7:19 PM

Change 606755 had a related patch set uploaded (by Majavah; owner: Majavah):
[operations/mediawiki-config@master] betacluster: Add explicit testwikidataclient-test overrides

https://gerrit.wikimedia.org/r/606755

gerritbot added a project: Patch-For-Review.Jun 19 2020, 7:19 PM
Maintenance_bot moved this task from Unsorted to Working on on the User-Majavah board.Jun 19 2020, 8:15 PM
gerritbot added a comment.Jun 22 2020, 9:42 AM

Change 606755 merged by jenkins-bot:
[operations/mediawiki-config@master] betacluster: Disallow wikidataclient-test leaking over

https://gerrit.wikimedia.org/r/606755

taavi closed this task as Resolved.Jun 22 2020, 9:53 AM

Should be fixed now.

Maintenance_bot removed a project: Patch-For-Review.Jun 22 2020, 10:11 AM
Maintenance_bot moved this task from Working on to Done on the User-Majavah board.Jun 22 2020, 10:15 AM
Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL · Credits