Page MenuHomePhabricator
Create Task
Maniphest T390244

InvalidArgumentException: Default TTM service eqiad cannot be write only
Closed, ResolvedPublicPRODUCTION ERROR
Actions

Description

Error
normalized_message
[{reqId}] {exception_url}   InvalidArgumentException: Default TTM service eqiad cannot be write only
FrameLocationCall
from/srv/mediawiki/php-1.44.0-wmf.22/extensions/Translate/src/TtmServer/TtmServerFactory.php(98)
#0/srv/mediawiki/php-1.44.0-wmf.22/extensions/Translate/src/HookHandler.php(640)MediaWiki\Extension\Translate\TtmServer\TtmServerFactory->getDefaultForQuerying()
#1/srv/mediawiki/php-1.44.0-wmf.22/includes/HookContainer/HookContainer.php(155)MediaWiki\Extension\Translate\HookHandler::searchProfileForm(MediaWiki\Specials\SpecialSearch, string, string, string, array)
#2/srv/mediawiki/php-1.44.0-wmf.22/includes/HookContainer/HookRunner.php(3901)MediaWiki\HookContainer\HookContainer->run(string, array)
#3/srv/mediawiki/php-1.44.0-wmf.22/includes/search/searchwidgets/SearchFormWidget.php(265)MediaWiki\HookContainer\HookRunner->onSpecialSearchProfileForm(MediaWiki\Specials\SpecialSearch, string, string, string, array)
#4/srv/mediawiki/php-1.44.0-wmf.22/includes/search/searchwidgets/SearchFormWidget.php(101)MediaWiki\Search\SearchWidgets\SearchFormWidget->optionsHtml(string, bool, string)
#5/srv/mediawiki/php-1.44.0-wmf.22/includes/specials/SpecialSearch.php(466)MediaWiki\Search\SearchWidgets\SearchFormWidget->render(string, string, int, int, bool, int, bool, array)
#6/srv/mediawiki/php-1.44.0-wmf.22/includes/specials/SpecialSearch.php(237)MediaWiki\Specials\SpecialSearch->showResults(string)
#7/srv/mediawiki/php-1.44.0-wmf.22/includes/specialpage/SpecialPage.php(729)MediaWiki\Specials\SpecialSearch->execute(null)
#8/srv/mediawiki/php-1.44.0-wmf.22/includes/specialpage/SpecialPageFactory.php(1737)MediaWiki\SpecialPage\SpecialPage->run(null)
#9/srv/mediawiki/php-1.44.0-wmf.22/includes/actions/ActionEntryPoint.php(499)MediaWiki\SpecialPage\SpecialPageFactory->executePath(string, MediaWiki\Context\RequestContext)
#10/srv/mediawiki/php-1.44.0-wmf.22/includes/actions/ActionEntryPoint.php(143)MediaWiki\Actions\ActionEntryPoint->performRequest()
#11/srv/mediawiki/php-1.44.0-wmf.22/includes/MediaWikiEntryPoint.php(202)MediaWiki\Actions\ActionEntryPoint->execute()
#12/srv/mediawiki/php-1.44.0-wmf.22/index.php(58)MediaWiki\MediaWikiEntryPoint->run()
#13/srv/mediawiki/w/index.php(3)require(string)
#14{main}
Notes
  • Started at 15:30 on 2025-03-27
  • happening at a high rate now, mostly on commons
  • Seems like this might be operational, retag to SREs if that's true, please!

Details

Request URL
https://www.wikidata.org/w/index.php?fulltext=*&ns0=*&ns120=*&profile=*&search=*&title=*
Related Changes in Gerrit:
SubjectRepoBranchLines +/-
Translate: fix elasticsearch cluster setupoperations/mediawiki-configmaster+2 -2
Customize query in gerrit

Related Objects
Search...

Event Timeline

thcipriani created this task.Mar 27 2025, 10:02 PM
Restricted Application added a subscriber: Aklapper. · View Herald TranscriptMar 27 2025, 10:02 PM
Nikerabbit mentioned this in T388610: Migrate production Elastic clusters to Opensearch.Mar 28 2025, 6:36 AM
Nikerabbit subscribed.Mar 28 2025, 6:46 AM

There are docs in https://www.mediawiki.org/wiki/Help:Extension:Translate/Translation_memories#Configuration

Nikerabbit added a parent task: T388610: Migrate production Elastic clusters to Opensearch.Mar 28 2025, 6:47 AM
dcausse added a project: Discovery-Search (2025.03.22 - 2025.04.11).Mar 31 2025, 7:17 AM
gerritbot added a comment.Mar 31 2025, 7:20 AM

Change #1132423 had a related patch set uploaded (by DCausse; author: DCausse):

[operations/mediawiki-config@master] Translate: fix elasticsearch cluster setup

https://gerrit.wikimedia.org/r/1132423

gerritbot added a project: Patch-For-Review.Mar 31 2025, 7:20 AM
gerritbot added a comment.Mar 31 2025, 7:23 AM

Change #1132423 merged by jenkins-bot:

[operations/mediawiki-config@master] Translate: fix elasticsearch cluster setup

https://gerrit.wikimedia.org/r/1132423

Maintenance_bot removed a project: Patch-For-Review.Mar 31 2025, 7:30 AM
Stashbot added a comment.Mar 31 2025, 7:32 AM

Mentioned in SAL (#wikimedia-operations) [2025-03-31T07:32:25Z] <dcausse@deploy1003> Started scap sync-world: Backport for [[gerrit:1132423|Translate: fix elasticsearch cluster setup (T390244)]]

Stashbot added a comment.Mar 31 2025, 7:50 AM

Mentioned in SAL (#wikimedia-operations) [2025-03-31T07:50:53Z] <dcausse@deploy1003> Started scap sync-world: Backport for [[gerrit:1132423|Translate: fix elasticsearch cluster setup (T390244)]]

Stashbot added a comment.Mar 31 2025, 8:38 AM

Mentioned in SAL (#wikimedia-operations) [2025-03-31T08:38:26Z] <dcausse@deploy1003> Started scap sync-world: Backport for [[gerrit:1132423|Translate: fix elasticsearch cluster setup (T390244)]]

Stashbot added a comment.Mar 31 2025, 9:15 AM

Mentioned in SAL (#wikimedia-operations) [2025-03-31T09:15:00Z] <dcausse@deploy1003> Started scap sync-world: Backport for [[gerrit:1132423|Translate: fix elasticsearch cluster setup (T390244)]]

Stashbot added a comment.Mar 31 2025, 10:05 AM

Mentioned in SAL (#wikimedia-operations) [2025-03-31T10:05:17Z] <dcausse@deploy1003> Started scap sync-world: Backport for [[gerrit:1132423|Translate: fix elasticsearch cluster setup (T390244)]]

Stashbot added a comment.Mar 31 2025, 12:12 PM

Mentioned in SAL (#wikimedia-operations) [2025-03-31T12:12:18Z] <dcausse@deploy1003> Started scap sync-world: Backport for [[gerrit:1132423|Translate: fix elasticsearch cluster setup (T390244)]]

Stashbot added a comment.Mar 31 2025, 12:16 PM

Mentioned in SAL (#wikimedia-operations) [2025-03-31T12:16:36Z] <dcausse@deploy1003> dcausse: Backport for [[gerrit:1132423|Translate: fix elasticsearch cluster setup (T390244)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug)

Stashbot added a comment.Mar 31 2025, 12:28 PM

Mentioned in SAL (#wikimedia-operations) [2025-03-31T12:28:16Z] <dcausse@deploy1003> Finished scap sync-world: Backport for [[gerrit:1132423|Translate: fix elasticsearch cluster setup (T390244)]] (duration: 15m 57s)

dcausse closed this task as Resolved.Mar 31 2025, 12:38 PM
dcausse claimed this task.
dcausse moved this task from Incoming to Done on the Discovery-Search (2025.03.22 - 2025.04.11) board.
dcausse subscribed.

When shifting search traffic to eqiad we introduced an invalid config for TTM, adjusting mw-config solved the issue and restored TTM search functionalities.

Krinkle moved this task from Untriaged to Jan-Mar 2025 on the Wikimedia-production-error board.Apr 1 2025, 2:35 AM
Nikerabbit moved this task from Backlog to maintenance and operational issues on the MediaWiki-extensions-Translate board.Apr 1 2025, 9:57 AM
Nikerabbit moved this task from To triage to Blocked on others on the Language and Product Localization board.
Gehel moved this task from Done to Reported on the Discovery-Search (2025.03.22 - 2025.04.11) board.Apr 4 2025, 9:42 AM
Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL · Credits