Page MenuHomePhabricator

deployment-restbase05.deployment-prep.eqiad1.wikimedia.cloud configured to talk to parsoid.svc.deployment-prep.eqiad1.wikimedia.cloud
Closed, ResolvedPublicBUG REPORT

Description

Logstash is showing quite a number of Exec error in changeprop failures that indicate things are mad because I removed the parsoid.svc.deployment-prep.eqiad1.wikimedia.cloud service name in T385849: Determine usefulness of questionable hosts found in 2025-02-06 audit

{"type":"https://mediawiki.org/wiki/HyperSwitch/errors/internal_http_error","method":"get","detail":"getaddrinfo ENOTFOUND parsoid.svc.deployment-prep.eqiad1.wikimedia.cloud","uri":"/commons.wikimedia.beta.wmflabs.org/v1/page/html/File%3AACDC_test_file_1.pdf/316688","internalURI":"http://deployment-restbase05.deployment-prep.eqiad1.wikimedia.cloud:7231/commons.wikimedia.beta.wmflabs.org/v1/page/html/File%3AACDC_test_file_1.pdf/316688","internalMethod":"get"}

Event Timeline

bd808 changed the task status from Open to In Progress.Mar 18 2025, 9:04 PM
bd808 claimed this task.
bd808 triaged this task as High priority.

Mentioned in SAL (#wikimedia-releng) [2025-03-19T00:12:19Z] <bd808> Trying the simplest thing that might work by adding a CNAME record for parsoid.svc.deployment-prep.eqiad1.wikimedia.cloud. (T389252)

Adding the CNAME seems to have made things happier in the near term. I also just managed to figure out that the config that needs changing for this is https://gerrit.wikimedia.org/g/operations/mediawiki-config/+/c0e5c7f71d70de5749f6770abcbbb7e57032bd29/wmf-config/LabsServices.php#46

Change #1128996 had a related patch set uploaded (by BryanDavis; author: Bryan Davis):

[operations/mediawiki-config@master] LabsServices: use appservers service name for parsoid

https://gerrit.wikimedia.org/r/1128996

Change #1128996 merged by jenkins-bot:

[operations/mediawiki-config@master] LabsServices: use appservers service name for parsoid

https://gerrit.wikimedia.org/r/1128996

Mentioned in SAL (#wikimedia-operations) [2025-03-19T20:16:56Z] <tgr@deploy2002> Started scap sync-world: Backport for [[gerrit:1128996|LabsServices: use appservers service name for parsoid (T389252)]], [[gerrit:1129215|wikitech: Remove $wgCookieDomain override (T389318)]], [[gerrit:1129351|Revert^2 "Allowlist Special:WikimediaDebug on the shared domain"]], [[gerrit:1129352|Revert^2 "Allowlist Special:WikimediaDebug on the shared domain"]], [[gerrit:1129353|Revert^2 "Fix SUL3 login

Mentioned in SAL (#wikimedia-operations) [2025-03-19T20:22:03Z] <tgr@deploy2002> tgr, bd808: Backport for [[gerrit:1128996|LabsServices: use appservers service name for parsoid (T389252)]], [[gerrit:1129215|wikitech: Remove $wgCookieDomain override (T389318)]], [[gerrit:1129351|Revert^2 "Allowlist Special:WikimediaDebug on the shared domain"]], [[gerrit:1129352|Revert^2 "Allowlist Special:WikimediaDebug on the shared domain"]], [[gerrit:1129353|Revert^2 "Fix SUL3 login cohort logic

Mentioned in SAL (#wikimedia-operations) [2025-03-19T20:42:22Z] <tgr@deploy2002> Finished scap sync-world: Backport for [[gerrit:1128996|LabsServices: use appservers service name for parsoid (T389252)]], [[gerrit:1129215|wikitech: Remove $wgCookieDomain override (T389318)]], [[gerrit:1129351|Revert^2 "Allowlist Special:WikimediaDebug on the shared domain"]], [[gerrit:1129352|Revert^2 "Allowlist Special:WikimediaDebug on the shared domain"]], [[gerrit:1129353|Revert^2 "Fix SUL3 logi

Mentioned in SAL (#wikimedia-releng) [2025-03-26T00:30:44Z] <bd808> Delete parsoid.svc.deployment-prep.eqiad1.wikimedia.cloud service name again (T389252)