Page MenuHomePhabricator

MinT: Translation with MinT/Apertium are failing: fetch failed
Closed, ResolvedPublicBUG REPORT

Description

MinT (and probably Apertium) seems failing with errors like this,

Error: Translation with MinT en>uz failed: fetch failed
    at MinT.translate (/srv/service/lib/mt/MinT.js:77:10)
    at process.processTicksAndRejections (node:internal/process/task_queues:95:5)

Log: https://logstash.wikimedia.org/app/discover#/doc/logstash-*/logstash-k8s-1-7.0.0-1-2024.03.07?id=SUzGGI4BWjhRzdxnwgEg

Event Timeline

KartikMistry renamed this task from MinT: Translation with MinT failed: fetch failed to MinT: Translation with MinT/Apertium are failing: fetch failed.Mar 7 2024, 12:09 PM
KartikMistry triaged this task as High priority.

From translatewiki.net logs, this has started a few days ago:

[2024-03-05T19:28:29.966835+00:00] translationservices.WARNING: Translation service MinT problem: STATUS:  BODY: Error: Translation with MinT en>el failed: fetch failed [] []
[2024-03-05T19:29:20.760445+00:00] translationservices.WARNING: Translation service MinT problem: STATUS:  BODY: Error: Translation with MinT en>el failed: fetch failed [] []
[2024-03-05T19:29:52.785186+00:00] translationservices.WARNING: Translation service MinT problem: STATUS:  BODY: Error: Translation with MinT en>el failed: fetch failed [] []
[2024-03-05T19:40:30.258658+00:00] translationservices.WARNING: Translation service MinT problem: STATUS:  BODY: Error: Translation with MinT en>el failed: fetch failed [] []
[2024-03-05T19:44:43.354863+00:00] translationservices.WARNING: Translation service MinT problem: STATUS:  BODY: Error: Translation with MinT en>el failed: fetch failed [] []
[2024-03-05T20:01:26.995179+00:00] translationservices.WARNING: Translation service MinT problem: STATUS:  BODY: Error: Translation with MinT en>lij failed: fetch failed [] []
[2024-03-05T20:25:19.667624+00:00] translationservices.WARNING: Translation service MinT problem: STATUS:  BODY: Error: Translation with MinT en>sl failed: fetch failed [] []
[2024-03-05T20:33:49.480156+00:00] translationservices.WARNING: Translation service Apertium WMF problem: STATUS:  BODY: Error: Translation with Apertium sv > is failed: fetch failed [] []
[2024-03-05T20:42:19.272992+00:00] translationservices.WARNING: Translation service MinT problem: STATUS:  BODY: Error: Translation with MinT en>lij failed: fetch failed [] []
[2024-03-05T20:57:44.083116+00:00] translationservices.WARNING: Translation service MinT problem: STATUS:  BODY: Error: Translation with MinT en>fr failed: fetch failed [] []
[2024-03-05T21:20:51.737015+00:00] translationservices.WARNING: Translation service Apertium WMF problem: STATUS:  BODY: Error: Translation with Apertium sv > is failed: fetch failed [] []
[2024-03-05T21:21:34.157926+00:00] translationservices.WARNING: Translation service MinT problem: STATUS:  BODY: Error: Translation with MinT en>el failed: fetch failed [] []
[2024-03-05T21:36:55.687952+00:00] translationservices.WARNING: Translation service MinT problem: STATUS:  BODY: Error: Translation with MinT en>el failed: fetch failed [] []
[2024-03-05T21:53:37.473085+00:00] translationservices.WARNING: Translation service MinT problem: STATUS:  BODY: Error: Translation with MinT en>lij failed: fetch failed [] []
[2024-03-05T22:12:46.840496+00:00] translationservices.WARNING: Translation service MinT problem: STATUS:  BODY: Error: Translation with MinT en>lb failed: fetch failed [] []
[2024-03-05T22:33:15.004545+00:00] translationservices.WARNING: Translation service MinT problem: STATUS:  BODY: Error: Translation with MinT en>el failed: fetch failed [] []
[2024-03-05T23:03:13.652790+00:00] translationservices.WARNING: Translation service MinT problem: STATUS:  BODY: Error: Translation with MinT en>fi failed: fetch failed [] []
[2024-03-05T23:45:43.297639+00:00] translationservices.WARNING: Translation service MinT problem: STATUS:  BODY: Error: Translation with MinT en>pl failed: fetch failed [] []
[2024-03-06T00:37:34.660137+00:00] translationservices.WARNING: Translation service MinT problem: STATUS:  BODY: Error: Translation with MinT en>fr failed: fetch failed [] []
[2024-03-06T00:38:20.453077+00:00] translationservices.WARNING: Translation service MinT problem: STATUS:  BODY: Error: Translation with MinT en>fr failed: fetch failed [] []
[2024-03-06T00:38:34.187399+00:00] translationservices.WARNING: Translation service MinT problem: STATUS:  BODY: Error: Translation with MinT en>fr failed: fetch failed [] []
[2024-03-06T00:38:51.996510+00:00] translationservices.WARNING: Translation service MinT problem: STATUS:  BODY: Error: Translation with MinT en>fr failed: fetch failed [] []
[2024-03-06T00:39:01.416347+00:00] translationservices.WARNING: Translation service MinT problem: STATUS:  BODY: Error: Translation with MinT en>fr failed: fetch failed [] []
[2024-03-06T00:55:17.491464+00:00] translationservices.WARNING: Translation service MinT problem: STATUS:  BODY: Error: Translation with MinT en>mk failed: fetch failed [] []
[2024-03-06T01:18:14.134049+00:00] translationservices.WARNING: Translation service MinT problem: STATUS:  BODY: Error: Translation with MinT en>mk failed: fetch failed [] []
[2024-03-06T01:44:14.611160+00:00] translationservices.WARNING: Translation service MinT problem: STATUS:  BODY: Error: Translation with MinT en>es failed: fetch failed [] []
[2024-03-06T01:54:42.747130+00:00] translationservices.WARNING: Translation service Apertium WMF problem: STATUS:  BODY: Error: Translation with Apertium ca > en failed: fetch failed [] []
[2024-03-06T02:15:26.642539+00:00] translationservices.WARNING: Translation service MinT problem: STATUS:  BODY: Error: Translation with MinT en>mk failed: fetch failed [] []
[2024-03-06T02:16:09.705334+00:00] translationservices.WARNING: Translation service MinT problem: STATUS:  BODY: Error: Translation with MinT en>mk failed: fetch failed [] []
[2024-03-06T03:12:58.484135+00:00] translationservices.WARNING: Translation service MinT problem: STATUS:  BODY: Error: Translation with MinT en>it failed: fetch failed [] []
[2024-03-06T03:13:49.624770+00:00] translationservices.WARNING: Translation service MinT problem: STATUS:  BODY: Error: Translation with MinT en>it failed: fetch failed [] []
[2024-03-06T03:14:17.683499+00:00] translationservices.WARNING: Translation service Apertium WMF problem: STATUS:  BODY: Error: Translation with Apertium es > it failed: fetch failed [] []
[2024-03-06T03:14:52.244647+00:00] translationservices.WARNING: Translation service MinT problem: STATUS:  BODY: Error: Translation with MinT en>it failed: fetch failed [] []
[2024-03-06T03:15:47.936890+00:00] translationservices.WARNING: Translation service Apertium WMF problem: STATUS:  BODY: Error: Translation with Apertium es > it failed: fetch failed [] []
[2024-03-06T03:15:47.937424+00:00] translationservices.WARNING: Translation service MinT problem: STATUS:  BODY: Error: Translation with MinT en>it failed: fetch failed [] []
[2024-03-06T03:34:06.335443+00:00] translationservices.WARNING: Translation service MinT problem: STATUS:  BODY: Error: Translation with MinT en>scn failed: fetch failed [] []
[2024-03-06T04:28:18.748981+00:00] translationservices.WARNING: Translation service MinT problem: STATUS:  BODY: Error: Translation with MinT en>es failed: fetch failed [] []
[2024-03-06T04:29:52.405718+00:00] translationservices.WARNING: Translation service MinT problem: STATUS:  BODY: Error: Translation with MinT en>ar failed: fetch failed [] []
[2024-03-06T05:31:25.551615+00:00] translationservices.WARNING: Translation service MinT problem: STATUS:  BODY: Error: Translation with MinT en>ar failed: fetch failed [] []
[2024-03-06T05:37:16.625991+00:00] translationservices.WARNING: Translation service MinT problem: STATUS:  BODY: Error: Translation with MinT en>ar failed: fetch failed [] []
[2024-03-06T05:37:16.989294+00:00] translationservices.WARNING: Translation service MinT problem: STATUS:  BODY: Error: Translation with MinT en>ar failed: fetch failed [] []
[2024-03-06T05:38:00.222634+00:00] translationservices.WARNING: Translation service MinT problem: STATUS:  BODY: Error: Translation with MinT en>ar failed: fetch failed [] []
[2024-03-06T06:21:00.910814+00:00] translationservices.WARNING: Translation service MinT problem: STATUS:  BODY: Error: Translation with MinT en>fi failed: fetch failed [] []
[2024-03-06T06:24:03.669532+00:00] translationservices.WARNING: Translation service MinT problem: STATUS:  BODY: Error: Translation with MinT en>mag failed: fetch failed [] []
[2024-03-06T06:25:35.623285+00:00] translationservices.WARNING: Translation service MinT problem: STATUS:  BODY: Error: Translation with MinT en>pt failed: fetch failed [] []
[2024-03-06T06:25:55.000023+00:00] translationservices.WARNING: Translation service MinT problem: STATUS:  BODY: Error: Translation with MinT en>ru failed: fetch failed [] []
[2024-03-06T06:28:18.032656+00:00] translationservices.WARNING: Translation service Apertium WMF problem: STATUS:  BODY: Error: Translation with Apertium fr > frp failed: fetch failed [] []
[2024-03-06T06:29:00.075087+00:00] translationservices.WARNING: Translation service Apertium WMF problem: STATUS:  BODY: Error: Translation with Apertium fr > frp failed: fetch failed [] []
[2024-03-06T06:43:39.022607+00:00] translationservices.WARNING: Translation service MinT problem: STATUS:  BODY: Error: Translation with MinT en>yo failed: fetch failed [] []
[2024-03-06T07:23:46.956808+00:00] translationservices.WARNING: Translation service MinT problem: STATUS:  BODY: Error: Translation with MinT en>ru failed: fetch failed [] []
[2024-03-06T07:33:33.656727+00:00] translationservices.WARNING: Translation service MinT problem: STATUS:  BODY: Error: Translation with MinT en>ru failed: fetch failed [] []
[2024-03-06T07:34:35.238780+00:00] translationservices.WARNING: Translation service MinT problem: STATUS:  BODY: Error: Translation with MinT en>ru failed: fetch failed [] []
[2024-03-06T07:50:26.375608+00:00] translationservices.WARNING: Translation service MinT problem: STATUS:  BODY: Error: Translation with MinT en>ar failed: fetch failed [] []
[2024-03-06T07:51:07.578439+00:00] translationservices.WARNING: Translation service MinT problem: STATUS:  BODY: Error: Translation with MinT en>ar failed: fetch failed [] []
[2024-03-06T08:24:25.587056+00:00] translationservices.WARNING: Translation service Apertium WMF problem: STATUS:  BODY: Error: Translation with Apertium es > it failed: fetch failed [] []
[2024-03-06T08:24:25.587778+00:00] translationservices.WARNING: Translation service MinT problem: STATUS:  BODY: Error: Translation with MinT en>it failed: fetch failed [] []
[2024-03-06T08:25:07.639460+00:00] translationservices.WARNING: Translation service MinT problem: STATUS:  BODY: Error: Translation with MinT en>it failed: fetch failed [] []
[2024-03-06T08:50:11.047820+00:00] translationservices.WARNING: Translation service MinT problem: STATUS:  BODY: Error: Translation with MinT en>it failed: fetch failed [] []
[2024-03-06T09:38:49.421943+00:00] translationservices.WARNING: Translation service MinT problem: STATUS:  BODY: Error: Translation with MinT en>sl failed: fetch failed [] []
[2024-03-06T09:39:01.867081+00:00] translationservices.WARNING: Translation service MinT problem: STATUS:  BODY: Error: Translation with MinT en>sl failed: fetch failed [] []
[2024-03-06T09:43:11.494722+00:00] translationservices.WARNING: Translation service MinT problem: STATUS:  BODY: Error: Translation with MinT en>sl failed: fetch failed [] []
[2024-03-06T09:45:17.537371+00:00] translationservices.WARNING: Translation service MinT problem: STATUS:  BODY: Error: Translation with MinT en>sl failed: fetch failed [] []
[2024-03-06T09:48:13.479949+00:00] translationservices.WARNING: Translation service MinT problem: STATUS:  BODY: Error: Translation with MinT en>sl failed: fetch failed [] []
[2024-03-06T10:04:35.058307+00:00] translationservices.WARNING: Translation service MinT problem: STATUS:  BODY: Error: Translation with MinT en>mk failed: fetch failed [] []
[2024-03-06T10:27:11.845744+00:00] translationservices.WARNING: Translation service MinT problem: STATUS:  BODY: Error: Translation with MinT en>ar failed: fetch failed [] []
[2024-03-06T10:46:58.033365+00:00] translationservices.WARNING: Translation service Apertium WMF problem: STATUS:  BODY: Error: Translation with Apertium en > eo failed: fetch failed [] []
[2024-03-06T10:47:15.255410+00:00] translationservices.WARNING: Translation service MinT problem: STATUS:  BODY: Error: Translation with MinT en>eo failed: fetch failed [] []
[2024-03-06T11:36:23.957334+00:00] translationservices.WARNING: Translation service MinT problem: STATUS:  BODY: Error: Translation with MinT en>fi failed: fetch failed [] []
[2024-03-06T11:36:29.116035+00:00] translationservices.WARNING: Translation service MinT problem: STATUS:  BODY: Error: Translation with MinT en>fi failed: fetch failed [] []
[2024-03-06T11:38:26.423202+00:00] translationservices.WARNING: Translation service MinT problem: STATUS:  BODY: Error: Translation with MinT en>fi failed: fetch failed [] []
[2024-03-06T11:42:05.280710+00:00] translationservices.WARNING: Translation service MinT problem: STATUS:  BODY: Error: Translation with MinT en>fi failed: fetch failed [] []
[2024-03-06T11:44:02.268897+00:00] translationservices.WARNING: Translation service MinT problem: STATUS:  BODY: Error: Translation with MinT en>sv failed: fetch failed [] []
[2024-03-06T12:01:03.503926+00:00] translationservices.WARNING: Translation service MinT problem: STATUS:  BODY: Error: Translation with MinT en>pa failed: fetch failed [] []
[2024-03-06T12:19:20.983180+00:00] translationservices.WARNING: Translation service MinT problem: STATUS:  BODY: Error: Translation with MinT en>fr failed: fetch failed [] []
[2024-03-06T12:34:39.409440+00:00] translationservices.WARNING: Translation service MinT problem: STATUS:  BODY: Error: Translation with MinT en>he failed: fetch failed [] []
[2024-03-06T12:50:24.062172+00:00] translationservices.WARNING: Translation service MinT problem: STATUS:  BODY: Error: Translation with MinT en>fr failed: fetch failed [] []
[2024-03-06T13:07:37.694965+00:00] translationservices.WARNING: Translation service MinT problem: STATUS:  BODY: Error: Translation with MinT en>ko failed: fetch failed [] []
[2024-03-06T13:21:17.674017+00:00] translationservices.WARNING: Translation service Apertium WMF problem: STATUS:  BODY: Error: Translation with Apertium be > ru failed: fetch failed [] []
[2024-03-06T13:23:00.950199+00:00] translationservices.WARNING: Translation service MinT problem: STATUS:  BODY: Error: Translation with MinT en>fr failed: fetch failed [] []
[2024-03-06T13:38:21.288983+00:00] translationservices.WARNING: Translation service MinT problem: STATUS:  BODY: Error: Translation with MinT en>ko failed: fetch failed [] []
[2024-03-06T14:07:53.660371+00:00] translationservices.WARNING: Translation service Apertium WMF problem: STATUS:  BODY: Error: Translation with Apertium nl > af failed: fetch failed [] []
[2024-03-06T14:10:05.975833+00:00] translationservices.WARNING: Translation service Apertium WMF problem: STATUS:  BODY: Error: Translation with Apertium nl > af failed: fetch failed [] []
[2024-03-06T14:11:04.708950+00:00] translationservices.WARNING: Translation service Apertium WMF problem: STATUS:  BODY: Error: Translation with Apertium nl > af failed: fetch failed [] []
[2024-03-06T14:13:18.005159+00:00] translationservices.WARNING: Translation service Apertium WMF problem: STATUS:  BODY: Error: Translation with Apertium nl > af failed: fetch failed [] []
[2024-03-06T14:14:21.759979+00:00] translationservices.WARNING: Translation service MinT problem: STATUS:  BODY: Error: Translation with MinT en>af failed: fetch failed [] []
[2024-03-06T14:14:46.497911+00:00] translationservices.WARNING: Translation service Apertium WMF problem: STATUS:  BODY: Error: Translation with Apertium nl > af failed: fetch failed [] []
[2024-03-06T14:14:59.345530+00:00] translationservices.WARNING: Translation service MinT problem: STATUS:  BODY: Error: Translation with MinT en>af failed: fetch failed [] []
[2024-03-06T14:15:17.486540+00:00] translationservices.WARNING: Translation service MinT problem: STATUS:  BODY: Error: Translation with MinT en>af failed: fetch failed [] []
[2024-03-06T14:21:05.525645+00:00] translationservices.WARNING: Translation service MinT problem: STATUS:  BODY: Error: Translation with MinT en>da failed: fetch failed [] []
[2024-03-06T14:41:36.122126+00:00] translationservices.WARNING: Translation service MinT problem: STATUS:  BODY: Error: Translation with MinT en>es failed: fetch failed [] []
[2024-03-06T15:05:03.015239+00:00] translationservices.WARNING: Translation service MinT problem: STATUS:  BODY: Error: Translation with MinT en>tr failed: fetch failed [] []
[2024-03-06T15:44:38.440913+00:00] translationservices.WARNING: Translation service MinT problem: STATUS:  BODY: Error: Translation with MinT en>it failed: fetch failed [] []
[2024-03-06T15:44:59.989269+00:00] translationservices.WARNING: Translation service MinT problem: STATUS:  BODY: Error: Translation with MinT en>it failed: fetch failed [] []
[2024-03-06T15:45:56.477873+00:00] translationservices.WARNING: Translation service MinT problem: STATUS:  BODY: Error: Translation with MinT en>it failed: fetch failed [] []
[2024-03-06T15:48:01.381640+00:00] translationservices.WARNING: Translation service MinT problem: STATUS:  BODY: Error: Translation with MinT en>it failed: fetch failed [] []
[2024-03-06T15:48:07.524208+00:00] translationservices.WARNING: Translation service MinT problem: STATUS:  BODY: Error: Translation with MinT en>it failed: fetch failed [] []
[2024-03-06T15:50:20.555893+00:00] translationservices.WARNING: Translation service Apertium WMF problem: STATUS:  BODY: Error: Translation with Apertium es > it failed: fetch failed [] []
[2024-03-06T15:50:54.648703+00:00] translationservices.WARNING: Translation service Apertium WMF problem: STATUS:  BODY: Error: Translation with Apertium es > it failed: fetch failed [] []
[2024-03-06T15:51:20.759093+00:00] translationservices.WARNING: Translation service Apertium WMF problem: STATUS:  BODY: Error: Translation with Apertium es > it failed: fetch failed [] []
[2024-03-06T15:51:23.868437+00:00] translationservices.WARNING: Translation service Apertium WMF problem: STATUS:  BODY: Error: Translation with Apertium es > it failed: fetch failed [] []
[2024-03-06T15:51:29.553618+00:00] translationservices.WARNING: Translation service Apertium WMF problem: STATUS:  BODY: Error: Translation with Apertium es > it failed: fetch failed [] []
[2024-03-06T16:04:14.985063+00:00] translationservices.WARNING: Translation service MinT problem: STATUS:  BODY: Error: Translation with MinT en>it failed: fetch failed [] []
[2024-03-06T16:08:44.191251+00:00] translationservices.WARNING: Translation service Apertium WMF problem: STATUS:  BODY: Error: Translation with Apertium es > it failed: fetch failed [] []
[2024-03-06T17:33:58.801492+00:00] translationservices.WARNING: Translation service MinT problem: STATUS:  BODY: Error: Translation with MinT en>scn failed: fetch failed [] []
[2024-03-06T17:51:22.515446+00:00] translationservices.WARNING: Translation service MinT problem: STATUS:  BODY: Error: Translation with MinT en>apc failed: fetch failed [] []
[2024-03-06T18:13:22.434632+00:00] translationservices.WARNING: Translation service MinT problem: STATUS:  BODY: Error: Translation with MinT en>es failed: fetch failed [] []
[2024-03-06T18:13:25.894153+00:00] translationservices.WARNING: Translation service MinT problem: STATUS:  BODY: Error: Translation with MinT en>es failed: fetch failed [] []
[2024-03-06T18:13:26.443994+00:00] translationservices.WARNING: Translation service MinT problem: STATUS:  BODY: Error: Translation with MinT en>es failed: fetch failed [] []
[2024-03-06T18:35:32.692426+00:00] translationservices.WARNING: Translation service MinT problem: STATUS:  BODY: Error: Translation with MinT en>pl failed: fetch failed [] []
[2024-03-06T18:54:25.689752+00:00] translationservices.WARNING: Translation service MinT problem: STATUS:  BODY: Error: Translation with MinT en>sl failed: fetch failed [] []
[2024-03-06T19:14:09.754989+00:00] translationservices.WARNING: Translation service MinT problem: STATUS:  BODY: Error: Translation with MinT en>he failed: fetch failed [] []
[2024-03-06T19:35:58.881087+00:00] translationservices.WARNING: Translation service MinT problem: STATUS:  BODY: Error: Translation with MinT en>uk failed: fetch failed [] []
[2024-03-06T20:51:29.815951+00:00] translationservices.WARNING: Translation service MinT problem: STATUS:  BODY: Error: Translation with MinT en>lij failed: fetch failed [] []
[2024-03-06T21:12:07.562608+00:00] translationservices.WARNING: Translation service MinT problem: STATUS:  BODY: Error: Translation with MinT en>lij failed: fetch failed [] []
[2024-03-06T21:13:21.741335+00:00] translationservices.WARNING: Translation service MinT problem: STATUS:  BODY: Error: Translation with MinT en>lij failed: fetch failed [] []
[2024-03-06T21:24:24.395374+00:00] translationservices.WARNING: Translation service MinT problem: STATUS:  BODY: Error: Translation with MinT en>lij failed: fetch failed [] []
[2024-03-06T21:26:01.691454+00:00] translationservices.WARNING: Translation service MinT problem: STATUS:  BODY: Error: Translation with MinT en>lij failed: fetch failed [] []
[2024-03-06T21:50:34.601752+00:00] translationservices.WARNING: Translation service MinT problem: STATUS:  BODY: Error: Translation with MinT en>lij failed: fetch failed [] []
[2024-03-06T21:55:58.775730+00:00] translationservices.WARNING: Translation service Apertium WMF problem: STATUS:  BODY: Error: Translation with Apertium da > nb failed: fetch failed [] []
[2024-03-06T21:56:38.978874+00:00] translationservices.WARNING: Translation service Apertium WMF problem: STATUS:  BODY: Error: Translation with Apertium da > nb failed: fetch failed [] []
[2024-03-06T22:06:19.154832+00:00] translationservices.WARNING: Translation service MinT problem: STATUS:  BODY: Error: Translation with MinT en>lb failed: fetch failed [] []
[2024-03-06T22:34:48.695469+00:00] translationservices.WARNING: Translation service MinT problem: STATUS:  BODY: Error: Translation with MinT en>fr failed: fetch failed [] []
[2024-03-06T22:50:32.142873+00:00] translationservices.WARNING: Translation service MinT problem: STATUS:  BODY: Error: Translation with MinT en>fr failed: fetch failed [] []
[2024-03-06T23:14:24.993902+00:00] translationservices.WARNING: Translation service MinT problem: STATUS:  BODY: Error: Translation with MinT en>he failed: fetch failed [] []
[2024-03-06T23:24:47.518687+00:00] translationservices.WARNING: Translation service Apertium WMF problem: STATUS:  BODY: Error: Translation with Apertium nb > sv failed: fetch failed [] []
[2024-03-07T00:22:35.983874+00:00] translationservices.WARNING: Translation service MinT problem: STATUS:  BODY: Error: Translation with MinT en>he failed: fetch failed [] []
[2024-03-07T00:22:50.719431+00:00] translationservices.WARNING: Translation service MinT problem: STATUS:  BODY: Error: Translation with MinT en>he failed: fetch failed [] []
[2024-03-07T00:24:35.884463+00:00] translationservices.WARNING: Translation service MinT problem: STATUS:  BODY: Error: Translation with MinT en>he failed: fetch failed [] []
[2024-03-07T00:31:13.462582+00:00] translationservices.WARNING: Translation service MinT problem: STATUS:  BODY: Error: Translation with MinT en>he failed: fetch failed [] []
[2024-03-07T00:32:57.923879+00:00] translationservices.WARNING: Translation service MinT problem: STATUS:  BODY: Error: Translation with MinT en>he failed: fetch failed [] []
[2024-03-07T03:52:03.075073+00:00] translationservices.WARNING: Translation service MinT problem: STATUS:  BODY: Error: Translation with MinT en>ko failed: fetch failed [] []
[2024-03-07T03:53:12.097603+00:00] translationservices.WARNING: Translation service MinT problem: STATUS:  BODY: Error: Translation with MinT en>ko failed: fetch failed [] []
[2024-03-07T04:06:21.667190+00:00] translationservices.WARNING: Translation service MinT problem: STATUS:  BODY: Error: Translation with MinT en>ta failed: fetch failed [] []
[2024-03-07T04:08:43.833181+00:00] translationservices.WARNING: Translation service MinT problem: STATUS:  BODY: Error: Translation with MinT en>ta failed: fetch failed [] []
[2024-03-07T04:11:57.559994+00:00] translationservices.WARNING: Translation service MinT problem: STATUS:  BODY: Error: Translation with MinT en>ko failed: fetch failed [] []
[2024-03-07T04:27:53.230962+00:00] translationservices.WARNING: Translation service MinT problem: STATUS:  BODY: Error: Translation with MinT en>ko failed: fetch failed [] []
[2024-03-07T04:44:21.643844+00:00] translationservices.WARNING: Translation service MinT problem: STATUS:  BODY: Error: Translation with MinT en>ko failed: fetch failed [] []
[2024-03-07T06:22:36.282600+00:00] translationservices.WARNING: Translation service MinT problem: STATUS:  BODY: Error: Translation with MinT en>he failed: fetch failed [] []
[2024-03-07T06:22:49.186796+00:00] translationservices.WARNING: Translation service MinT problem: STATUS:  BODY: Error: Translation with MinT en>he failed: fetch failed [] []
[2024-03-07T06:27:03.603966+00:00] translationservices.WARNING: Translation service MinT problem: STATUS:  BODY: Error: Translation with MinT en>mk failed: fetch failed [] []
[2024-03-07T06:27:04.207176+00:00] translationservices.WARNING: Translation service MinT problem: STATUS:  BODY: Error: Translation with MinT en>mk failed: fetch failed [] []
[2024-03-07T06:27:14.296639+00:00] translationservices.WARNING: Translation service MinT problem: STATUS:  BODY: Error: Translation with MinT en>mk failed: fetch failed [] []
[2024-03-07T06:27:46.641195+00:00] translationservices.WARNING: Translation service Apertium WMF problem: STATUS:  BODY: Error: Translation with Apertium bg > mk failed: fetch failed [] []
[2024-03-07T06:27:47.352794+00:00] translationservices.WARNING: Translation service Apertium WMF problem: STATUS:  BODY: Error: Translation with Apertium bg > mk failed: fetch failed [] []
[2024-03-07T06:49:07.060420+00:00] translationservices.WARNING: Translation service MinT problem: STATUS:  BODY: Error: Translation with MinT en>mk failed: fetch failed [] []
[2024-03-07T06:49:09.284777+00:00] translationservices.WARNING: Translation service MinT problem: STATUS:  BODY: Error: Translation with MinT en>mk failed: fetch failed [] []
[2024-03-07T06:50:37.219774+00:00] translationservices.WARNING: Translation service Apertium WMF problem: STATUS:  BODY: Error: Translation with Apertium nl > af failed: fetch failed [] []
[2024-03-07T06:50:37.779505+00:00] translationservices.WARNING: Translation service Apertium WMF problem: STATUS:  BODY: Error: Translation with Apertium nl > af failed: fetch failed [] []
[2024-03-07T06:51:06.499162+00:00] translationservices.WARNING: Translation service Apertium WMF problem: STATUS:  BODY: Error: Translation with Apertium nl > af failed: fetch failed [] []
[2024-03-07T06:51:06.570898+00:00] translationservices.WARNING: Translation service Apertium WMF problem: STATUS:  BODY: Error: Translation with Apertium nl > af failed: fetch failed [] []
[2024-03-07T07:07:10.883159+00:00] translationservices.WARNING: Translation service MinT problem: STATUS:  BODY: Error: Translation with MinT en>mk failed: fetch failed [] []
[2024-03-07T07:25:25.541368+00:00] translationservices.WARNING: Translation service Apertium WMF problem: STATUS:  BODY: Error: Translation with Apertium mk > en failed: fetch failed [] []
[2024-03-07T07:25:25.541838+00:00] translationservices.WARNING: Translation service MinT problem: STATUS:  BODY: Error: Translation with MinT he>en failed: fetch failed [] []
[2024-03-07T07:25:25.820191+00:00] translationservices.WARNING: Translation service Apertium WMF problem: STATUS:  BODY: Error: Translation with Apertium ca > en failed: fetch failed [] []
[2024-03-07T07:25:25.820793+00:00] translationservices.WARNING: Translation service MinT problem: STATUS:  BODY: Error: Translation with MinT ar>en failed: fetch failed [] []
[2024-03-07T07:25:54.237265+00:00] translationservices.WARNING: Translation service Apertium WMF problem: STATUS:  BODY: Error: Translation with Apertium es > en failed: fetch failed [] []
[2024-03-07T07:26:22.549430+00:00] translationservices.WARNING: Translation service Apertium WMF problem: STATUS:  BODY: Error: Translation with Apertium ca > en failed: fetch failed [] []
[2024-03-07T07:26:56.095340+00:00] translationservices.WARNING: Translation service Apertium WMF problem: STATUS:  BODY: Error: Translation with Apertium ca > en failed: fetch failed [] []
[2024-03-07T07:42:29.866902+00:00] translationservices.WARNING: Translation service MinT problem: STATUS:  BODY: Error: Translation with MinT en>pl failed: fetch failed [] []
[2024-03-07T07:42:30.380469+00:00] translationservices.WARNING: Translation service MinT problem: STATUS:  BODY: Error: Translation with MinT en>pl failed: fetch failed [] []
[2024-03-07T08:09:57.196297+00:00] translationservices.WARNING: Translation service MinT problem: STATUS:  BODY: Error: Translation with MinT en>el failed: fetch failed [] []
[2024-03-07T08:35:36.553918+00:00] translationservices.WARNING: Translation service Apertium WMF problem: STATUS:  BODY: Error: Translation with Apertium es > it failed: fetch failed [] []
[2024-03-07T08:35:36.554754+00:00] translationservices.WARNING: Translation service MinT problem: STATUS:  BODY: Error: Translation with MinT en>it failed: fetch failed [] []
[2024-03-07T08:35:39.150935+00:00] translationservices.WARNING: Translation service Apertium WMF problem: STATUS:  BODY: Error: Translation with Apertium es > it failed: fetch failed [] []
[2024-03-07T08:35:39.151515+00:00] translationservices.WARNING: Translation service MinT problem: STATUS:  BODY: Error: Translation with MinT en>it failed: fetch failed [] []
[2024-03-07T08:35:42.975871+00:00] translationservices.WARNING: Translation service Apertium WMF problem: STATUS:  BODY: Error: Translation with Apertium es > it failed: fetch failed [] []
[2024-03-07T08:35:46.795802+00:00] translationservices.WARNING: Translation service Apertium WMF problem: STATUS:  BODY: Error: Translation with Apertium es > it failed: fetch failed [] []
[2024-03-07T08:35:51.352747+00:00] translationservices.WARNING: Translation service Apertium WMF problem: STATUS:  BODY: Error: Translation with Apertium es > it failed: fetch failed [] []
[2024-03-07T08:51:05.251787+00:00] translationservices.WARNING: Translation service MinT problem: STATUS:  BODY: Error: Translation with MinT en>yo failed: fetch failed [] []
[2024-03-07T10:05:23.669533+00:00] translationservices.WARNING: Translation service MinT problem: STATUS:  BODY: Error: Translation with MinT en>fi failed: fetch failed [] []
[2024-03-07T10:05:27.934873+00:00] translationservices.WARNING: Translation service MinT problem: STATUS:  BODY: Error: Translation with MinT en>fi failed: fetch failed [] []
[2024-03-07T10:05:40.804388+00:00] translationservices.WARNING: Translation service MinT problem: STATUS:  BODY: Error: Translation with MinT en>fi failed: fetch failed [] []
[2024-03-07T10:06:23.779620+00:00] translationservices.WARNING: Translation service MinT problem: STATUS:  BODY: Error: Translation with MinT en>fi failed: fetch failed [] []
[2024-03-07T10:06:25.721183+00:00] translationservices.WARNING: Translation service MinT problem: STATUS:  BODY: Error: Translation with MinT en>fi failed: fetch failed [] []
[2024-03-07T10:06:26.034318+00:00] translationservices.WARNING: Translation service MinT problem: STATUS:  BODY: Error: Translation with MinT en>fi failed: fetch failed [] []
[2024-03-07T10:14:48.459526+00:00] translationservices.WARNING: Translation service Apertium WMF problem: STATUS:  BODY: Error: Translation with Apertium ur > hi failed: fetch failed [] []
[2024-03-07T10:14:48.627626+00:00] translationservices.WARNING: Translation service Apertium WMF problem: STATUS:  BODY: Error: Translation with Apertium ur > hi failed: fetch failed [] []
[2024-03-07T10:14:50.598125+00:00] translationservices.WARNING: Translation service Apertium WMF problem: STATUS:  BODY: Error: Translation with Apertium ur > hi failed: fetch failed [] []
[2024-03-07T10:14:50.684194+00:00] translationservices.WARNING: Translation service Apertium WMF problem: STATUS:  BODY: Error: Translation with Apertium ur > hi failed: fetch failed [] []
[2024-03-07T10:15:00.414320+00:00] translationservices.WARNING: Translation service Apertium WMF problem: STATUS:  BODY: Error: Translation with Apertium ur > hi failed: fetch failed [] []
[2024-03-07T10:15:00.488982+00:00] translationservices.WARNING: Translation service Apertium WMF problem: STATUS:  BODY: Error: Translation with Apertium ur > hi failed: fetch failed [] []
[2024-03-07T10:33:08.300842+00:00] translationservices.WARNING: Translation service MinT problem: STATUS:  BODY: Error: Translation with MinT en>fi failed: fetch failed [] []
[2024-03-07T10:33:09.031416+00:00] translationservices.WARNING: Translation service MinT problem: STATUS:  BODY: Error: Translation with MinT en>fi failed: fetch failed [] []
[2024-03-07T10:34:53.891060+00:00] translationservices.WARNING: Translation service Apertium WMF problem: STATUS:  BODY: Error: Translation with Apertium bg > mk failed: fetch failed [] []
[2024-03-07T10:34:54.935391+00:00] translationservices.WARNING: Translation service Apertium WMF problem: STATUS:  BODY: Error: Translation with Apertium bg > mk failed: fetch failed [] []
[2024-03-07T10:48:54.830686+00:00] translationservices.WARNING: Translation service MinT problem: STATUS:  BODY: Error: Translation with MinT en>fi failed: fetch failed [] []
[2024-03-07T10:48:55.116897+00:00] translationservices.WARNING: Translation service MinT problem: STATUS:  BODY: Error: Translation with MinT en>fi failed: fetch failed [] []
[2024-03-07T11:04:21.003841+00:00] translationservices.WARNING: Translation service MinT problem: STATUS:  BODY: Error: Translation with MinT en>ko failed: fetch failed [] []
[2024-03-07T11:04:21.481876+00:00] translationservices.WARNING: Translation service MinT problem: STATUS:  BODY: Error: Translation with MinT en>ko failed: fetch failed [] []
[2024-03-07T11:19:49.097450+00:00] translationservices.WARNING: Translation service MinT problem: STATUS:  BODY: Error: Translation with MinT en>nl failed: fetch failed [] []
[2024-03-07T11:19:49.156104+00:00] translationservices.WARNING: Translation service MinT problem: STATUS:  BODY: Error: Translation with MinT en>nl failed: fetch failed [] []
[2024-03-07T11:37:20.312884+00:00] translationservices.WARNING: Translation service MinT problem: STATUS:  BODY: Error: Translation with MinT en>fi failed: fetch failed [] []
[2024-03-07T11:58:38.400877+00:00] translationservices.WARNING: Translation service MinT problem: STATUS:  BODY: Error: Translation with MinT en>he failed: fetch failed [] []

Both MinT and Apertium does not use proxy. They were working and then we added MT clients with proxy support . Then clients without proxy started showing this issue- This is not consistently reproducible, but happens very frequent.

The way proxy support is added to cxserver was through undici libs setGlobalDispatcher( options.proxyAgent ); This affects all fetch requests. Not nice.

There probably is a way to use undici without setGlobalDispatcher but only use it for specific requests.

Change 1009634 had a related patch set uploaded (by Santhosh; author: Santhosh):

[mediawiki/services/cxserver@master] Apertium & MinT: Reset proxy settings for fetch

https://gerrit.wikimedia.org/r/1009634

Change 1009634 merged by jenkins-bot:

[mediawiki/services/cxserver@master] Apertium & MinT: Reset proxy settings for fetch

https://gerrit.wikimedia.org/r/1009634

Change 1009712 had a related patch set uploaded (by KartikMistry; author: KartikMistry):

[operations/deployment-charts@master] Update cxserver to 2024-03-08-084626-production

https://gerrit.wikimedia.org/r/1009712

Change 1009712 merged by jenkins-bot:

[operations/deployment-charts@master] Update cxserver to 2024-03-08-084626-production

https://gerrit.wikimedia.org/r/1009712

Mentioned in SAL (#wikimedia-operations) [2024-03-08T09:10:47Z] <kart_> Updated cxserver to 2024-03-08-084626-production (T359525)

Immediate issue is fixed, leaving open for retro/linking follow-ups.

Change 1010449 had a related patch set uploaded (by Santhosh; author: Santhosh):

[mediawiki/services/cxserver@master] Set the proxy to dispatcher option of fetch API

https://gerrit.wikimedia.org/r/1010449

Change 1010449 merged by jenkins-bot:

[mediawiki/services/cxserver@master] Set the proxy to dispatcher option of fetch API

https://gerrit.wikimedia.org/r/1010449

Change 1010508 had a related patch set uploaded (by KartikMistry; author: KartikMistry):

[operations/deployment-charts@master] Update cxserver to 2024-03-12-113634-production

https://gerrit.wikimedia.org/r/1010508

Change 1010508 merged by jenkins-bot:

[operations/deployment-charts@master] Update cxserver to 2024-03-12-113634-production

https://gerrit.wikimedia.org/r/1010508

Mentioned in SAL (#wikimedia-operations) [2024-03-13T04:50:27Z] <kart_> Updated cxserver to 2024-03-12-113634-production (T350773, T359525)

No observed error since the deployment.