Page MenuHomePhabricator

Debug Yandex translation service failures
Open, LowPublic

Description

Need more debugging information to see what is the cause of the recent failures at translatewiki.net.


Version: master
Severity: normal
See Also:
https://bugzilla.wikimedia.org/show_bug.cgi?id=41435
https://bugzilla.wikimedia.org/show_bug.cgi?id=55633

Details

Reference
bz50861

Event Timeline

bzimport raised the priority of this task from to High.Nov 22 2014, 1:51 AM
bzimport set Reference to bz50861.

Have you ever managed to look into the debugging output you added for Microsoft? Is that the kind of info you'd need here too? The problem for TWN started in July and seems basically continuous since then.

$ grep -E "Yandex.+suspended" irclogs/FreeNode/#mediawiki-i18n.log | grep -oE "^[0-9-]{10}" | uniq -c

 2 2013-06-03
 5 2013-07-01
19 2013-07-02
 6 2013-07-03
21 2013-07-04
18 2013-07-05
32 2013-07-06
21 2013-07-07
19 2013-07-08
14 2013-07-09
19 2013-07-10
19 2013-07-11
22 2013-07-12
 9 2013-07-13
11 2013-07-14
25 2013-07-15
 9 2013-07-16
21 2013-07-17
26 2013-07-18
21 2013-07-19
10 2013-07-20

$ grep -E "Yandex.+restored" irclogs/FreeNode/#mediawiki-i18n.log | grep -oE "^[0-9-]{10}" | uniq -c

1 2013-07-02
1 2013-07-06
2 2013-07-07
2 2013-07-08
1 2013-07-09
1 2013-07-12
1 2013-07-16
1 2013-07-19
1 2013-07-20

I guess this is the culprit, or related, given the dates: «On July 1, 2013 the API version 1.0 was deprecated. Starting from version 1.5, all API methods must be accessed using a key. To get your free API key, you need to fill out a simple form.»
http://api.yandex.com/translate/

Terms didn't seem to change since April: http://legal.yandex.com/translate_api/

Lockal, do you know what needs doing here on the side of the code you added, if anything?

Change 74853 had a related patch set uploaded by Lockal:
(Bug 50861) Debug Yandex translation service failures

https://gerrit.wikimedia.org/r/74853

lockalsash wrote:

See the patch above for the fix.

I'm not very happy about changes in Yandex API, but at least API keys from https://translate.yandex.com/apikeys are still free and there is no "paid quotas" like in Google. Yandex 1.5 API also only works via HTTPS, which is known to be slower than HTTP, but I can't do anything with it.

Change 74853 had a related patch set uploaded by Nikerabbit:
(Bug 50861) Debug Yandex translation service failures

https://gerrit.wikimedia.org/r/74853

Change 74853 merged by jenkins-bot:
(Bug 50861) Support for Yandex Translate API v1.5

https://gerrit.wikimedia.org/r/74853

(In reply to comment #7)

It works!

Now it quite does not. Niklas says it's due to "lots of timeouts and dns failures", hopefully temporary.

Well, it never went away in these months, reopening.

$ grep -E "Yandex.+suspended" irclogs/FreeNode/#mediawiki-i18n.log | grep -oE "^[0-9-]{7}" | uniq -c

  2 2013-06
587 2013-07
251 2013-08
304 2013-09
554 2013-10
571 2013-11
515 2013-12
287 2014-01

$ grep -E "Yandex.+restored" irclogs/FreeNode/#mediawiki-i18n.log | grep -oE "^[0-9-]{7}" | uniq -c

29 2013-07
22 2013-08
24 2013-09
43 2013-10
38 2013-11
57 2013-12
23 2014-01
Nikerabbit lowered the priority of this task from High to Low.Jan 29 2015, 6:08 PM
Nikerabbit set Security to None.