Page MenuHomePhabricator

[BUG] Kazakh Wikipedia Character mapping
Closed, ResolvedPublicBUG REPORT

Description

From Znuny:
https://ticket.wikimedia.org/otrs/index.pl?Action=AgentTicketZoom;TicketID=12147405

On the Wikipedia iOS app, the character mapping between Kazakh scripts does not work. Attempting to switch from Cyrillic Kazakh to Arabic or Latin Kazakh does not change the script. I can get it to work just fine in the browser. Version: WikipediaApp/6.8.2.1868 (iOS 15.4; Phone)

Event Timeline

Restricted Application changed the subtype of this task from "Task" to "Bug Report". · View Herald TranscriptApr 4 2022, 3:59 PM
Restricted Application added a subscriber: Aklapper. · View Herald Transcript
LGoto triaged this task as Medium priority.Apr 4 2022, 6:33 PM
LGoto moved this task from Needs Triage to Bug Backlog on the Wikipedia-iOS-App-Backlog board.
JMinor subscribed.

We do use language converter in a standard way across all languages with multiple character options. I'm not sure why Kazakh would have regressed specifically as no changes were made on our end. Will need to investigate if there is a config or upstream issue.

It looks like the mobile-html endpoint ignores our Accept-Language header - I see Cyrillic characters even if we pass in `kk-latn' in the request:

curl 'https://kk.wikipedia.org/api/rest_v1/page/mobile-html/%D0%9C%D1%8B%D1%81%D1%8B%D2%9B' \
-H 'Host: kk.wikipedia.org' \
-H 'Accept: text/html; charset=utf-8' \
-H 'Accept-Language: kk-latn' \
curl 'https://kk.wikipedia.org/api/rest_v1/page/mobile-html/%D0%9C%D1%8B%D1%81%D1%8B%D2%9B' \
-H 'Host: kk.wikipedia.org' \
-H 'Accept: text/html; charset=utf-8' \
-H 'Accept-Language: kk-cyrl' \

Compare this to Serbian which changes characters:

curl 'https://sr.wikipedia.org/api/rest_v1/page/mobile-html/%D0%9C%D0%B0%D1%87%D0%BA%D0%B0' \
-H 'Host: sr.wikipedia.org' \
-H 'Accept: text/html; charset=utf-8' \
-H 'Accept-Language: sr-ec' \
curl 'https://sr.wikipedia.org/api/rest_v1/page/mobile-html/%D0%9C%D0%B0%D1%87%D0%BA%D0%B0' \
-H 'Host: sr.wikipedia.org' \
-H 'Accept: text/html; charset=utf-8' \
-H 'Accept-Language: sr-el' \

Tagging Content-Transform-Team for more investigation.

This is a language pair which Parsoid's language converter doesn't support. We either need to implement that in Parsoid (T43716) or use the same workaround in the mobile app which we use for zhwiki (T236733).

Moved into the Product-Infrastructure-Backlog project; this will be reviewed in the next two weeks.

LGoto subscribed.

Note that this also affects Android as well as iOS.

Change 824159 had a related patch set uploaded (by Jgiannelos; author: Jgiannelos):

[mediawiki/services/mobileapps@master] Use MW mobile view instead of parsoid for kkwiki

https://gerrit.wikimedia.org/r/824159

Change 824159 merged by jenkins-bot:

[mediawiki/services/mobileapps@master] Use MW mobile view instead of parsoid for kkwiki

https://gerrit.wikimedia.org/r/824159

ABorbaWMF subscribed.

This issue is still reproducible for me. It seems once you view an article in Kazakh (Cyrillic) the other versions of the article in Kazakh (Latin and Arabic) change to (Cyrillic). I am testing on the latest testflight 6.9.3 (1980)

Jgiannelos claimed this task.