Implement language variant support in the REST API
Closed, ResolvedPublic
Actions

Assigned To

Authored By

	• GWicke
	Mar 8 2017, 8:34 PM

Description

Following the resolution of T122942: RFC: Support language variants in the REST API, this task is about tracking the implementation of language variant support in the REST API.

Implementation will start once T43716 on the Parsoid side is resolved.

Details

	Subject	Repo	Branch	Lines +/-
	Create skeleton of language variant support in Parsoid API	mediawiki/services/parsoid	master	+44 -0

Customize query in gerrit

Related Objects
Search...

Status	Subtype	Assigned	Task
Stalled		None	T324931 Clean up open RESTBase related tickets
In Progress		None	T262315 <CORE TECHNOLOGY> API Migration & RESTBase Sunset
Resolved		DAlangi_WMF	T324678 Migrate proton (chromium-render) away from restbase
Open		None	T167603 Any Chinese Wiki's projects about "Download as PDF" can not auto change to Simplified Chinese or Traditional Chinese
Resolved		ovasileva	T147553 [EPIC] Page previews broken on many projects
Open		ovasileva	T244262 [Epic] Enable page previews and reference previews as a beta feature on all projects
Open		None	T111231 Page previews for Wikidata
Invalid		None	T148854 Use RESTBase for zhwiki
Resolved		• Pchelolo	T188164 Popups don‘t support language variant conversion and {{lang}} template
Resolved		• mobrovac	T190689 FY17/18 Q4 Program 7 Services Goal: Language variants support
Resolved		• Pchelolo	T159985 Implement language variant support in the REST API
Open		None	T43716 [EPIC] Support language variant conversion in Parsoid
Open		None	T21044 Document LanguageConverter
Resolved		cscott	T53587 Parsoid needs to run findVariantLink or some equivalent thing
Invalid		• GWicke	T48658 Tpl-style encapsulation for <include> and lang-variant conversions
Resolved		liangent	T45547 MediaWiki needs a fictitious variant for English for easier variant development work
Resolved		thiemowmde	T156280 Wikibase assumes English doesn't have a variant
Open		None	T54661 Preprocessor/Parser irregularities with -{...}- variant constructs.
Resolved		cscott	T146304 Preprocessor should handle -{...}- variant constructs in template arguments
Resolved		cscott	T153761 Incorrect parser output if -{{ appears in wikitext
Resolved		• Elitre	T165175 Support communications around the preprocessor fixups
Resolved		cscott	T146305 Parser should protect -{...}- variant constructs in links
Resolved		cscott	T54192 Markups in alt param of <gallery> are "eaten" during parsing
Resolved		cscott	T54190 <gallery> with \|link=<external link> doesn't work on wikis with LanguageConverter
Resolved		cscott	T153135 doBlockLevels breaks with embedded language converter markup
Resolved		cscott	T153140 -{ ... }- markup breaks tables
Open		None	T153265 Language converter source text and language names cannot use <nowiki> escaping.
Duplicate	BUG REPORT	None	T353501 new Parsoid cannot parse the converter wikitext syntax
Resolved		cscott	T153341 Export LanguageConverter enabled status in page info from core
Open		None	T204966 Production use of LanguageConverter for read views of Phase 2A languages
Open		None	T204968 Production use of LanguageConverter for read views of Phase 2B languages
Open		None	T204969 Production use of LanguageConverter for read views of Phase 2C languages
Open		None	T222328 [extlink] parsing - link cannot contain language variant or extension tags
Resolved	BUG REPORT	Jgiannelos	T305383 [BUG] Kazakh Wikipedia Character mapping
Open		None	T320733 Support and document how language conversion work with multidirectional wikitext <=> HTML conversion on language-conversion-supported extensions.
Resolved		• mobrovac	T195327 Normalise the Accept-Language header for REST API requests

Event Timeline

• GWicke created this task.Mar 8 2017, 8:34 PM

• GWicke mentioned this in T122942: RFC: Support language variants in the REST API.

• GWicke added a parent task: T43716: [EPIC] Support language variant conversion in Parsoid.

Bianjiang subscribed.Mar 8 2017, 10:59 PM

• Nikerabbit subscribed.Mar 9 2017, 1:40 PM

Dbrant moved this task from Needs Triage to Tracking on the Wikipedia-Android-App-Backlog board.Mar 10 2017, 1:39 PM

• Fjalapeno added a project: Reading Epics (Platform JS CSS and HTML consolidation).Jun 7 2017, 2:25 PM

• GWicke added a project: Parsing-Team--ARCHIVED.Jul 18 2017, 8:15 PM

Shizhao added a project: MediaWiki-Language-converter.Jul 19 2017, 1:56 AM

Shizhao moved this task from Backlog to Extensions/Skins on the Chinese-Sites board.

phuedx mentioned this in T111231: Page previews for Wikidata.Jul 19 2017, 12:01 PM

phuedx added a parent task: T111231: Page previews for Wikidata.

• Mholloway mentioned this in T173842: [BUG] Wikidata description for the specific Chinese language variant should be shown.Oct 4 2017, 7:36 PM

• Mholloway added a subtask: T173842: [BUG] Wikidata description for the specific Chinese language variant should be shown.Oct 4 2017, 7:49 PM

• Mholloway mentioned this in T177619: Return variant URLs and titles in the metadata response.Oct 6 2017, 6:34 PM

Tgr mentioned this in T167603: Any Chinese Wiki's projects about "Download as PDF" can not auto change to Simplified Chinese or Traditional Chinese .Nov 20 2017, 1:15 AM

Change 396538 had a related patch set uploaded (by C. Scott Ananian; owner: C. Scott Ananian):
[mediawiki/services/parsoid@master] Create skeleton of language variant support in Parsoid API

https://gerrit.wikimedia.org/r/396538

gerritbot added a project: Patch-For-Review.Dec 8 2017, 10:28 PM

Change 396538 merged by jenkins-bot:
[mediawiki/services/parsoid@master] Create skeleton of language variant support in Parsoid API

https://gerrit.wikimedia.org/r/396538

Dbrant awarded a token.Jan 3 2018, 8:44 PM

cooltey awarded a token.Jan 4 2018, 1:45 AM

Mentioned in SAL (#wikimedia-operations) [2018-01-08T21:30:49Z] <arlolra> Updated Parsoid to e133312 (T182349, T183893, T159985)

• Pchelolo mentioned this in T185139: Popups should respect user's language variant preferences.Jan 30 2018, 5:39 PM

Jdlrobson added a parent task: T167603: Any Chinese Wiki's projects about "Download as PDF" can not auto change to Simplified Chinese or Traditional Chinese .Jan 31 2018, 5:44 PM

Jdlrobson added a parent task: T185139: Popups should respect user's language variant preferences.

ovasileva added a project: Web-Team-Backlog (Tracking).Feb 1 2018, 4:24 PM

Jdlrobson moved this task from Untriaged to Untag on the Web-Team-Backlog (Tracking) board.Feb 7 2018, 5:50 PM

• Mholloway mentioned this in T186627: Remove the MobileView API.Feb 7 2018, 6:14 PM

All the skeleton code for this has been completed in Parsoid: we honor the Accept-Language header and dispatch to an appropriate language variant converter.

Those converters don't do anything yet (still working on that!) but there shouldn't be anything blocking the RESTBase portion of this task -- which is just to pass along the Accept-Language header from the REST request, and probably to cache the results in a different place/way.

• bearND mentioned this in T188164: Popups don‘t support language variant conversion and {{lang}} template.Feb 26 2018, 4:46 PM

lisong subscribed.Mar 17 2018, 8:40 AM

Liuxinyu970226 awarded a token.Mar 23 2018, 1:29 PM

Dbrant mentioned this in T194161: Explore card content showing Traditional Chinese when Simplified Chinese is selected.May 8 2018, 2:21 PM

• mobrovac edited parent tasks, added: T190689: FY17/18 Q4 Program 7 Services Goal: Language variants support; removed: T185139: Popups should respect user's language variant preferences, T167603: Any Chinese Wiki's projects about "Download as PDF" can not auto change to Simplified Chinese or Traditional Chinese , T111231: Page previews for Wikidata, T43716: [EPIC] Support language variant conversion in Parsoid, T148854: Use RESTBase for zhwiki.May 22 2018, 7:32 PM

• mobrovac added a subtask: T43716: [EPIC] Support language variant conversion in Parsoid.

• mobrovac added a subtask: T195327: Normalise the Accept-Language header for REST API requests.May 22 2018, 7:41 PM

• mobrovac closed subtask T195327: Normalise the Accept-Language header for REST API requests as Resolved.Jun 7 2018, 11:28 AM

Jdforrester-WMF subscribed.Jun 7 2018, 6:24 PM

RHo mentioned this in T197580: Automatically set Serbian Cyrillic/Latin variant based on the user's selected keyboard.Jun 18 2018, 10:05 AM

• Vvjjkkii reopened subtask T195327: Normalise the Accept-Language header for REST API requests as Open.Jul 1 2018, 1:08 AM

• mobrovac closed subtask T195327: Normalise the Accept-Language header for REST API requests as Resolved.Jul 1 2018, 10:12 AM

• Jhernandez mentioned this in T199096: Add support for wikidata summaries in the /page/summary/ endpoint.Jul 9 2018, 11:11 AM

RESTBase API now supports language variants, but the actual converters are enabled only on a subset of wikis. However, nothing else needs to be done on the API side.

Shizhao moved this task from Extensions/Skins to Closed on the Chinese-Sites board.Jul 31 2018, 2:46 AM

Liuxinyu970226 unsubscribed.Jul 31 2018, 11:46 PM

Liuxinyu970226 rescinded a token.Oct 8 2018, 2:27 AM

Liuxinyu970226 awarded a token.

JoeWalsh removed a subtask: T173842: [BUG] Wikidata description for the specific Chinese language variant should be shown.Jul 31 2019, 8:19 PM

Maintenance_bot removed a project: Patch-For-Review.Jul 31 2019, 9:10 PM

VulpesVulpes825 subscribed.Jul 18 2020, 3:01 PM

• Nikerabbit mentioned this in T278272: Rest API endpoints do not respect Accept-Language header for some Wikis.Aug 24 2021, 10:54 AM

Stang unsubscribed.Nov 14 2021, 12:15 AM

Winston_Sung moved this task from Backlog to Apps/Tools/Services on the MediaWiki-Language-converter board.Dec 27 2023, 5:44 PM