Recognize apc language code in MediaWiki
Closed, ResolvedPublicFeature
Actions

Description

Feature summary (what you would like to be able to do and where):

Support the apc language code.

Use case(s) (list the steps that you performed to discover that problem, and describe the actual underlying problem which you want to solve. Do not describe only a solution):

I want to be able to use language=apc (for instance) in citation templates on the English Wikipedia.

However, there is a limited number of supported languages for citation on Wikipedia: https://en.wikipedia.org/wiki/Template:Citation_Style_documentation/language/doc

In particular, Levantine Arabic is not recognized whereas other Arabic varieties such as arz (Egyptian), arq (Algerian), aeb (Tunisian), shu (Chadian), and ary (Moroccan) are: https://en.wikipedia.org/wiki/Help_talk:Citation_Style_1#Add_languages

Benefits (why should this be implemented?):

Support one of the most spoken and most widely understood Arabic varieties in the Arab world.

According to T187344: Add language codes for Arabic languages for use in labels, aliases and descriptions to Wikidata; "If one or the other language code is needed (for labels/descriptions/aliases) or just monolingual string or lexemes, it might be worth creating a separate request.", here it is!

Adding languages: https://www.mediawiki.org/wiki/Manual:Adding_and_removing_languages

Add to translatewiki
Add to cldr extension if possible or the cldr overrides
Add to language-data if not possible to add to cldr extension
Add to includes/languages/data/Names.php (patch)
Set fallback, etc. (discussion, jquery.i18n patch, core patch)
Add to rtl languages of MF (patch)
Add to release notes (patch)
Remove from translatewiki after deploying the core change (patch)
Fix ULS language search (patch)

(Comment: The initial version of this task included the ajp code, but that code was deprecated in ISO 639 since then.)

Details

Subject	Repo	Branch	Lines +/-
Remove local definitions for languages fon and apc	mediawiki/extensions/WikibaseLexeme	master	+0 -6
Remove apc, which was added to Names.php	translatewiki	master	+1 -2
Add apc autonym to MediaWiki	mediawiki/core	master	+170 -0

Customize query in gerrit

Related Objects
Search...

		Status	Subtype	Assigned	Task
		Open	Feature	None	T345870 Levantine Arabic unsupported in Commons' captions
		Resolved	Feature	Amire80	T290657 Recognize apc language code in MediaWiki

Event Timeline

A455bcd9 created this task.Sep 9 2021, 12:17 PM

Restricted Application added a subscriber: Aklapper. · View Herald TranscriptSep 9 2021, 12:17 PM

A455bcd9 updated the task description. (Show Details)Sep 9 2021, 12:18 PM

A455bcd9 updated the task description. (Show Details)

Reedy added projects: MediaWiki-Internationalization, I18n.Sep 9 2021, 12:38 PM

Bugreporter added a project: Language codes.Sep 10 2021, 2:00 AM

If the use is for an English Wikipedia template, shouldn't additions be required there?

No samples for uses at Wikidata have been provided.

According to people here the only way to solve this issue is to add it to MediaWiki and it cannot be done on the English Wikipedia.

An example of use on Wikidata, we cannot use the "native label" using the apc code on the Levantine Arabic item: https://www.wikidata.org/wiki/Q56593

It seems the request is unrelated to Wikidata. Maybe you want to edit the description to make this clear.

Merely adding "native label" on the language item itself isn't considered sufficient to create the code for Wikidata (see https://www.wikidata.org/wiki/Help:Monolingual_text_languages#Requirements_for_a_new_language_code ).

Esc3300 moved this task from Backlog to MediaWiki core on the Language codes board.Sep 20 2021, 7:50 AM

OK, I thought the underlying issue for the lack of support for ajp in the citation template and on Wikidata was the same.

If it's not, then it means I need to create a new ticket for Wikidata?

In any case, this issue (the lack of support of ajp in citation templates) still stands.

Depending on how it's solved for the template, it might do it for Wikidata as well.

There is a simplified way to define it for monolingual text in Wikidata, but this generally requires to provide samples for how it's to be used.

OK, I see, thanks.

So regarding samples for how it's to be used:

There's an ongoing project (which was slowed down by font & directionality issues...) to create an ajp Wikipedia: https://incubator.wikimedia.org/wiki/Wp/ajp/Main_Page So these pages will need ajp entries on Wikidata if the ajp Wikipedia is one day approved
Languages such as French ( https://www.wikidata.org/wiki/Q150 ) have properties such as "has tense" and "has grammatical person" with grammatical examples. I'd like to add similar fields on the "Levantine Arabic" entry (and subdialects such as Damascene Arabic, Aleppo Arabic, etc.), based on the references cited on Wikipedia ( https://en.wikipedia.org/wiki/Levantine_Arabic#Grammar ).
The number of South Levantine Arabic (ajp) lemmas on the English Wiktionary ( https://en.wiktionary.org/wiki/Category:South_Levantine_Arabic_lemmas ) is growing, and in particular terms with audio links have been recently added ( https://en.wiktionary.org/wiki/Category:South_Levantine_Arabic_terms_with_audio_links ), these audio files could be added to Wikidata ("pronunciation audio" property), especially for the local pronunciation in Levantine Arabic of city names such as Jerusalem ( https://www.wikidata.org/wiki/Q1218 ) which differs from the Standard Arabic pronunciation, which is the only one currently provided.

Please let me know if this is enough. There may also be other use cases I don't have in mind right now.

Actually it seems that audio entries can be added for South Levantine Arabic (or any other dialect, for instance "Palestinian Arabic") even though ajp and apc codes are not recognized.

ajp has been deprecated since the task was created and merged into apc.

apc is supported on translatewiki. If anyone translates enough of it, it will be fully supported in MediaWiki.

If you want support in Wikidata or Lexemes before that, it's probably covered by task T332264, and this task can probably be merged into that one.

In T290657#8715282, @Amire80 wrote:

ajp has been deprecated since the task was created and merged into apc.

apc is supported on translatewiki. If anyone translates enough of it, it will be fully supported in MediaWiki.

If you want support in Wikidata or Lexemes before that, it's probably covered by task T332264, and this task can probably be merged into that one.

This task has nothing to do with Wikidata. The description says they want it to work in a template on the English Wikipedia. It looks like the template/module is fetching language names from MediaWiki, which fails because MediaWiki doesn't have names for most languages. I'm not sure why it's doing that instead of using something more suited to the task like https://en.wikipedia.org/wiki/Module:ISO_639_name, but if we want MediaWiki to know the English name, it would have to be added to LocalNamesEn.php in the CLDR extension (even if someone translates enough of it for it to be added as an interface language).

Winston_Sung moved this task from Untriaged to Language names and codes on the I18n board.Aug 9 2023, 3:37 PM

TheDJ updated the task description. (Show Details)Sep 8 2023, 11:56 AM

TheDJ mentioned this in T345870: Levantine Arabic unsupported in Commons' captions.

Change 955921 had a related patch set uploaded (by TheDJ; author: TheDJ):

[mediawiki/core@master] Add apc autonym to MediaWiki

https://gerrit.wikimedia.org/r/955921

gerritbot added a project: Patch-For-Review.Sep 8 2023, 12:15 PM

Made this patch because of T345870, but might require additional changes to cldr extension and friends ?

Raymond subscribed.Sep 10 2023, 12:01 PM

Change 955921 abandoned by TheDJ:

[mediawiki/core@master] Add apc autonym to MediaWiki

Reason:

https://gerrit.wikimedia.org/r/955921

Maintenance_bot removed a project: Patch-For-Review.Sep 29 2023, 9:10 PM

In T290657#9152132, @TheDJ wrote:

Made this patch because of T345870, but might require additional changes to cldr extension and friends ?

Hi,
I don't understand, the latest CLDR release includes apc: https://cldr.unicode.org/index/downloads/cldr-43

What else needs to be done?

In T290657#9219219, @A455bcd9 wrote:

What else needs to be done?

I guess Debian needs to ship an updated package which the Wikimedia servers which run Debian would use: https://tracker.debian.org/pkg/unicode-cldr-core

In T290657#9219270, @Aklapper wrote:

In T290657#9219219, @A455bcd9 wrote:

What else needs to be done?

I guess Debian needs to ship an updated package which the Wikimedia servers which run Debian would use: https://tracker.debian.org/pkg/unicode-cldr-core

Thanks. I asked them when it'll be packaged.

Nardog subscribed.Oct 18 2023, 7:44 PM

In T290657#9219270, @Aklapper wrote:

I guess Debian needs to ship an updated package which the Wikimedia servers which run Debian would use: https://tracker.debian.org/pkg/unicode-cldr-core

That's not relevant for English names. English names for languages come from the CLDR extension. The data in the extension is independent of the operating system, it's updated by downloading the version of CLDR you want to use and running rebuild.php.

In T290657#9219219, @A455bcd9 wrote:

I don't understand, the latest CLDR release includes apc: https://cldr.unicode.org/index/downloads/cldr-43

What else needs to be done?

CLDR does not have an English name for apc though - https://github.com/unicode-org/cldr/blob/main/common/main/en.xml

Once they've added one, it will be included in the next release, and after the next release, the MediaWiki CLDR extension will need updating to the latest CLDR release. Until that happens, it could be temporarily added to LocalNamesEn.php in the CLDR extension.

In T290657#9316141, @Nikki wrote:

CLDR does not have an English name for apc though - https://github.com/unicode-org/cldr/blob/main/common/main/en.xml

Thanks, just submitted a PR... https://github.com/unicode-org/cldr/pull/3387

Reedy added a project: Language-Technical Support.Jan 3 2024, 5:23 PM

Reedy added a parent task: T345870: Levantine Arabic unsupported in Commons' captions.

Reedy updated the task description. (Show Details)Jan 3 2024, 5:25 PM

MaryMunyoki moved this task from Backlog to Adding languages on the Language-Technical Support board.Jan 17 2024, 5:59 PM

Amire80 edited projects, added Language-Technical Support (Language-Technical Support (Current)); removed Language-Technical Support.Feb 15 2024, 4:01 PM

Amire80 moved this task from Incoming Requests to Potential Next on the Language-Technical Support (Language-Technical Support (Current)) board.

Amire80 updated the task description. (Show Details)Feb 29 2024, 1:32 AM

Most of the remaining points can be completed after the localization of core MediaWiki gets to 13%. Currently, it's at 11%, so you are very close.

The first thing I recommend is fixing the translations with wikitext issues: https://translatewiki.net/w/i.php?title=Special:Translate&group=core-0-mostused&language=apc&filter=fuzzy&optional=1&action=page

(Most of those have incorrect usage of {{PLURAL}}. Whoever does the translations, should make sure to use all the correct singular and plural forms. It looks like now all of them only use the plural forms and omit the singular, and they don't use the {{PLURAL}} keyword at all. The instructions for using {{PLURAL}} in Standard Arabic are at https://translatewiki.net/wiki/Localisation_guidelines/ar , and they can probably be reused for this language, too.)

After all those are fixed, complete the "Most important messages".

jquery.ime is probably unnecessary, but if you need any characters that don't appear in Standard Arabic keyboards, please let me know.

Amire80 edited projects, added Language-Technical Support; removed Language-Technical Support (Language-Technical Support (Current)).Feb 29 2024, 1:42 AM

Amire80 renamed this task from Recognize ajp and apc language codes in MediaWiki to Recognize apc language codes in MediaWiki.Apr 29 2024, 11:29 AM

Amire80 renamed this task from Recognize apc language codes in MediaWiki to Recognize apc language code in MediaWiki.

Amire80 updated the task description. (Show Details)

Nardog updated the task description. (Show Details)Apr 29 2024, 11:32 AM

First export for apc from translatewiki now with https://gerrit.wikimedia.org/r/c/mediawiki/core/+/1025602

I think https://gerrit.wikimedia.org/r/955921 could be restored, couldn't it?

In T290657#9756467, @Raymond wrote:

First export for apc from translatewiki now with https://gerrit.wikimedia.org/r/c/mediawiki/core/+/1025602

I think https://gerrit.wikimedia.org/r/955921 could be restored, couldn't it?

True, thanks for the reminder.

Change #955921 restored by Amire80:

[mediawiki/core@master] Add apc autonym to MediaWiki

https://gerrit.wikimedia.org/r/955921

gerritbot added a project: Patch-For-Review.Apr 30 2024, 8:31 AM

Amire80 updated the task description. (Show Details)Apr 30 2024, 8:32 AM

Amire80 updated the task description. (Show Details)Apr 30 2024, 10:17 AM

Change #1025712 had a related patch set uploaded (by Amire80; author: Amire80):

[mediawiki/extensions/WikibaseLexeme@master] Remove local definitions for languages fon and apc

https://gerrit.wikimedia.org/r/1025712

Amire80 updated the task description. (Show Details)Apr 30 2024, 10:33 AM

Amire80 updated the task description. (Show Details)