Page MenuHomePhabricator
Create Task
Maniphest T389281

Librarize language-specific text transformations
Open, In Progress, Needs TriagePublic
Actions

Description

Description

The goal of this task is to librarize language-specific text transformation—such as pluralization, grammatical adjustments, gender-based selection, and bidirectional formatting—into dedicated handlers within the Leximorph library.

Next Steps:

  • Create a patch for the core library under the includes/libs/Leximorph
  • Create a feature flag configuration
  • Create LeximorphFactory for Manager and Provider
  • Integrate UseLeximorph flag into CoreParserFunctions.php
  • Integrate UseLeximorph flag into Language.php
  • Integrate UseLeximorph flag into LocalisationCache.php
  • Update relevant extensions using text transformations
  • Enable and run feature-flagged tests on translatewiki.net (T402009)
  • Announce on wikitech-l and in Tech News
  • Create separate Leximorph library (T390289)

Details

Related Changes in Gerrit:
Show related patches Customize query in gerrit

Related Objects
Search...

Event Timeline

Dogu created this task.Mar 18 2025, 11:09 PM
Restricted Application added a subscriber: Aklapper. · View Herald TranscriptMar 18 2025, 11:09 PM
gerritbot added a comment.Mar 18 2025, 11:10 PM

Change #1128045 had a related patch set uploaded (by Abaris; author: Abaris):

[mediawiki/core@master] Modularize language-specific text transformations

https://gerrit.wikimedia.org/r/1128045

gerritbot added a project: Patch-For-Review.Mar 18 2025, 11:10 PM
Aklapper added a project: MediaWiki-Internationalization.Mar 18 2025, 11:12 PM
Dogu changed the task status from Open to In Progress.Mar 18 2025, 11:15 PM
Dogu claimed this task.
Dogu mentioned this in T387862: Create a stand-alone library for preprocessing command tokens.
Tacsipacsi subscribed.Mar 19 2025, 12:27 AM
Dogu renamed this task from Modularize language-specific text transformations to Librarize language-specific text transformations.Mar 24 2025, 10:46 PM
Dogu updated the task description. (Show Details)
Dogu updated the task description. (Show Details)Mar 25 2025, 9:02 PM
jhsoby subscribed.Mar 26 2025, 11:23 AM
Dogu mentioned this in T390289: [Stub] Create separate Leximorph library.Mar 28 2025, 12:20 PM
Dogu updated the task description. (Show Details)
gerritbot added a comment.Mar 30 2025, 11:01 PM

Change #1132203 had a related patch set uploaded (by Abaris; author: Abaris):

[mediawiki/core@master] Librarize language-specific text transformations

https://gerrit.wikimedia.org/r/1132203

Dogu updated the task description. (Show Details)Mar 30 2025, 11:16 PM
gerritbot added a comment.Apr 1 2025, 10:06 PM

Change #1132203 abandoned by Abaris:

[mediawiki/core@master] Librarize language-specific text transformations

https://gerrit.wikimedia.org/r/1132203

gerritbot added a comment.Apr 1 2025, 10:09 PM

Change #1128045 had a related patch set uploaded (by Abaris; author: Abaris):

[mediawiki/core@master] Librarize language-specific text transformations

https://gerrit.wikimedia.org/r/1128045

gerritbot added a comment.Apr 1 2025, 10:11 PM

Change #1132203 restored by Abaris:

[mediawiki/core@master] Librarize language-specific text transformations

https://gerrit.wikimedia.org/r/1132203

Dogu mentioned this in T376615: Migrate MediaWiki away from heavy classes to lighter-weight, smaller ones.Apr 2 2025, 12:08 PM
Dogu added a project: Wikimania-Hackathon-2025.Jul 18 2025, 11:29 PM
gerritbot added a comment.Aug 9 2025, 9:53 AM

Change #1176757 had a related patch set uploaded (by Abaris; author: Abaris):

[mediawiki/core@master] Create Leximorph lib for language-specific text transformations

https://gerrit.wikimedia.org/r/1176757

gerritbot added a comment.Aug 10 2025, 8:02 AM

Change #1176803 had a related patch set uploaded (by Abaris; author: Abaris):

[mediawiki/core@master] Introduce UseLeximorph feature flag

https://gerrit.wikimedia.org/r/1176803

gerritbot added a comment.Aug 10 2025, 8:08 AM

Change #1176804 had a related patch set uploaded (by Abaris; author: Abaris):

[mediawiki/core@master] Integrate UseLeximorph flag into CoreParserFunctions

https://gerrit.wikimedia.org/r/1176804

Aklapper moved this task from Backlog to Hacking Projects on the Wikimania-Hackathon-2025 board.Aug 12 2025, 8:43 PM
gerritbot added a comment.Aug 13 2025, 10:01 AM

Change #1178494 had a related patch set uploaded (by Abaris; author: Abaris):

[mediawiki/core@master] Integrate UseLeximorph flag into Language

https://gerrit.wikimedia.org/r/1178494

Dogu updated the task description. (Show Details)Aug 13 2025, 10:22 AM
gerritbot added a comment.Aug 14 2025, 2:26 PM

Change #1176757 merged by jenkins-bot:

[mediawiki/core@master] Create Leximorph lib for language-specific text transformations

https://gerrit.wikimedia.org/r/1176757

gerritbot added a comment.Aug 14 2025, 2:26 PM

Change #1176803 merged by jenkins-bot:

[mediawiki/core@master] config: Introduce UseLeximorph feature flag

https://gerrit.wikimedia.org/r/1176803

ReleaseTaggerBot added a project: MW-1.45-notes (1.45.0-wmf.15; 2025-08-19).Aug 14 2025, 3:00 PM
Dogu updated the task description. (Show Details)Aug 15 2025, 11:31 AM
Dogu updated the task description. (Show Details)
gerritbot added a comment.Aug 15 2025, 11:32 AM

Change #1178992 had a related patch set uploaded (by Abaris; author: Abaris):

[mediawiki/core@master] includes/libs/Leximorph: Validate fallback nodes and log warnings

https://gerrit.wikimedia.org/r/1178992

gerritbot added a comment.Aug 15 2025, 11:33 AM

Change #1178920 had a related patch set uploaded (by Abaris; author: Abaris):

[mediawiki/core@master] includes/libs/Leximorph: Support override forms in Grammar

https://gerrit.wikimedia.org/r/1178920

gerritbot added a comment.Aug 15 2025, 11:33 AM

Change #1128383 had a related patch set uploaded (by Abaris; author: Abaris):

[mediawiki/extensions/Translate@master] scripts/plural-comparison.php: Use Leximorph provider with feature flag

https://gerrit.wikimedia.org/r/1128383

gerritbot added a comment.Aug 15 2025, 11:33 AM

Change #1131864 had a related patch set uploaded (by Abaris; author: Abaris):

[mediawiki/extensions/cldr@master] Hooks: Use Leximorph provider with feature flag

https://gerrit.wikimedia.org/r/1131864

gerritbot added a comment.Aug 15 2025, 12:27 PM

Change #1179130 had a related patch set uploaded (by Abaris; author: Abaris):

[mediawiki/core@master] includes/language/LocalisationCache: Use Leximorph with feature flag

https://gerrit.wikimedia.org/r/1179130

Dogu updated the task description. (Show Details)Aug 15 2025, 12:32 PM
Dogu updated the task description. (Show Details)Aug 15 2025, 12:46 PM
Dogu updated the task description. (Show Details)Aug 15 2025, 12:58 PM
gerritbot added a comment.Aug 15 2025, 6:14 PM

Change #1179186 had a related patch set uploaded (by Abaris; author: Abaris):

[mediawiki/core@master] services: Introduce LeximorphFactory for Manager and Provider

https://gerrit.wikimedia.org/r/1179186

Dogu updated the task description. (Show Details)Aug 16 2025, 8:38 AM
Dogu updated the task description. (Show Details)
gerritbot added a comment.Aug 28 2025, 11:17 PM

Change #1182953 had a related patch set uploaded (by Abaris; author: Abaris):

[mediawiki/core@master] includes/libs/Leximorph/Manager: Share single Provider and logger

https://gerrit.wikimedia.org/r/1182953

gerritbot added a comment.Sep 2 2025, 4:29 PM

Change #1179186 merged by jenkins-bot:

[mediawiki/core@master] services: Introduce LeximorphFactory for Manager and Provider

https://gerrit.wikimedia.org/r/1179186

ReleaseTaggerBot edited projects, added MW-1.45-notes (1.45.0-wmf.18; 2025-09-09); removed MW-1.45-notes (1.45.0-wmf.15; 2025-08-19).Sep 2 2025, 5:00 PM
srishakatux subscribed.Sep 23 2025, 4:48 PM
Jdforrester-WMF added a parent task: T227447: Librarize i18n-related PHP classes in MediaWiki.Sep 30 2025, 11:58 PM
MaryMunyoki added subscribers: ToluAyo, MaryMunyoki.Oct 1 2025, 4:39 PM

@Dogu great meeting last week to learn more about this work and congratulations for the progress made so far. As part of the follow ups after this meeting, I spoke with a couple of engineers including Jdforrester-WMF to better understand this work. My understanding is this part of work is part of the long-term (2014+) work to[[ https://www.mediawiki.org/wiki/Library_infrastructure_for_MediaWiki to move tight code like this out of MediaWiki core and into libraries, ]] and this particular piece of work might have originated with a different change to provide a PHP-equivalence library for Vue code. I also understand there is a Phabricator board of these pieces of work, and this task comes under the T227447: Librarize i18n-related PHP classes in MediaWiki task, which I see is now linked as a parent task.

In particular, as a follow up, I am interested to learn more on the scope of the planned work and the anticipated impact on language onboarding which entails adding and removing languages , Plural support, Keyboard support, Fall back among other areas, just so the expectations are clear early on. is there documentation that details the scope of the planned work that can be shared and anticipated changes?

Dogu updated the task description. (Show Details)Oct 2 2025, 9:05 AM
Dogu added a comment.Oct 2 2025, 9:36 AM

Hey @MaryMunyoki, I don't yet have a formal future plan, with several patches awaiting review and merge I paused further changes, and once they land I will draft and share the concrete next steps.

Jdforrester-WMF subscribed.Oct 8 2025, 2:45 PM
In T389281#11236146, @Dogu wrote:

Hey @MaryMunyoki, I don't yet have a formal future plan, with several patches awaiting review and merge I paused further changes, and once they land I will draft and share the concrete next steps.

Sure, but I think we need a rough outline of the overall direction here (so we know when we're "Done", but also so other things can happen alongside). Can you put down some draft bullets of your thoughts here so we can move forward?

gerritbot added a comment.Nov 26 2025, 12:01 PM

Change #1178920 merged by jenkins-bot:

[mediawiki/core@master] includes/libs/Leximorph/Handler/Grammar: Support override forms

https://gerrit.wikimedia.org/r/1178920

gerritbot added a comment.Nov 26 2025, 12:07 PM

Change #1178992 merged by jenkins-bot:

[mediawiki/core@master] includes/libs/Leximorph: Validate fallback nodes and log warnings

https://gerrit.wikimedia.org/r/1178992

ReleaseTaggerBot added a project: MW-1.46-notes (1.46.0-wmf.5; 2025-12-02).Nov 26 2025, 1:01 PM
gerritbot added a comment.Nov 26 2025, 8:05 PM

Change #1128045 abandoned by Abaris:

[mediawiki/core@master] [PoC] Librarize language-specific text transformations

https://gerrit.wikimedia.org/r/1128045

gerritbot added a comment.Nov 30 2025, 7:07 PM

Change #1178494 abandoned by Abaris:

[mediawiki/core@master] includes/language/Language: Use Leximorph with feature flag

https://gerrit.wikimedia.org/r/1178494

gerritbot added a comment.Nov 30 2025, 7:08 PM

Change #1176804 abandoned by Abaris:

[mediawiki/core@master] includes/parser/CoreParserFunctions: Use Leximorph with feature flag

https://gerrit.wikimedia.org/r/1176804

Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL · Credits