Page MenuHomePhabricator
Create Task
Maniphest T380517

Make Parsoid language conversion into an OutputTransform pass
Closed, ResolvedPublic
Actions

Description

This code for language conversion should move out of Parsoid and into core as an OutputTrasnform pass.

As part of this, we might drop the dependency on wikimedia/langconv and switch back to using mediawiki-core's implementation of LanguageConverter for the actual conversion, although the markup parsing will still be done by Parsoid.

Details

Related Changes in Gerrit:
SubjectRepoBranchLines +/-
Bump wikimedia/parsoid to 0.23.0-a17mediawiki/vendormaster+2 K -1 K
Bump wikimedia/parsoid to V0.23.0-a17mediawiki/vendormaster+2 K -1 K
[tests] *Actually* skip +langconv testsmediawiki/services/parsoidmaster+4 -0
Parsoid LanguageConverter postprocessing passmediawiki/coremaster+1 K -91
parsertests: Skip +langconv testsmediawiki/services/parsoidmaster+8 -4
Support `!! metadata+langconv` sections in parser testsmediawiki/coremaster+55 -18
ConverterRule: allow DocumentFragments as well as stringsmediawiki/coremaster+263 -46
Bump wikimedia/parsoid to 0.23.0-a2mediawiki/vendormaster+2 K -1 K
Convert Language Converter to use NodeData objectsmediawiki/services/parsoidmaster+899 -283
Customize query in gerrit

Related Objects
Search...

View Standalone Graph
This task is connected to more than 200 other tasks. Only direct parents and subtasks are shown here. Use View Standalone Graph to show more of the graph.
StatusSubtypeAssignedTask
· · ·
ResolvedihurbainT348255 Parser cache infrastructure for OutputTransform
In ProgressNoneT43716 [EPIC] Support language variant conversion in Parsoid
ResolvedcscottT380517 Make Parsoid language conversion into an OutputTransform pass
ResolvedBUG REPORTcscottT400140 Existed links render as redlinks in Template
ResolvedcscottT415435 Add temporary URL request parameter to opt-in to the new Parsoid LanguageConverter implementation
ResolvedcscottT267067 Make language variant a parser option
OpencscottT416104 Use proper variant in ParsoidLocalization on messages localized into the page language
· · ·

Event Timeline

cscott created this task.Nov 21 2024, 5:43 PM
Restricted Application added a project: Parsoid. · View Herald TranscriptNov 21 2024, 5:43 PM
cscott mentioned this in T348255: Parser cache infrastructure for OutputTransform.Nov 21 2024, 5:50 PM
MSantos mentioned this in T262593: MediaWiki Developer stores different HTML output for different language variants in the parser cache.Nov 21 2024, 6:28 PM
MSantos merged a task: T262593: MediaWiki Developer stores different HTML output for different language variants in the parser cache.
MSantos added subscribers: • eprodromou, MSantos, Ericliu1912 and 5 others.
ihurbain removed ihurbain as the assignee of this task.Feb 3 2025, 4:56 PM
ihurbain subscribed.
ihurbain removed a project: Content-Transform-Team-WIP.Apr 7 2025, 1:43 PM
ihurbain moved this task from Phase 2 - testwiki Main namespace support to Language Converter Support on the Parsoid-Read-Views board.Apr 7 2025, 1:51 PM
ihurbain edited projects, added: Parsoid-Read-Views (Language Converter Support); removed: Parsoid-Read-Views (Phase 2 - testwiki Main namespace support).
Hakimi97 subscribed.Apr 25 2025, 2:05 PM
MSantos removed a project: Parsoid.Jul 17 2025, 2:30 PM
cscott added a project: Content-Transform-Team (Work In Progress).Oct 20 2025, 3:16 PM
cscott merged a task: T407765: Create LanguageConverter pass as an OutputTransform stage.Oct 20 2025, 3:18 PM
SLopes-WMF assigned this task to cscott.Oct 27 2025, 3:15 PM
SLopes-WMF moved this task from Backlog to In Progress on the Content-Transform-Team (Work In Progress) board.
gerritbot added a comment.Oct 28 2025, 6:09 PM

Change #824564 had a related patch set uploaded (by C. Scott Ananian; author: C. Scott Ananian):

[mediawiki/services/parsoid@master] Convert Language Converter to use NodeData objects

https://gerrit.wikimedia.org/r/824564

gerritbot added a project: Patch-For-Review.Oct 28 2025, 6:09 PM
gerritbot added a comment.Oct 31 2025, 1:10 AM

Change #824564 merged by jenkins-bot:

[mediawiki/services/parsoid@master] Convert Language Converter to use NodeData objects

https://gerrit.wikimedia.org/r/824564

Maintenance_bot removed a project: Patch-For-Review.Oct 31 2025, 1:30 AM
gerritbot added a comment.Nov 3 2025, 5:52 PM

Change #1201164 had a related patch set uploaded (by C. Scott Ananian; author: C. Scott Ananian):

[mediawiki/vendor@master] Bump wikimedia/parsoid to 0.23.0-a2

https://gerrit.wikimedia.org/r/1201164

gerritbot added a project: Patch-For-Review.Nov 3 2025, 5:52 PM
gerritbot added a comment.Nov 3 2025, 6:30 PM

Change #1201164 merged by jenkins-bot:

[mediawiki/vendor@master] Bump wikimedia/parsoid to 0.23.0-a2

https://gerrit.wikimedia.org/r/1201164

cscott added a subtask: T400140: Existed links render as redlinks in Template.Nov 20 2025, 3:32 PM
Maintenance_bot removed a project: Patch-For-Review.Nov 20 2025, 4:32 PM
MSantos triaged this task as High priority.Nov 21 2025, 10:28 AM
cscott created subtask T415435: Add temporary URL request parameter to opt-in to the new Parsoid LanguageConverter implementation.Jan 24 2026, 5:44 AM
cscott mentioned this in T415435: Add temporary URL request parameter to opt-in to the new Parsoid LanguageConverter implementation.
cscott added a subtask: T267067: Make language variant a parser option.Jan 24 2026, 6:00 AM
gerritbot added a comment.Jan 24 2026, 6:46 AM

Change #1203255 had a related patch set uploaded (by C. Scott Ananian; author: C. Scott Ananian):

[mediawiki/core@master] Parsoid LanguageConverter postprocessing pass

https://gerrit.wikimedia.org/r/1203255

gerritbot added a project: Patch-For-Review.Jan 24 2026, 6:46 AM
gerritbot added a comment.Jan 28 2026, 12:08 AM

Change #1233932 had a related patch set uploaded (by C. Scott Ananian; author: C. Scott Ananian):

[mediawiki/services/parsoid@master] parsertests: Skip +langconv tests

https://gerrit.wikimedia.org/r/1233932

gerritbot added a comment.Jan 28 2026, 12:10 AM

Change #1225050 had a related patch set uploaded (by C. Scott Ananian; author: C. Scott Ananian):

[mediawiki/core@master] ConverterRule: allow DocumentFragments as well as strings

https://gerrit.wikimedia.org/r/1225050

gerritbot added a comment.Jan 28 2026, 12:10 AM

Change #1229812 had a related patch set uploaded (by C. Scott Ananian; author: C. Scott Ananian):

[mediawiki/core@master] Support `!! metadata+langconv` sections in parser tests

https://gerrit.wikimedia.org/r/1229812

gerritbot added a comment.Jan 30 2026, 10:09 AM

Change #1225050 merged by jenkins-bot:

[mediawiki/core@master] ConverterRule: allow DocumentFragments as well as strings

https://gerrit.wikimedia.org/r/1225050

ReleaseTaggerBot added a project: MW-1.46-notes (1.46.0-wmf.14; 2026-02-03).Jan 30 2026, 11:00 AM
cscott added a parent task: T43716: [EPIC] Support language variant conversion in Parsoid.Feb 2 2026, 4:07 AM
cscott created subtask T416104: Use proper variant in ParsoidLocalization on messages localized into the page language.Feb 2 2026, 4:14 AM
gerritbot added a comment.Feb 3 2026, 2:25 PM

Change #1229812 merged by jenkins-bot:

[mediawiki/core@master] Support `!! metadata+langconv` sections in parser tests

https://gerrit.wikimedia.org/r/1229812

ReleaseTaggerBot edited projects, added: MW-1.46-notes (1.46.0-wmf.15; 2026-02-10); removed: MW-1.46-notes (1.46.0-wmf.14; 2026-02-03).Feb 3 2026, 3:00 PM
MSantos moved this task from In Progress to Code Review on the Content-Transform-Team (Work In Progress) board.Feb 9 2026, 4:17 PM
gerritbot added a comment.Feb 16 2026, 6:08 PM

Change #1203255 merged by jenkins-bot:

[mediawiki/core@master] Parsoid LanguageConverter postprocessing pass

https://gerrit.wikimedia.org/r/1203255

gerritbot added a comment.Feb 16 2026, 6:08 PM

Change #1233932 merged by jenkins-bot:

[mediawiki/services/parsoid@master] parsertests: Skip +langconv tests

https://gerrit.wikimedia.org/r/1233932

Maintenance_bot removed a project: Patch-For-Review.Feb 16 2026, 6:30 PM
gerritbot added a comment.Feb 19 2026, 7:35 AM

Change #1240485 had a related patch set uploaded (by C. Scott Ananian; author: C. Scott Ananian):

[mediawiki/services/parsoid@master] [tests] *Actually* skip +langconv tests

https://gerrit.wikimedia.org/r/1240485

gerritbot added a project: Patch-For-Review.Feb 19 2026, 7:35 AM
gerritbot added a comment.Feb 19 2026, 8:11 AM

Change #1240485 merged by jenkins-bot:

[mediawiki/services/parsoid@master] [tests] *Actually* skip +langconv tests

https://gerrit.wikimedia.org/r/1240485

Maintenance_bot removed a project: Patch-For-Review.Feb 19 2026, 8:30 AM
MSantos moved this task from Code Review to To Deploy on the Content-Transform-Team (Work In Progress) board.Feb 23 2026, 4:05 PM
cscott moved this task from To Deploy to To Verify on the Content-Transform-Team (Work In Progress) board.Feb 23 2026, 4:05 PM
gerritbot added a comment.Feb 23 2026, 4:58 PM

Change #1242436 had a related patch set uploaded (by Isabelle Hurbain-Palatin; author: Isabelle Hurbain-Palatin):

[mediawiki/vendor@master] Bump wikimedia/parsoid to V0.23.0-a17

https://gerrit.wikimedia.org/r/1242436

gerritbot added a project: Patch-For-Review.Feb 23 2026, 4:58 PM
gerritbot added a comment.Feb 23 2026, 5:00 PM

Change #1242436 abandoned by Isabelle Hurbain-Palatin:

[mediawiki/vendor@master] Bump wikimedia/parsoid to V0.23.0-a17

Reason:

wrong tag

https://gerrit.wikimedia.org/r/1242436

Maintenance_bot removed a project: Patch-For-Review.Feb 23 2026, 5:31 PM
gerritbot added a comment.Feb 23 2026, 5:38 PM

Change #1242450 had a related patch set uploaded (by Isabelle Hurbain-Palatin; author: Isabelle Hurbain-Palatin):

[mediawiki/vendor@master] Bump wikimedia/parsoid to 0.23.0-a17

https://gerrit.wikimedia.org/r/1242450

gerritbot added a project: Patch-For-Review.Feb 23 2026, 5:38 PM
gerritbot added a comment.Feb 23 2026, 7:05 PM

Change #1242450 merged by jenkins-bot:

[mediawiki/vendor@master] Bump wikimedia/parsoid to 0.23.0-a17

https://gerrit.wikimedia.org/r/1242450

Maintenance_bot removed a project: Patch-For-Review.Feb 23 2026, 7:32 PM
cscott mentioned this in T416536: hywiki: some doi links in refs render with https with legacy parser and http with Parsoid.Feb 25 2026, 8:45 PM
Bewfip mentioned this in T418549: VisualEditor may add excessive LanguageConverter tags since 1.46.0-wmf.17.Feb 27 2026, 3:50 AM
cscott mentioned this in T391844: Convert data-mw-variant to use rich attributes.Mar 6 2026, 11:52 PM
cscott mentioned this in T420043: Secure Link Filtering Functionality.Mar 13 2026, 6:58 PM
cscott closed subtask T415435: Add temporary URL request parameter to opt-in to the new Parsoid LanguageConverter implementation as Resolved.Apr 9 2026, 10:49 PM
cscott closed this task as Resolved.Apr 25 2026, 1:58 AM
cscott closed subtask T267067: Make language variant a parser option as Resolved.
cscott mentioned this in T424409: Remove old Parsoid language converter implementation.Apr 25 2026, 2:03 AM
cscott mentioned this in T410543: Pages that have a `variant=` parameter or use a $wgVariantArticlePath should not use Parsoid.Apr 30 2026, 4:32 PM
cscott closed subtask T400140: Existed links render as redlinks in Template as Resolved.Fri, Jun 5, 11:59 PM
Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL · Credits