Use Parsoid in Mediawiki Core for Content Translation
Closed, ResolvedPublic
Actions

Assigned To

Authored By

	santhosh
	Nov 23 2022, 6:50 AM

Description

Similar to T264669: Move VE API from RESTBase into core. Content Translation should be able to use the Parsoid in Mediawiki core. Currently, CX uses Virtual Restbase service.

Write a client to use Parsoid in MW Core, use it in CX html->wikitext workflow
Provide a mechanism to choose the existing RestbaseClient or Direct parsoid client by configuration. By default, it should use the current restbase approach.
Add tests
Switch to a new client in multiple stages to evaluate
- Small and Medium Wikipedias: https://phabricator.wikimedia.org/T337922
- All Wikipedias: https://phabricator.wikimedia.org/T339322
Followups:
- Remove VRS related code from CX: https://phabricator.wikimedia.org/T339228 (Patch: https://gerrit.wikimedia.org/r/c/mediawiki/extensions/ContentTranslation/+/930794)
- Remove wgContentTranslationDefaultParsoidClient cleanup: https://gerrit.wikimedia.org/r/c/operations/mediawiki-config/+/930798

Details

Subject	Repo	Branch	Lines +/-
testwiki: Use Parsoid in Mediawiki Core for Content Translation	operations/mediawiki-config	master	+5 -0
testwiki: Use Parsoid in Mediawiki Core for Content Translation	operations/mediawiki-config	master	+5 -0
Direct Parsoid Client integration, tests	mediawiki/extensions/ContentTranslation	master	+968 -147

Customize query in gerrit

Related Objects
Search...

Status	Assigned	Task
Resolved	santhosh	T323667 Use Parsoid in Mediawiki Core for Content Translation
Resolved	KartikMistry	T337922 Use Parsoid in Small and Medium Wikis for Content Translation
Resolved	KartikMistry	T339322 Use Parsoid in all Wikis for Content Translation

Event Timeline

santhosh created this task.Nov 23 2022, 6:50 AM

Restricted Application added a subscriber: Aklapper. · View Herald TranscriptNov 23 2022, 6:50 AM

Change 859459 had a related patch set uploaded (by Santhosh; author: Santhosh):

[mediawiki/extensions/ContentTranslation@master] Direct Parsoid Client integration, tests

https://gerrit.wikimedia.org/r/859459

gerritbot added a project: Patch-For-Review.Nov 23 2022, 6:51 AM

santhosh claimed this task.Nov 23 2022, 6:53 AM

santhosh moved this task from Quarter Backlog to In Progress on the Language-Team (Language-2022-October-December) board.

DAlangi_WMF awarded a token.Nov 23 2022, 8:28 AM

DAlangi_WMF subscribed.

Change 859459 merged by jenkins-bot:

[mediawiki/extensions/ContentTranslation@master] Direct Parsoid Client integration, tests

https://gerrit.wikimedia.org/r/859459

Maintenance_bot removed a project: Patch-For-Review.Nov 29 2022, 9:31 AM

Is this task still in progress, or we could move it to another column?

• Nikerabbit triaged this task as Medium priority.Dec 19 2022, 11:24 AM

• Nikerabbit moved this task from In Progress to Check after deployment on the Language-Team (Language-2022-October-December) board.

• Nikerabbit moved this task from Needs Triage to Enhancements on the ContentTranslation board.

Pending: Deployment plan and gradual configuration switching. Tendatively in Jan 2023

Pginer-WMF edited projects, added Language-Team (Language-2023-January-March); removed Language-Team (Language-2022-October-December).Jan 9 2023, 11:36 AM

Pginer-WMF moved this task from Quarter Backlog to Check after deployment on the Language-Team (Language-2023-January-March) board.

Change 879276 had a related patch set uploaded (by KartikMistry; author: KartikMistry):

[operations/mediawiki-config@master] testwiki: Use Parsoid in Mediawiki Core for Content Translation

https://gerrit.wikimedia.org/r/879276

gerritbot added a project: Patch-For-Review.Jan 12 2023, 9:02 AM

Change 879276 merged by jenkins-bot:

[operations/mediawiki-config@master] testwiki: Use Parsoid in Mediawiki Core for Content Translation

https://gerrit.wikimedia.org/r/879276

Maintenance_bot removed a project: Patch-For-Review.Jan 16 2023, 6:30 AM

Change 879998 had a related patch set uploaded (by KartikMistry; author: KartikMistry):

[operations/mediawiki-config@master] "testwiki: Use Parsoid in Mediawiki Core for Content Translation""

https://gerrit.wikimedia.org/r/879998

gerritbot added a project: Patch-For-Review.Jan 17 2023, 6:26 AM

Change 879998 merged by jenkins-bot:

[operations/mediawiki-config@master] testwiki: Use Parsoid in Mediawiki Core for Content Translation

https://gerrit.wikimedia.org/r/879998

Mentioned in SAL (#wikimedia-operations) [2023-01-17T08:08:49Z] <kartik@deploy1002> Started scap: Backport for [[gerrit:879998|testwiki: Use Parsoid in Mediawiki Core for Content Translation (T323667)]]

Mentioned in SAL (#wikimedia-operations) [2023-01-17T08:13:35Z] <kartik@deploy1002> kartik and kartik: Backport for [[gerrit:879998|testwiki: Use Parsoid in Mediawiki Core for Content Translation (T323667)]] synced to the testservers: mwdebug1002.eqiad.wmnet, mwdebug2001.codfw.wmnet, mwdebug1001.eqiad.wmnet, mwdebug2002.codfw.wmnet

Mentioned in SAL (#wikimedia-operations) [2023-01-17T08:29:45Z] <kartik@deploy1002> Finished scap: Backport for [[gerrit:879998|testwiki: Use Parsoid in Mediawiki Core for Content Translation (T323667)]] (duration: 20m 56s)

Maintenance_bot removed a project: Patch-For-Review.Jan 17 2023, 8:30 AM

• Nikerabbit moved this task from Check after deployment to Needs QA on the Language-Team (Language-2023-January-March) board.Feb 22 2023, 9:12 AM

@santhosh correct me if I am wrong, there is no UI code changes here. This is to ensure nothing breaks and things work as expected correct ?

EChukwukere-WMF moved this task from Needs QA to Pending input for QA on the Language-Team (Language-2023-January-March) board.Mar 8 2023, 5:27 AM

Pginer-WMF edited projects, added Language-Team (Language-2023-April-June); removed Language-Team (Language-2023-January-March).Mar 31 2023, 1:22 PM

Pginer-WMF moved this task from Quarter Backlog to Pending input for QA on the Language-Team (Language-2023-April-June) board.

KartikMistry mentioned this in T337922: Use Parsoid in Small and Medium Wikis for Content Translation.Jun 1 2023, 11:26 AM

KartikMistry updated the task description. (Show Details)Jun 1 2023, 11:29 AM

In T323667#8675224, @EChukwukere-WMF wrote:

@santhosh correct me if I am wrong, there is no UI code changes here. This is to ensure nothing breaks and things work as expected correct ?

Yes, there is no UI change. But this change is related to how publishing works. So testing the publishing of translation on changed wikis is important.

KartikMistry updated the task description. (Show Details)Jun 16 2023, 5:28 AM

KartikMistry mentioned this in T339322: Use Parsoid in all Wikis for Content Translation.Jun 16 2023, 5:31 AM

KartikMistry updated the task description. (Show Details)Jun 19 2023, 7:15 AM

KartikMistry updated the task description. (Show Details)

Pginer-WMF edited projects, added Language-Team (Language-2023-July-September); removed Language-Team (Language-2023-April-June).Jun 30 2023, 11:43 AM

Pginer-WMF moved this task from Quarter Backlog to Pending input for QA on the Language-Team (Language-2023-July-September) board.

• Nikerabbit closed subtask T337922: Use Parsoid in Small and Medium Wikis for Content Translation as Resolved.Aug 24 2023, 1:48 PM

• Nikerabbit updated the task description. (Show Details)