Exports and imports for translation memory
Open, MediumPublic
Actions

Assigned To

None

Authored By

	Nikerabbit
	Nov 2 2020, 3:07 PM

Description

In order to improve translation memory, it should be easy to get real test data from different production environments.

We need a new scripts to export and import this data. The format of the data should be different, more generic than what is currently stored in the schema. It should be possible to do a schema change in TTMServer index and just use the same dump to re-import the data.

Details

	Subject	Repo	Branch	Lines +/-
	WIP: Add ImportTtmServerDump maintenance script	mediawiki/extensions/Translate	master	+136 -9
	Add script to create a dump that can be imported to TTMServer	mediawiki/extensions/Translate	master	+256 -0

Customize query in gerrit

Related Objects
Search...

Status	Assigned	Task
Resolved	None	T195760 Language Annual Plan 2018-2019
Resolved	Nikerabbit	T204818 Language tools maintenance intervention: Improve the quality of translations for Translate extension
Open	None	T101236 TTMServer performance and coverage issues
Open	None	T267031 Exports and imports for translation memory

Event Timeline

Nikerabbit created this task.Nov 2 2020, 3:07 PM

Restricted Application added a subscriber: Aklapper. · View Herald TranscriptNov 2 2020, 3:07 PM

Nikerabbit added a parent task: T101236: TTMServer performance and coverage issues.Nov 2 2020, 3:07 PM

Nikerabbit triaged this task as Medium priority.Nov 3 2020, 8:28 AM

Nikerabbit moved this task from Quarter Backlog to Priority Backlog on the Language-Team (Language-2020-October-December) board.

Change 638605 had a related patch set uploaded (by Nikerabbit; owner: Nikerabbit):
[mediawiki/extensions/Translate@master] Add script to create a dump that can be imported to TTMServer

https://gerrit.wikimedia.org/r/638605

gerritbot added a project: Patch-For-Review.Nov 3 2020, 4:06 PM

Nikerabbit claimed this task.Nov 3 2020, 4:06 PM

Nikerabbit moved this task from Priority Backlog to In Progress on the Language-Team (Language-2020-October-December) board.

Nikerabbit moved this task from Backlog to TTMServer on the MediaWiki-extensions-Translate board.Nov 5 2020, 12:30 PM

Nikerabbit merged a task: T178885: Create a script to export/import a test dataset to TTMServer.Nov 23 2020, 4:01 PM

Nikerabbit added a subscriber: EBernhardson.

Change 638605 merged by jenkins-bot:
[mediawiki/extensions/Translate@master] Add script to create a dump that can be imported to TTMServer

https://gerrit.wikimedia.org/r/638605

Maintenance_bot removed a project: Patch-For-Review.Nov 27 2020, 10:10 AM

ReleaseTaggerBot added a project: MW-1.36-notes (1.36.0-wmf.20; 2020-12-01).Nov 27 2020, 11:01 AM

Pginer-WMF edited projects, added Language-Team (Language-2021-January-March); removed Language-Team (Language-2020-October-December).Jan 4 2021, 10:16 AM

Pginer-WMF moved this task from Quarter Backlog to In Progress on the Language-Team (Language-2021-January-March) board.

This has been progressing slowly because:

The Elastic license change announcement caused uncertainty about the future of translation memory
Trying to not incur additional tech debt while creating new code. This has necessitated refactorings to improve the old code.

Nikerabbit moved this task from In Progress to Priority Backlog on the Language-Team (Language-2021-January-March) board.Feb 25 2021, 1:26 PM

Nikerabbit removed Nikerabbit as the assignee of this task.Mar 15 2021, 2:05 PM

Pginer-WMF edited projects, added Language-Team (Language-2021-April-June); removed Language-Team (Language-2021-January-March).Apr 1 2021, 11:29 AM

Pginer-WMF moved this task from Quarter Backlog to Priority Backlog on the Language-Team (Language-2021-April-June) board.

Pginer-WMF moved this task from Priority Backlog to Quarter Backlog on the Language-Team (Language-2021-April-June) board.Jun 1 2021, 9:10 AM

Pginer-WMF edited projects, added Language-Team (Language-2021-July-September); removed Language-Team (Language-2021-April-June).Jul 12 2021, 3:27 PM

Pginer-WMF edited projects, added Language-Team (Language-2021-October-December); removed Language-Team (Language-2021-July-September).Oct 1 2021, 12:36 PM

Change 655614 had a related patch set uploaded (by Nikerabbit; author: Nikerabbit):

[mediawiki/extensions/Translate@master] WIP: Add ImportTtmServerDump maintenance script

https://gerrit.wikimedia.org/r/655614

Change 655614 abandoned by Nikerabbit:

[mediawiki/extensions/Translate@master] WIP: Add ImportTtmServerDump maintenance script