Page MenuHomePhabricator
Create Task
Maniphest T95886

for ContentTranslation MT, store information about source content, machine-translated content and user-edited content
Closed, ResolvedPublic
Actions

Description

For improving machine translation engines, it is useful to store the source content, the machine-translated content sent back from the MT service, and the user-edited content.

Every such triplet must have:

  • a unique ID
  • the timestamp of the machine translation
  • the timestamp of publishing the edited text
  • the MT engine identifier ("Apertium", "Moses", etc.)

Related Objects
Search...

StatusSubtypeAssignedTask
 ResolvedsanthoshT95886 for ContentTranslation MT, store information about source content, machine-translated content and user-edited content
 ResolvedsanthoshT111905 Design the technical infrastructure for parallel corpora storage and api (tracking)
 ResolvedsanthoshT119489 Avoid deleting the saved translation once translation published to wiki
 ResolvedsanthoshT119495 Save the revision id of source and published article in cx_translations table
 ResolvedjcrespoT119752 Review schema changes for T119495
 ResolvedjcrespoT121509 Correct the schema to make revision id columns of cx_translations nullable
 ResolvedsanthoshT119497 Expose the revisions in ApiQueryPublishedTranslations output
ResolvedsanthoshT119617 Create new table for CX Parallel corpora
 ResolvedNoneT120815 Review and create CX Parallel corpora table
 ResolvedNikerabbitT119618 Create API for accessing parallel corpora by providing translation id
 ResolvedsanthoshT120062 Design and develop API to save the source, initial MT and final translation at section level to parallel corpora table
 ResolvedNikerabbitT122042 Provide parallel corpora dumps
 ResolvedsanthoshT124399 Migrate the draft translation restore mechanism to use data from cx_corpora table
 ResolvedsanthoshT125621 ApiQueryContentTranslation: Serve the saved translation from cxc_corpora table
 ResolvedsanthoshT125622 While saving the data to corpora table, remove the corresponding entry from drafts table
 ResolvedsanthoshT125623 Remove the ext.cx.drafts module, migrate the section restore logic to a new module
 ResolvedsanthoshT125645 Use cxpublish api only for publish and use cxsave api for save
 ResolvedsanthoshT128162 Resuming a re-translated deleted translation will cause restoring the sections from old deleted translation
 ResolvedsanthoshT130178 Translation restore: Do not attempt adding orphan section unless source article is old revision
 ResolvedArielGlennT127793 Create Content Translation Parallel Corpora dumps
 ResolvedNikerabbitT133006 Add compression support to scripts/dump-corpora.php
 ResolvedNikerabbitT133007 Add --output option to scripts/dump-corpora.php

Event Timeline

Amire80 created this task.Apr 13 2015, 1:28 PM
Amire80 raised the priority of this task from to Needs Triage.
Amire80 updated the task description. (Show Details)
Amire80 added a project: ContentTranslation.
Amire80 subscribed.
Restricted Application added a subscriber: Aklapper. · View Herald TranscriptApr 13 2015, 1:28 PM
Amire80 updated the task description. (Show Details)Apr 13 2015, 1:34 PM
Amire80 set Security to None.
Amire80 triaged this task as High priority.May 4 2015, 4:41 PM
Amire80 mentioned this in T96165: Learn from user corrections to avoid editing the same term again and again.May 4 2015, 4:50 PM
Pginer-WMF mentioned this in ContentTranslation-Release6.May 16 2015, 1:18 PM
Ricordisamoa subscribed.Jun 6 2015, 11:07 PM
• iecetcwcpggwqpgciazwvzpfjpwomjxn subscribed.Jun 7 2015, 9:35 AM
• Elitre subscribed.Jun 7 2015, 10:31 AM
• Purodha subscribed.Jun 7 2015, 12:42 PM
Liuxinyu970226 subscribed.Jun 10 2015, 6:59 AM
KuboF awarded a token.Jun 10 2015, 4:38 PM
KuboF subscribed.
Amire80 added a project: ContentTranslation-Release6.Jun 17 2015, 9:28 AM
Amire80 moved this task from Backlog to Parallel corpora on the ContentTranslation-Release6 board.
Amire80 moved this task from Needs Triage to CX6 on the ContentTranslation board.Jun 23 2015, 8:29 AM
Amire80 merged a task: T90218: Store initial machine translation and the actual human translation.Jul 3 2015, 2:03 PM
He7d3r subscribed.Jul 11 2015, 12:35 AM
Unhammer subscribed.Sep 1 2015, 12:33 PM
Arrbee added a project: OKR-Work.Sep 7 2015, 6:26 AM
Pginer-WMF mentioned this in ContentTranslation-Release7.Sep 17 2015, 9:12 AM
Amire80 moved this task from CX6 to CX7 on the ContentTranslation board.Oct 2 2015, 2:43 PM
Pginer-WMF added a project: ContentTranslation-Release7.Oct 6 2015, 7:27 AM
Pginer-WMF moved this task from Backlog to 3rd party support on the ContentTranslation-Release7 board.
Arrbee removed a project: ContentTranslation-Release6.Oct 8 2015, 10:26 AM
Amire80 moved this task from CX7 to CX8 on the ContentTranslation board.Jan 24 2016, 10:31 PM
Amire80 edited projects, added ContentTranslation-Release8; removed ContentTranslation-Release7.Jan 27 2016, 9:24 AM
Amire80 moved this task from Backlog to Infrastructure WMF requirements on the ContentTranslation-Release8 board.Feb 3 2016, 6:17 AM
Amire80 moved this task from Infrastructure WMF requirements to Parallel corpora on the ContentTranslation-Release8 board.
KuboF unsubscribed.Feb 6 2016, 4:48 PM
santhosh closed this task as Resolved.Mar 7 2016, 6:47 AM
santhosh claimed this task.
santhosh subscribed.

T111905: Design the technical infrastructure for parallel corpora storage and api (tracking) addressed this. All the information mentioned above are stored now
See documentation https://www.mediawiki.org/wiki/Content_translation/Published_translations

Liuxinyu970226 unsubscribed.Mar 11 2016, 1:38 PM
Amire80 closed subtask T111905: Design the technical infrastructure for parallel corpora storage and api (tracking) as Resolved.Oct 3 2016, 11:16 AM
Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL · Credits