@bmansurov please find the candidates here: @stat1005:/home/dsaez/code/alignment/resultsMapping

You should find 6 files like this: mapping_xx.json, where xx is the source language. The information inside is formated in the following way:

key1: {"rank": n, "l1: [candidate1, ..., candidate5], ...'l5':[candidate1, ... candidate5]}

where:
key1: string, Section name in lang xx , eg: 'References'
rank: int, section 'popularity' ranking in source language, where n=1 is the most frequent section, eg: 45
l1: string -> list, l1 is one target language, and the list are the candidates translations/maps from key1, eg: 'es': ['Referencias', 'Notas', ...]

@diego would it be possible to generate each entry on a separate line and mappings bundled under the key "targets"? Something like this:

{key1: {"rank": n, "targets: { "l1": [candidate1, ..., candidate5], ..., "l5":[candidate1, ... candidate5]}}}

{key2: {"rank": n, "targets: { "l1": [candidate1, ..., candidate5], ..., "l5":[candidate1, ... candidate5]}}}

This would allow me to not load all data in memory in order to parse it.

In T182211#3967826, @bmansurov wrote:

@diego would it be possible to generate each entry on a separate line and mappings bundled under the key "targets"? Something like this:

{key1: {"rank": n, "targets: { "l1": [candidate1, ..., candidate5], ..., "l5":[candidate1, ... candidate5]}}}

{key2: {"rank": n, "targets: { "l1": [candidate1, ..., candidate5], ..., "l5":[candidate1, ... candidate5]}}}

This would allow me to not load all data in memory in order to parse it.

Served: /home/dsaez/code/alignment/resultsMappingLines

@diego thanks. I also updated the request above, so you must have missed the new format. Please add "targets" to the output.

Another thing I noticed is that some entries are missing mappings. For example, in the English file here are some missing entries:

External features is missing ar mappings.
External features is missing ja mappings.
Extracurriculars is missing ar mappings.
Location and features is missing ar mappings.
International honours is missing ja mappings.
Junction list is missing ar mappings.
New books is missing es mappings.
Opinion of the Court is missing ar mappings.
List of representatives is missing ar mappings.
Construction and commissioning is missing ar mappings.
Ladder is missing ar mappings.
Ladder is missing es mappings.
Ladder is missing ja mappings.
Ladder is missing ru mappings.
Assembly segments is missing ar mappings.

@diego I'm moving this task to Done as you've built the first version of the classifier and we're gathering labels now to improve it. Improvements will be tracked at T190770