Page MenuHomePhabricator
Create Task
Maniphest T176619

Wikispeech server doesn't seem to use the POS from pronlex if it is specified
Closed, ResolvedPublic
Actions

Description

Steps to reproduce:

  1. Lookup "dom" and you will get the the pronunciation and pos tag for the function word:

http://localhost:10000/wikispeech/textprocessing/?lang=sv&input=dom

  1. Look up the id for "dom" /d U m/:

http://localhost:8787/lexicon/lookup?lexicons=sv_se_nst_lex:sv-se.nst&words=dom&transcriptionlike=__d%20U%20m

  1. Set entry "dom" /d U m/ to preferred (replace ID in the URL with the id found above.

http://localhost:8787/lexicon/updateentry?entry={%22id%22:ID,%22lexRef%22:{%22DBRef%22:%22sv_se_nst_lex%22,%22LexName%22:%22sv-se.nst%22},%22strn%22:%22dom%22,%22language%22:%22sv-se%22,%22partOfSpeech%22:%22NN%22,%22morphology%22:%22SIN|IND|NOM|UTR%22,%22wordParts%22:%22dom%22,%22lemma%22:{%22id%22:22903,%22strn%22:%22dom%22,%22reading%22:%22%22,%22paradigm%22:%22s2l-sjukdom%22},%22transcriptions%22:[{%22id%22:202659,%22entryId%22:197150,%22strn%22:%22\%22%20d%20U%20m%22,%22language%22:%22sv-se%22,%22sources%22:[]}],%22status%22:{%22id%22:197150,%22name%22:%22imported%22,%22source%22:%22nst%22,%22timestamp%22:%222017-09-25T11:54:02Z%22,%22current%22:true},%22entryValidations%22:[],%22preferred%22:true}

  1. Lookup "dom" and you will get the correct transcription but still the function tag:

http://localhost:10000/wikispeech/textprocessing/?lang=sv&input=dom

Event Timeline

HannaLindgren created this task.Sep 25 2017, 12:21 PM
HannaLindgren updated the task description. (Show Details)Sep 27 2017, 12:58 PM
HannaLindgren updated the task description. (Show Details)
HannaLindgren triaged this task as Low priority.Dec 11 2017, 2:19 PM
HannaLindgren raised the priority of this task from Low to Needs Triage.Oct 23 2019, 8:54 AM
HannaLindgren edited projects, added Wikispeech-Text-to-Speech; removed Wikispeech.Oct 23 2019, 12:23 PM
Sebastian_Berlin-WMSE removed a project: Wikispeech-Textprocessing.Nov 11 2019, 11:49 AM
Sebastian_Berlin-WMSE added a project: Wikispeech-Jobrunner.Nov 13 2019, 4:10 PM
HaraldBerthelsen moved this task from Incoming to Proposed for next sprint on the Wikispeech-Jobrunner board.Nov 14 2019, 12:23 PM
HaraldBerthelsen moved this task from Proposed for next sprint to Sprint on the Wikispeech-Jobrunner board.Nov 14 2019, 1:20 PM
HaraldBerthelsen edited projects, added Wikispeech-Jobrunner (Sprint); removed Wikispeech-Jobrunner.
HaraldBerthelsen moved this task from Backlog to In progress on the Wikispeech-Jobrunner (Sprint) board.Nov 25 2019, 10:09 AM
HaraldBerthelsen added a comment.Nov 25 2019, 12:45 PM

This is part of the (complicated) question of how to deal with ambiguity in pronunciation and part-of-speech tags. If there is a "real" pos-tagger at work, or if pos-tags are set by the user, these should be used to select pronunciation. Otherwise the lexicon might just as well set it. Changed (test) to set part-of-speech in the same way as pronunciation has been set before: Use the first entry in the lexicon, unless another one is explicitly set as preferred.

Not sure if we need a new task to set this up in a better way?

HaraldBerthelsen moved this task from In progress to Done on the Wikispeech-Jobrunner (Sprint) board.Nov 25 2019, 12:46 PM
Lokal_Profil closed this task as Resolved.Nov 28 2019, 1:21 PM
Content licensed under Creative Commons Attribution-ShareAlike 3.0 (CC-BY-SA) unless otherwise noted; code licensed under GNU General Public License (GPL) or other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL