Allows us to use WikiText-based models and query-text-based models without having to put them in one directory (which requires duplication and confuses provenance). Generalize to any number of directories. Expected outcome is improved recall and possible boost to precision, by identifying some languages for which we have no query-text-based models, but for which we have or can easily generate wiki-text-based models.
Update Perl and PHP versions of TextCat.
| Subject | Repo | Branch | Lines +/- | |
|---|---|---|---|---|
| Allow TextCat to use multiple language model directories | wikimedia/textcat | master | +81 -38 |
| Status | Subtype | Assigned | Task | ||
|---|---|---|---|---|---|
| Open | None | T118278 [EPIC] Improve Language Identification for use in Cirrus Search | |||
| Resolved | TJones | T140289 Investigate Improvements and Confidence Measures for TextCat Language Detection | |||
| Resolved | TJones | T149316 allow TextCat to use multiple language model directories |
Change 320852 had a related patch set uploaded (by Tjones):
Allow TextCat to use multiple language model directories
Change 320852 merged by jenkins-bot:
Allow TextCat to use multiple language model directories