Tech News translators are experiencing the translation memory not working for anything but the very shortest of sentences.
See discussion here:
https://meta.wikimedia.org/wiki/Talk:Tech/News/2017/41
Description
Description
Details
Details
Customize query in gerrit
Related Objects
Related Objects
Event Timeline
Comment Actions
CC @dcausse for ba7373e05385fe982d75efc537f38cf4aa158c24
Another report I got last night: https://meta.wikimedia.org/wiki/User_talk:Nikerabbit#K.C3.A4.C3.A4nn.C3.B6smuisti_ei_anna_en.C3.A4.C3.A4_ehdotuksia_pidemmille_viesteille
Based on the reports, it doesn't seem to work "without significant degradation" as I hoped.
Comment Actions
While revert seems appropriate for an interim solution, there is now also https://github.com/codelibs/elasticsearch-minhash LSH plugin that could tried out to see if it can replace the fuzzy query.
Comment Actions
Change 383075 had a related patch set uploaded (by DCausse; owner: DCausse):
[mediawiki/extensions/Translate@master] Revert "[tech-debt] Remove usage of FuzzyLikeThis in favor of simple fuzzy match"
Comment Actions
@Nikerabbit I think it'd be interesting to try this plugin, but given that it'll be hard to test such changes without breaking current usage I'd suggest keeping the FuzzyLikeThis method now and start to add some new logic in TTM that we could activate with a URL param.
I'll swat the revert today, and add this plugin to the list of plugins to install to production.
Comment Actions
Change 383079 had a related patch set uploaded (by DCausse; owner: DCausse):
[mediawiki/extensions/Translate@wmf/1.31.0-wmf.2] Revert "[tech-debt] Remove usage of FuzzyLikeThis in favor of simple fuzzy match"
Comment Actions
Change 383075 merged by jenkins-bot:
[mediawiki/extensions/Translate@master] Revert "[tech-debt] Remove usage of FuzzyLikeThis in favor of simple fuzzy match"
Comment Actions
Change 383084 had a related patch set uploaded (by DCausse; owner: DCausse):
[search/extra@master] Revert "Stop maintaining FuzzyLikeThis"
Comment Actions
Change 383084 merged by Gehel:
[search/extra@master] Revert "Stop maintaining FuzzyLikeThis"
Comment Actions
Change 383079 merged by jenkins-bot:
[mediawiki/extensions/Translate@wmf/1.31.0-wmf.2] Revert "[tech-debt] Remove usage of FuzzyLikeThis in favor of simple fuzzy match"
Comment Actions
Mentioned in SAL (#wikimedia-operations) [2017-10-09T13:53:01Z] <zfilipin@tin> Synchronized php-1.31.0-wmf.2/extensions/Translate/: SWAT: [[gerrit:383079|Revert "[tech-debt] Remove usage of FuzzyLikeThis in favor of simple fuzzy match" (T177727)]] (duration: 00m 57s)
Comment Actions
@Johan we reverted the change that caused the issue, I tested few french translations and it seemed to work again on long text, could you double-check on your side and close the task if the issue is resolved? Sorry for the inconvenience, next time I'll keep the current implementation in place so that we can experiment with new techniques without breaking production usage.