Page MenuHomePhabricator
Create Task
Maniphest T216738

Reindex Korean-language wikis to enable Nori analyzer
Closed, ResolvedPublic
Actions

Description

In order to enable the new Korean analyzer (Nori) we need to reindex the Korean-language wikis.

However there are a few extra steps:

  • finish for the ES6 upgrade, so that Nori is available—T183282
  • disable LTR for Korean (the old model with the new analysis could do weird things)
  • do the reindexing

Related Objects
Search...

Event Timeline

TJones created this task.Feb 21 2019, 4:52 PM
TJones moved this task from needs triage to Language Stuff on the Discovery-Search board.
TJones mentioned this in T147505: [tracking] CirrusSearch: what is updated during re-indexing.
TJones renamed this task from Reindex Korean-language wikis to Reindex Korean-language wikis to enable Nori analyzer.Feb 21 2019, 4:54 PM
dcausse mentioned this in T219534: Test MLR models for zhwiki, jawiki and kowiki.Mar 28 2019, 4:45 PM
dcausse added a subtask: T219534: Test MLR models for zhwiki, jawiki and kowiki.
TJones closed this task as Resolved.Apr 10 2019, 3:15 PM

Korean got reindexed incidentally as part of the ES 6 upgrade: some of our previous configuration for spaceless languages was deprecated so we had to upgrade them to BM25, and reindex, which picked up the Nori changes for Korean.

Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL