Page MenuHomePhabricator
Create Task
Maniphest T174065

[FY 2017-18 Objective] Improve support for searching in multiple languages
Closed, InvalidPublic
Actions

Description

Improve support for multiple languages by researching and deploying new language analyzers as they make sense to individual language wikis.

Related Objects
Search...

StatusSubtypeAssignedTask
 InvalidNoneT174065 [FY 2017-18 Objective] Improve support for searching in multiple languages
 OpenNoneT154511 [Tracking] Research, test, and deploy new language analyzers
 ResolvedTJonesT154516 [Research spike, 4 hours] Research Polish language analysers
 ResolvedTJonesT154517 Test and analyse new Polish language analysers
 ResolvedEBernhardsonT158682 Deploy new Polish language analyser
ResolvedTJonesT155549 Create an ordered list of languages we want to find new analysers for
ResolvedTJonesT158202 [Research spike, 4 hours] Research Chinese language analyzers
 ResolvedTJonesT158203 Test and analyze new Chinese language analyzers
 ResolvedTJonesT163829 Enable BM25 for Chinese wikis
 ResolvedNoneT163832 Reindex Chinese wikis
 ResolvedTJonesT166722 Disable SmartCN for zh-hans
 ResolvedTJonesT160105 [Research spike, 4 hours] Research Ukrainian language analyzers
 ResolvedTJonesT160106 Test and analyze new Ukrainian language analyzers
 ResolvedEBernhardsonT162055 Deploy New Ukrainian Analyzer & Re-index Ukrainian Wikis
 ResolvedTJonesT162739 [Research spike, 4 hours] Research Hebrew language analyzers
 ResolvedTJonesT162741 Test and analyze new Hebrew language analyzers
 ResolvedGehelT167057 Deploy HebMorph Plugin to production
 ResolveddcausseT167058 Re-index Hebrew-language wikis
 ResolveddebtT71361 Search should normalize Niqqud diacritics in Hebrew characters
 ResolvedTJonesT166731 Test and analyze new Kuromoji Japanese language analyzer
 DeclinedTJonesT170423 Test and analyze Vietnamese language analyzer
 ResolvedTJonesT171516 Publish Language Analyzer Analysis Tools
 ResolvedTJonesT171652 Language Analysis Morphological Library Research Spike
 OpenNoneT178923 Review Japanese Morphological Libraries
 OpenNoneT178924 Review Vietnamese Morphological Libraries
 ResolvedTJonesT178925 Review Korean Morphological Libraries
 ResolvedTJonesT206874 Add Nori (Korean) configuration to AnalysisConfigBuilder
 ResolvedTJonesT216738 Reindex Korean-language wikis to enable Nori analyzer
 OpenNoneT219534 Test MLR models for zhwiki, jawiki and kowiki
 ResolvedTJonesT178926 Review Serbian Morphological Libraries
 ResolvedTJonesT183015 Create Serbian Elasticsearch Plugin/Analysis Chain Using Serbian Morphological Libraries
 ResolveddebtT189239 Deploy initial version of the extra-analysis plugin
 ResolveddebtT189265 Re-index Serbian Wikis
 ResolvedTJonesT196404 Re-Re-Index Serbian Wikis after refactored plugins are deployed
 ResolvedTJonesT192395 Create Croatian, Serbo-Croatian, and Bosnian Analysis Chains Using Serbian Morphological Libraries
 ResolvedTJonesT196658 Re-index Croatian, Serbo-Croatian, and Bosnian Wikis
 ResolvedTJonesT178928 Review Estonian Morphological Libraries
 ResolvedTJonesT178929 Review Slovak Morphological Libraries
 ResolvedTJonesT190815 Create Slovak Elasticsearch Plugin/Analysis Chain Using Slovak Stemming Algorithm
 ResolvedGehelT191543 Deploy updated search/extra plugin and search/extra-analysis-slovak plugin with Slovak Stemmer
 ResolvedTJonesT191544 Deploy the analysis config for the new Slovak stemmer
 ResolvedTJonesT191545 Re-index Slovak Wikis after analysis chain is deployed
 ResolvedTJonesT196780 Review Applying Indonesian Analysis Chain for Malay
 ResolvedTJonesT200204 Re-index Malay and Indonesian Wikis to use new unpacked analysis chain
 ResolvedTJonesT197240 Review Esperanto Morphological Libraries
 ResolvedTJonesT200099 Create Esperanto Elasticsearch Plugin Using Esperanto Morphological Libraries
 ResolvedTJonesT202173 Create Esperanto Analysis Chain using new Esperanto Plugin
 ResolvedTJonesT202662 Esperanto Stemmer Updates
 ResolvedTJonesT203005 Re-index Esperanto Wikis
 ResolvedTJonesT193734 Move Serbian language wikis from extra-analysis to extra-analysis-serbian plugin

Event Timeline

• EBjune created this task.Aug 24 2017, 6:40 PM
Restricted Application added a subscriber: Aklapper. · View Herald TranscriptAug 24 2017, 6:40 PM
• EBjune renamed this task from FY Objective 2: Improve support for searching in multiple languages to [FY 2017-18 Objective] Improve support for searching in multiple languages.Aug 24 2017, 6:43 PM
• EBjune triaged this task as Medium priority.Aug 24 2017, 6:57 PM
• EBjune added a project: Epic.
• EBjune added a subtask: T154511: [Tracking] Research, test, and deploy new language analyzers.Aug 31 2017, 4:43 PM
• EBjune edited projects, added Goal, Discovery-Search; removed Epic.Sep 15 2017, 11:15 PM
debt moved this task from needs triage to search-icebox on the Discovery-Search board.Sep 21 2017, 5:24 PM
Liuxinyu970226 subscribed.Oct 25 2017, 12:37 AM
TJones mentioned this in T191114: Implement personalized search for logged-in wiki users.Apr 6 2018, 4:05 PM
CBogen removed a project: Search-Platform-Programs.Oct 29 2020, 3:01 PM
Aklapper added a subscriber: CBogen.EditedOct 29 2020, 3:21 PM

@CBogen: I don't see why Search-Platform-Programs was removed from this task when this is/was a valid task under that very project tag?
(Though wondering if this task should remain open anyway; as it's seems to be about three years ago.) Both the same for T174064.

CBogen added a comment.Oct 29 2020, 3:25 PM

@Aklapper I archived the tag so I thought I should remove the tasks from it, since we're no longer using it. But you're right I should probably just close these tasks. Thanks!

CBogen closed this task as Invalid.Oct 29 2020, 3:26 PM
• MPhamWMF closed subtask T154511: [Tracking] Research, test, and deploy new language analyzers as Declined.Aug 1 2022, 9:22 PM
RhinosF1 reopened subtask T154511: [Tracking] Research, test, and deploy new language analyzers as Open.Aug 2 2022, 1:33 PM
Restricted Application added a subscriber: RhinosF1. · View Herald TranscriptAug 2 2022, 1:33 PM
Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL · Credits