Page MenuHomePhabricator
Create Task
Maniphest T121616

EPIC: Resolve technical or product blockers to enable us to do a more full rollout of the completion suggester
Closed, ResolvedPublic
Actions

Description

Based on our data and qualitative feedback, the completion suggester is awesome! This is an epic to collect any technical blockers that remain and must be resolved before a more full rollout of the completion suggester can be performed. The completion suggester was deployed in a very barebones and early state for the beta feature, which was absolutely correct, but now we have the details to resolve.

Related Objects
Search...

StatusSubtypeAssignedTask
 Resolved• DeskanaT121616 EPIC: Resolve technical or product blockers to enable us to do a more full rollout of the completion suggester
 ResolvedSmalyshevT121430 Rework prefix search integration with core to provide completion suggester to users with the beta feature enabled
 ResolveddcausseT124071 Optimize completion suggester index creation
 DuplicatedcausseT120796 Integrate popularity score into completion suggester and full text search scoring
 ResolveddcausseT111120 Run load tests with the completion suggester in prod
 Resolved• DeskanaT124722 Decrease the weight of page views in search result ranking for the completion suggester
 Resolved• DeskanaT125112 Completion suggester should favor exact matches
 ResolvedEBernhardsonT125547 Use a dedicated pool counter for the CompletionSuggester
 Resolved• DeskanaT125602 EPIC: Significantly improve logging of completion suggester so that we have more data on how well it's working
 ResolvedEBernhardsonT125915 Implement logging schema AutocompleteSatisfaction for completion suggester
 ResolvedmpopovT125601 Define a way to measure user satisfaction of completion suggester
 ResolveddcausseT125671 Completion suggester: increase minimum prefix length from 0 to 1 for fuzzy queries
 Resolved• DeskanaT125669 Completion suggester: fine-tune thread pools
 ResolvedEBernhardsonT125667 Completion suggester: increase the number of replica for active wikis
 ResolveddcausseT127090 CompletionSuggester : add support for offsets
 ResolveddcausseT127182 Completion Suggester: index creation should not fail if a broken index exists
 ResolveddcausseT127216 CompletionSuggester Beta Feature broken on Hebrew Wikipedia
 ResolveddcausseT127287 Investigate the reason why hewiki_titlesuggest was empty
 ResolvedGehelT127322 Completion Suggester: make sure that the cronjob mediawiki::maintenance::cirrussearch is deployed to only one machine (terbium)
 ResolvedEBernhardsonT128774 Turn on completion suggester as default prefix search implementation on testwiki and test2wiki
 Resolved• DeskanaT128776 Gradually enable completion suggester as default prefix search algorithm on the remaining 12 wiki's March 16th
 ResolveddcausseT128775 Turn on completion suggester as default prefix search for all but the top 12 wiki's by query volume on March 10th

Event Timeline

• Deskana created this task.Dec 16 2015, 3:15 AM
• Deskana raised the priority of this task from to Medium.
• Deskana updated the task description. (Show Details)
• Deskana added projects: Discovery-ARCHIVED, Epic.
• Deskana subscribed.
Restricted Application added a subscriber: Aklapper. · View Herald TranscriptDec 16 2015, 3:15 AM
• Deskana renamed this task from EPIC: Support broader rollout of the completion suggester to EPIC: Support broader rollout of the completion suggester as a search mechanism for Wikipedia.Dec 16 2015, 3:15 AM
• Deskana moved this task from Needs triage to Product Epics on the Discovery-ARCHIVED board.
• Deskana set Security to None.
• Deskana added a subtask: T121430: Rework prefix search integration with core to provide completion suggester to users with the beta feature enabled.
• Deskana mentioned this in T116706: Bad search results when you don't include the preposition in your search query.Dec 30 2015, 9:41 PM
• Deskana mentioned this in T124325: EPIC: Resolve technical blockers to enable us to do a more full rollout of the completion suggester.Jan 21 2016, 6:54 PM
• Deskana updated the task description. (Show Details)
• Deskana renamed this task from EPIC: Support broader rollout of the completion suggester as a search mechanism for Wikipedia to EPIC: Resolve technical blockers to enable us to do a more full rollout of the completion suggester.Jan 21 2016, 7:05 PM
• Deskana updated the task description. (Show Details)
• Deskana updated the task description. (Show Details)
• ksmith subscribed.Jan 21 2016, 11:17 PM

Some related issues which may or may not be determined to be blockers:
T123014: Searching for a subpage title using the search bar at the top of the page (prefix) doesn't propose it for autocomplete
T123015: Completion Suggester: Searching for a subpage title using the search bar at the top of the page doesn't propose it for autocomplete
T123016: Completion Suggester: Searching for Gloss doesn't match the Glossary page
T122932: CompletionSuggester prefers perfect redirect match over near-perfect target match
T111122: Improve completion suggester score function (by using page views to affect rankings)

• Deskana added a subscriber: dcausse.Jan 21 2016, 11:35 PM

@dcausse When you get a chance, can you list any potential blockers that you're aware of here, like @ksmith did above? Then, as a team, we can make a determination what blocks us from moving forwards.

• Deskana added a subtask: T124071: Optimize completion suggester index creation.Jan 22 2016, 4:33 PM
• Deskana added a subtask: T120796: Integrate popularity score into completion suggester and full text search scoring.Jan 22 2016, 6:29 PM
• Deskana closed subtask T124071: Optimize completion suggester index creation as Resolved.Jan 23 2016, 4:00 AM
dcausse added a subtask: T111120: Run load tests with the completion suggester in prod.Jan 25 2016, 8:40 AM
• Deskana renamed this task from EPIC: Resolve technical blockers to enable us to do a more full rollout of the completion suggester to EPIC: Resolve technical or product blockers to enable us to do a more full rollout of the completion suggester.Jan 25 2016, 10:35 PM
• Deskana added a subtask: T124722: Decrease the weight of page views in search result ranking for the completion suggester.
• Deskana added a subtask: T125112: Completion suggester should favor exact matches.Jan 28 2016, 5:54 PM

I added T125112; we should evaluate whether this is possible, because it might help.

• Deskana closed subtask T125112: Completion suggester should favor exact matches as Resolved.Jan 28 2016, 9:47 PM
• Deskana closed subtask T124722: Decrease the weight of page views in search result ranking for the completion suggester as Resolved.Jan 28 2016, 9:53 PM
dcausse added a subtask: T125547: Use a dedicated pool counter for the CompletionSuggester.Feb 2 2016, 6:10 PM
• Deskana added a subtask: T125602: EPIC: Significantly improve logging of completion suggester so that we have more data on how well it's working.Feb 2 2016, 11:11 PM
CKoerner_WMF subscribed.Feb 2 2016, 11:14 PM
• Deskana closed subtask T125547: Use a dedicated pool counter for the CompletionSuggester as Resolved.Feb 3 2016, 4:20 AM
dcausse added subtasks: T125671: Completion suggester: increase minimum prefix length from 0 to 1 for fuzzy queries, T125669: Completion suggester: fine-tune thread pools, T125667: Completion suggester: increase the number of replica for active wikis.Feb 3 2016, 4:27 PM
• Deskana closed subtask T125671: Completion suggester: increase minimum prefix length from 0 to 1 for fuzzy queries as Resolved.Feb 3 2016, 6:19 PM
• Deskana closed subtask T111120: Run load tests with the completion suggester in prod as Resolved.Feb 3 2016, 6:25 PM
• Deskana closed subtask T121430: Rework prefix search integration with core to provide completion suggester to users with the beta feature enabled as Resolved.Feb 4 2016, 7:06 PM
• Deskana added a subtask: T125915: Implement logging schema AutocompleteSatisfaction for completion suggester.Feb 4 2016, 11:33 PM
• Deskana mentioned this in T125669: Completion suggester: fine-tune thread pools.Feb 9 2016, 11:09 PM
• Deskana mentioned this in T125667: Completion suggester: increase the number of replica for active wikis.
• Deskana closed subtask T125667: Completion suggester: increase the number of replica for active wikis as Resolved.Feb 11 2016, 11:23 PM
dcausse added a subtask: T127090: CompletionSuggester : add support for offsets.Feb 16 2016, 4:49 PM
dcausse added a subtask: T127182: Completion Suggester: index creation should not fail if a broken index exists.Feb 17 2016, 5:27 PM
• Deskana added a subtask: T127216: CompletionSuggester Beta Feature broken on Hebrew Wikipedia.Feb 17 2016, 7:20 PM
dcausse closed subtask T127216: CompletionSuggester Beta Feature broken on Hebrew Wikipedia as Resolved.Feb 17 2016, 10:07 PM
dcausse added subtasks: T127287: Investigate the reason why hewiki_titlesuggest was empty, T127322: Completion Suggester: make sure that the cronjob mediawiki::maintenance::cirrussearch is deployed to only one machine (terbium).Feb 18 2016, 3:41 PM
Etonkovidova mentioned this in T125984: Beta A/B test of new search auto-completion generator..Feb 19 2016, 10:39 PM
• Deskana closed subtask T127322: Completion Suggester: make sure that the cronjob mediawiki::maintenance::cirrussearch is deployed to only one machine (terbium) as Resolved.Feb 19 2016, 11:03 PM
• Deskana closed subtask T127287: Investigate the reason why hewiki_titlesuggest was empty as Resolved.Feb 24 2016, 7:10 PM
• Deskana closed subtask T127182: Completion Suggester: index creation should not fail if a broken index exists as Resolved.
• Deskana closed subtask T127090: CompletionSuggester : add support for offsets as Resolved.Feb 24 2016, 7:12 PM
• Deskana closed subtask T125915: Implement logging schema AutocompleteSatisfaction for completion suggester as Resolved.Mar 5 2016, 1:48 AM
• Deskana closed subtask T125602: EPIC: Significantly improve logging of completion suggester so that we have more data on how well it's working as Resolved.Mar 5 2016, 1:51 AM
• Deskana added subtasks: T128774: Turn on completion suggester as default prefix search implementation on testwiki and test2wiki, T128776: Gradually enable completion suggester as default prefix search algorithm on the remaining 12 wiki's March 16th, T128775: Turn on completion suggester as default prefix search for all but the top 12 wiki's by query volume on March 10th.Mar 5 2016, 2:09 AM
• Deskana mentioned this in T104468: EPIC: Improve spelling error detection and correction for search to fulfil Q1 2015-16 quarterly goal..Mar 5 2016, 2:15 AM
• Deskana closed subtask T128775: Turn on completion suggester as default prefix search for all but the top 12 wiki's by query volume on March 10th as Resolved.Mar 15 2016, 3:41 AM
• Deskana closed subtask T128774: Turn on completion suggester as default prefix search implementation on testwiki and test2wiki as Resolved.
• Deskana closed this task as Resolved.Mar 16 2016, 5:50 PM
• Deskana claimed this task.
• Deskana closed subtask T128776: Gradually enable completion suggester as default prefix search algorithm on the remaining 12 wiki's March 16th as Resolved.

Per the closing of T128776... it's aliiiiive! :-D

• Deskana closed subtask T125669: Completion suggester: fine-tune thread pools as Resolved.Mar 23 2016, 6:50 PM
Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL