Page MenuHomePhabricator
Create Task
Maniphest T101041

Switch to using CirrusSearch's "morelike:" prefix for fetching Read More suggestions.
Closed, ResolvedPublic3 Estimated Story Points
Actions

Description

The CirrusSearch API provides a "morelike:" prefix that is specifically intended for retrieving similar articles. This would be an improvement over our current method of getting similar articles (a simple full-text search query).

https://www.mediawiki.org/wiki/Help:CirrusSearch#Special_prefixes

  • Add a feature flag to split users 50/50 for using the old method vs. the new.

The event logging schema (https://meta.wikimedia.org/wiki/Schema:MobileWikiAppArticleSuggestions) has been modified to include a "readMoreSource" parameter used for logging whether the old or new method was used (0=old, 1=new). Note that the "version" parameter was removed from the schema.

Details

SubjectRepoBranchLines +/-
Enable morelike Cirrus search for half of usersapps/android/wikipediamaster+60 -18
Customize query in gerrit

Related Objects

Event Timeline

Dbrant created this task.Jun 1 2015, 10:27 PM
Dbrant raised the priority of this task from to Needs Triage.
Dbrant updated the task description. (Show Details)
Dbrant added projects: Wikipedia-Android-App-Backlog, Wikipedia-iOS-App-Backlog.
Dbrant subscribed.
Restricted Application added a subscriber: Aklapper. · View Herald TranscriptJun 1 2015, 10:27 PM
• Fjalapeno moved this task from Needs Triage to Engineering Backlog on the Wikipedia-iOS-App-Backlog board.Jun 2 2015, 4:03 PM
• Fjalapeno moved this task from Engineering Backlog to Needs Prototype on the Wikipedia-iOS-App-Backlog board.
• Fjalapeno moved this task from Needs Prototype to Needs Acceptance Criteria on the Wikipedia-iOS-App-Backlog board.
• Fjalapeno moved this task from Needs Acceptance Criteria to Needs Estimation on the Wikipedia-iOS-App-Backlog board.
• Fjalapeno mentioned this in T95365: Disambiguation Pages should not appear in Read More.
Dbrant added a project: Mobile-App-Sprint-59-Android-Getting-the-Band-Back-Together.Jun 2 2015, 7:03 PM
Dbrant updated the task description. (Show Details)Jun 2 2015, 7:06 PM
Dbrant set Security to None.
Dbrant moved this task from Needs Triage to Next Sprint on the Wikipedia-Android-App-Backlog board.
• KLans_WMF added a project: Mobile-App-Sprint-59-iOS.Jun 2 2015, 8:37 PM
• bearND subscribed.Jun 2 2015, 11:52 PM

Feel free to fill out https://etherpad.wikimedia.org/p/morelike_vs_fulltext

• KLans_WMF edited a custom field.Jun 5 2015, 5:43 PM
• KLans_WMF removed projects: Mobile-App-Sprint-59-iOS, Wikipedia-iOS-App-Backlog.Jun 5 2015, 6:28 PM
• KLans_WMF moved this task from Next Sprint to Current Sprint on the Wikipedia-Android-App-Backlog board.Jun 12 2015, 6:07 PM
• Niedzielski claimed this task.Jun 15 2015, 5:36 PM
• Niedzielski moved this task from To Do to Doing on the Mobile-App-Sprint-59-Android-Getting-the-Band-Back-Together board.
Dbrant updated the task description. (Show Details)Jun 15 2015, 8:40 PM
gerritbot subscribed.Jun 17 2015, 6:23 PM

Change 218983 had a related patch set uploaded (by Niedzielski):
Enable morelike Cirrus search for half of users

https://gerrit.wikimedia.org/r/218983

gerritbot added a project: Patch-For-Review.Jun 17 2015, 6:23 PM
• Niedzielski moved this task from Doing to Code Review on the Mobile-App-Sprint-59-Android-Getting-the-Band-Back-Together board.Jun 17 2015, 6:43 PM
• Niedzielski added a comment.Jun 17 2015, 10:39 PM

Depends on T102881

• Mholloway subscribed.Jun 18 2015, 11:28 PM

I just noticed that the existing "read more" algorithm now includes main pages (and presumably disambiguation pages) again even though I thought we had that fixed in T95365. See, for example, the suggestions on "Panama-Pacific commemorative coins."

Here are the query results for that page: https://en.wikipedia.org/w/api.php?action=query&prop=pageterms|pageprops&ppprop=mainpage|disambiguation&wbptterms=description&generator=search&gsrsearch=Panama%E2%80%93Pacific_commemorative_coins&gsrnamespace=0&gsrwhat=text&gsrinfo=&gsrprop=redirecttitle&gsrlimit=5

• Mholloway added a comment.Jun 19 2015, 12:10 AM

Confirmed that disambiguation pages are back in the results as well. See "California State Route 57."

• Mholloway added a comment.Jun 19 2015, 3:30 AM

This seems to have resolved itself; the main page is no longer a result of the above query. I guess you can disregard.

Dbrant edited projects, added Mobile-App-Sprint-60-Android-Lightning-Round; removed Mobile-App-Sprint-59-Android-Getting-the-Band-Back-Together.Jun 22 2015, 6:57 PM
Dbrant moved this task from To Do to Code Review on the Mobile-App-Sprint-60-Android-Lightning-Round board.
• bearND moved this task from Code Review to QA Signoff on the Mobile-App-Sprint-60-Android-Lightning-Round board.Jun 24 2015, 12:06 AM
gerritbot added a comment.Jun 24 2015, 12:07 AM

Change 218983 merged by jenkins-bot:
Enable morelike Cirrus search for half of users

https://gerrit.wikimedia.org/r/218983

• bearND mentioned this in rAPAWffcc9f27c05e: Enable morelike Cirrus search for half of users.Jun 24 2015, 12:08 AM
• bearND mentioned this in T103788: Android Production Release 2.0.105.Jun 25 2015, 6:55 AM
Etonkovidova moved this task from QA Signoff to Ready for Signoff on the Mobile-App-Sprint-60-Android-Lightning-Round board.Jun 25 2015, 10:46 PM
Dbrant moved this task from Ready for Signoff to Done on the Mobile-App-Sprint-60-Android-Lightning-Round board.Jun 26 2015, 2:43 AM
Etonkovidova subscribed.Jun 26 2015, 4:23 PM

Checked on 2.0.103-alpha-2015-06-25 on Samsung Tablet Ce0168(Android 4.0.4 (and compared with iOS where "morelike:" prefix not implemented).

Good examples to check the following articles and see improvements in fetching relevant results in 'Read more':

  • Color
  • Broth
  • Moth
Dbrant closed this task as Resolved.Jul 7 2015, 7:20 PM
Dbrant moved this task from Current Sprint to Resolved/Invalid/Declined/Legacy on the Wikipedia-Android-App-Backlog board.Jul 7 2015, 7:22 PM
Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL