Page MenuHomePhabricator
Create Task
Maniphest T133349

Plan release announcement for Discernatron, approx April 28th
Closed, ResolvedPublic
Actions

Description

Hoping to release the Discernatron (human judgment of search relevance) some time next week at https://discernatron.wmflabs.org. Anyways we should come up with some sort of plan to get some users onto the site and grading results for us. We plan to release a new set of 500 queries into it each month to be graded, and ideally we need each query graded by 10+ people.

For each query users will be provided the set of titles found by CirrusSearch, Bing, Google, and DuckDuckGo and asked to rank each title from 1 to 4, or leave the title unranked. We source up to 25 results per source, but due to duplicates there are probably 20 to 75 titles on each (not sure yet)

Possible avenues for getting users:

  • Village Pump Technical
  • Anywhere people have discussed how much search sucks
  • wikitech-l and discovery mailing lists
  • Moar?

Related Objects
Search...

Event Timeline

EBernhardson created this task.Apr 21 2016, 9:21 PM
Restricted Application added a subscriber: Aklapper. · View Herald TranscriptApr 21 2016, 9:21 PM
EBernhardson updated the task description. (Show Details)Apr 21 2016, 9:27 PM
• Deskana added a project: Discovery-ARCHIVED.Apr 21 2016, 10:03 PM
• Deskana triaged this task as Medium priority.Apr 21 2016, 10:08 PM
• Deskana added a subtask: T133359: Go over prose and user flow in Discernatron and make improvements to it.
• Deskana moved this task from needs triage to Up Next on the Discovery-Search board.
CKoerner_WMF claimed this task.Apr 21 2016, 10:45 PM
CKoerner_WMF added a subscriber: Ckoerner.
CKoerner_WMF removed a subscriber: Ckoerner.
CKoerner_WMF subscribed.
• Elitre subscribed.Apr 26 2016, 11:34 AM
CKoerner_WMF added a comment.May 2 2016, 9:50 PM

Draft here: https://meta.wikimedia.org/wiki/User:CKoerner_(WMF)/Work/Discernatron_Announcement

• Deskana subscribed.May 3 2016, 8:28 PM

Looks good. I think it'd be good to have a screenshot or something there to liven it up a little.

• Deskana added a comment.May 3 2016, 8:28 PM
In T133349#2257912, @CKoerner_WMF wrote:

Draft here: https://meta.wikimedia.org/wiki/User:CKoerner_(WMF)/Work/Discernatron_Announcement

This could use @EBernhardson's review, too.

EBernhardson added a comment.May 3 2016, 8:37 PM

I got the new oauth config so we can release with the better name, https://discernatron.wmflabs.org. Also made a tiny copy edit. Approved from my perspective.

EBernhardson updated the task description. (Show Details)May 3 2016, 8:38 PM
EBernhardson added a comment.May 9 2016, 4:13 PM

Everything looks to be in place now, anything blocking sending out a release announcement?

CKoerner_WMF added a comment.May 9 2016, 9:49 PM

Erik and I discussed this on IRC. Announcement sent to discovery-l and wikitech-l. Posted to Village Pump (technical) on English Wikipedia.

CKoerner_WMF closed this task as Resolved.May 9 2016, 9:50 PM
debt closed subtask T133359: Go over prose and user flow in Discernatron and make improvements to it as Resolved.Sep 1 2016, 8:43 PM
Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL