Investigate Ratio of First to Second Result Scores as a Confidence Measure
Open, NormalPublic

Description

Mentioned in "TextCat and Confidence" as a possible confidence measure, the ratio of first to second result scores was not investigated as part of the overall TextCat improvement.

The idea is that if the best score is x, then it is more likely to be correct if the second best score is x+50% than if the second best score is x+10%. The new config will require a gap of 6% (as less than that is too ambiguous to even consider).

This should be a quick test; if it turns out to be worthwhile, implementing it properly will be more work.

TJones created this task.Jan 18 2017, 9:47 PM

I've got too much on my plate right now, so I'm moving this back to the backlog.

debt lowered the priority of this task from High to Normal.Jan 24 2017, 6:26 PM

Moving to normal - we'll get to this soon.

TJones moved this task from Needs triage to Later on the Discovery-Search board.
TJones removed TJones as the assignee of this task.Jan 31 2017, 5:46 PM