Page MenuHomePhabricator

Investigate Ratio of First to Second Result Scores as a Confidence Measure
Closed, DeclinedPublic


Mentioned in "TextCat and Confidence" as a possible confidence measure, the ratio of first to second result scores was not investigated as part of the overall TextCat improvement.

The idea is that if the best score is x, then it is more likely to be correct if the second best score is x+50% than if the second best score is x+10%. The new config will require a gap of 6% (as less than that is too ambiguous to even consider).

This should be a quick test; if it turns out to be worthwhile, implementing it properly will be more work.

Event Timeline

TJones created this task.Jan 18 2017, 9:47 PM

I've got too much on my plate right now, so I'm moving this back to the backlog.

debt lowered the priority of this task from High to Medium.Jan 24 2017, 6:26 PM

Moving to normal - we'll get to this soon.

TJones removed TJones as the assignee of this task.Jan 31 2017, 5:46 PM
TJones closed this task as Declined.Jan 30 2019, 10:54 PM