Page MenuHomePhabricator

Check Accuracy for lists
Open, Needs TriagePublic

Description

User Story: “As a PM, I want to investigate Data Accuracy metrics for lists, as a continuation of our Data Quality work. The methods of list coverage is to be defined and agreed on for MR, so that we can make informed steps on how to build up a larger testing and confidence framework to release MR features"

Context
Follow up from the section coverage work, where certain findings are related to list parsing. See MR Data Accuracy doc for specific details.

Acceptance criteria

The document must have the following sections:

  • A Description of sample set, ground truth and method proposed
  • Discuss the above with team to get alignment
  • Run and document the agreed method
  • Document analysis of lists to explain the numbers or known caveats

Things to consider**
Please refer to the parent ticket, "things to consider section". Refer to the`Metric Framework`infobox Accuracy method to see how the individualual items are scored and then averaged to get an overall Accuracy score