Change Details

User Story: “As a PM, I want to finish the Data Coverage document where the scope, methods and outcomes of coverage are defined and agreed on for MR, so that we have a shared understanding of what has been done, a way to gather insights and make informed steps on how to build up a larger testing and confidence framework for Abstracts" ** Prep work** Agree on the sample size **Acceptance criteria** The document must have the following sections: [] A Description for abstracts of how we get our sample sets, where we got them from (What dataset was used to determine the outcomes?) [] A Description for abstracts of what was used to test against (ground truth) [] An explanation for abstracts of what FN, FP, TN, TP means for each features with examples of the four quadrants to reach team understanding and agreement that confusion matrix works for all features. [] Run and document the agreed method on the test sample for Abstracts [] Document analysis of Abstracts to explain the numbers or known caveats (eg findings in Reference discrepancies). Translate it to the matrix [] Document must have all pending comments in Data Coverage document made until Feb 28th marked as resolved ** Things to consider** Please refer to the parent ticket, "things to consider section"

User Story: “As a PM, I want to finish the Data Coverage document where the scope, methods and outcomes of coverage are defined and agreed on for MR, so that we have a shared understanding of what has been done, a way to gather insights and make informed steps on how to build up a larger testing and confidence framework for Abstracts" ** Prep work** Agree on the sample size **Acceptance criteria** The document must have the following sections: [x] A Description for abstracts of how we get our sample sets, where we got them from (What dataset was used to determine the outcomes?) [x] A Description for abstracts of what was used to test against (ground truth) [x] An explanation for abstracts of what FN, FP, TN, TP means for each features with examples of the four quadrants to reach team understanding and agreement that confusion matrix works for all features. [x] Run and document the agreed method on the test sample for Abstracts [x] Document analysis of Abstracts to explain the numbers or known caveats (eg findings in Reference discrepancies). Translate it to the matrix [] Document must have all pending comments in Data Coverage document made until Feb 28th marked as resolved ** Things to consider** Please refer to the parent ticket, "things to consider section"

User Story: “As a PM, I want to finish the Data Coverage document where the scope, methods and outcomes of coverage are defined and agreed on for MR, so that we have a shared understanding of what has been done, a way to gather insights and make informed steps on how to build up a larger testing and confidence framework for Abstracts" ** Prep work** Agree on the sample size **Acceptance criteria** The document must have the following sections: [[x] A Description for abstracts of how we get our sample sets, where we got them from (What dataset was used to determine the outcomes?) [x] A Description for abstracts of what was used to test against (ground truth) [x] An explanation for abstracts of what FN, FP, TN, TP means for each features with examples of the four quadrants to reach team understanding and agreement that confusion matrix works for all features. [x] Run and document the agreed method on the test sample for Abstracts [x] Document analysis of Abstracts to explain the numbers or known caveats (eg findings in Reference discrepancies). Translate it to the matrix [] Document must have all pending comments in Data Coverage document made until Feb 28th marked as resolved ** Things to consider** Please refer to the parent ticket, "things to consider section"