Work planned for January 2025:
- Analyse the test data we generated in T379431
- Evaluate whether the doc characteristics we measured are useful as indicators of the metrics we care about
- Publish data and results of assessment
| TBurmeister | |
| Dec 20 2024, 5:30 PM |
| F58325103: final_output.csv | |
| Jan 31 2025, 6:33 PM |
Work planned for January 2025:
| Status | Subtype | Assigned | Task | ||
|---|---|---|---|---|---|
| Resolved | TBurmeister | T372099 [FY2024-25] WE6.1.2 Research available Documentation Metrics | |||
| Resolved | TBurmeister | T382606 Analyze and publish results of metrics testing |
Weekly status update:
Cleaned up and formatted test dataset. Identified and created benchmarks for some data elements, and revisited how to implement weights and scoring of individual elements for metrics computation. Completed 80% of analysis and report generation for aggregate statistics (for the entire test dataset). Next week: finish analysis/report for aggregate dataset and test metrics computation. Start on collection-level analysis and report generation.
Weekly status update:
Weekly status update:
Next week: Finish intitial analysis and discuss {F58325103}outcomes with Tech Docs team. Stretch: create a plan for gathering feedback from community and stakeholders.
A version of the metrics test output with an additional field indicating each pages's collection membership is now available at https://gitlab.wikimedia.org/repos/technical-documentation/doc-metrics-testing/-/blob/develop/data/full_output%20with%20collections.csv
I have now published comprehensive reference documentation covering the fields in our test dataset (the metrics input), and the fields in the metrics output: https://www.mediawiki.org/wiki/Wikimedia_Technical_Documentation_Team/Doc_metrics/Field_reference
Next week I will be working with the other technical writers to try out some persona-based testing of the metrics output, and writing a short-and-sweet user guide (see: draft). When that is done, we'll be ready to share all this work more widely and formally request feedback from the larger community and stakeholders.
Outcomes of the test and analysis of its results are published at: https://www.mediawiki.org/wiki/Wikimedia_Technical_Documentation_Team/Doc_metrics/v0.
Moving on to the testing and feedback phase, tracked in T386254.