Page MenuHomePhabricator
Create Task
Maniphest T386254

Get feedback and do assessment of doc metrics test data
Closed, ResolvedPublic
Actions

Description

Work planned for Feb and March 2025:

  • User testing: Complete task-based testing of the metrics outputs to verify areas of confusion, utility, excellence, failure, etc. Discuss test outcomes with stakeholders.
  • Assessment: Summarize areas where the metrics appeared valid and useful, and make recommendations for next steps and future implementation work.

Related Objects
Search...

Event Timeline

TBurmeister created this task.Feb 12 2025, 7:07 PM
TBurmeister changed the task status from Open to In Progress.
TBurmeister triaged this task as Low priority.
TBurmeister mentioned this in T382606: Analyze and publish results of metrics testing.
TBurmeister moved this task from Backlog to In progress on the Tech-Docs-Team board.Feb 12 2025, 7:20 PM
TBurmeister added a comment.Feb 21 2025, 11:19 PM

Status update:

  • This week the Tech Docs team finished their testing and review of the metrics output. Based on their feedback, I heavily revised the User Guide and the Reference page. I wrote new content for both, to help people understand how to interpret the metrics scores and navigate the test data. Also updated the README.
  • Defined logistics of the testing process and prepared communication and instructions to be sent out next week (pending review).
  • Continued drafting and refining the test exercise scripts. Finalized all metrics-based and collection-based test scripts, just need to create two more control tests.
TBurmeister renamed this task from Get feedback and do user testing of doc metrics test data to Get feedback and do assessment of doc metrics test data.Mar 4 2025, 6:08 PM
TBurmeister updated the task description. (Show Details)
TBurmeister closed this task as Resolved.Mar 4 2025, 6:11 PM

Based on the testing of the experimental metrics with the tech docs team, I didn't want to put volunteers or other stakeholders through the pain of trying to interpret the very complex data, especially since initial results showed only a couple of the metrics were both useful and valid. So, I decided to complete the assessment based on our team's feedback. I wrote up my conclusions about the test metrics, and highlighted the shortfalls, opportunities, next steps et at: https://www.mediawiki.org/wiki/Wikimedia_Technical_Documentation_Team/Doc_metrics/Assessment.

TBurmeister moved this task from In progress to Done on the Tech-Docs-Team board.Mar 4 2025, 6:26 PM
TBurmeister mentioned this in T388141: Implement prototype for metrics calculations.Mar 6 2025, 3:42 PM
Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL · Credits