Page MenuHomePhabricator

Data Reports (SDS 2.3.1): Execute first cycle of reporting and feedback
Closed, ResolvedPublic

Description

Hypothesis 2.3.1.
As part of SDS 2.3.1, we will test the following hypothesis: If we publicly publish one report aimed at a general audience, collect feedback, and iterate on the report based on the feedback, we can identify a template for accessible and transparent data reporting to use for our core metric areas.

Last quarter, we planned the first cycle of reporting and feedback (T341882).

This quarter, we will execute the first cycle of reporting and feedback:

For the internal report

  • Develop survey questions for staff
  • Prepare internal report (i.e. prepare slides for All Staff pres)
    • Content metric: numbers, forecasts, and visualizations will be provided by Movement Insights (T346345/T346362/T346364)
    • Relevance metric: numbers and visualizations will be provided by Movement Insights (part of usual monthly key metrics reporting)
    • Contributors metric: info will be provided by Core Experiences
    • Effectiveness metric: percentage will be provided by Finance and Admin
  • Solicit feedback from staff on internal report
  • Review staff feedback to help guide revisions for next internal report

For the external report

  • Develop survey questions for Movement members
    • Design Research to support this work
  • Draft external report (i.e., modify internal report for public audience)
  • Finalize report components for publication
  • Publish external repot --> moved to Q3 (T354689)

Event Timeline

CMyrick-WMF renamed this task from Data Reports (SDS 2.3.1): Execute first cycle of reporting and feedback to Data Reports (SDS 2.3): Execute first cycle of reporting and feedback.Oct 5 2023, 12:57 PM
CMyrick-WMF renamed this task from Data Reports (SDS 2.3): Execute first cycle of reporting and feedback to Data Reports (SDS 2.3.1): Execute first cycle of reporting and feedback.
CMyrick-WMF updated the task description. (Show Details)
CMyrick-WMF updated the task description. (Show Details)

Weekly Update:

Weekly update:

  • Continued drafting external report and began drafting internal report
  • Began writing data wrangling scripts in R to use for data tables and visualizations in internal and external reports
  • Steering Committee meeting this week
  • Received preliminary Q1 Content and Relevance data from Movement Insights, per T346160
  • Received support from Community Growth compiling ext. audience list (by Oct 20th)
  • Discussed surveying with Design Research

Looking ahead:

  • Will receive the following data by October 16
    • Effectiveness data from Finance/Admin
    • Contributor (intervention) info from Core Experience
    • Relevance data from Movement Insights
    • Content data excluding September data from Movement Insights
  • Will receive the following data by Oct 27
    • Content data including September data from Movement Insights

Weekly update:

  • Continued drafting external report, internal report, and wrangling scripts in R
  • Met with Design, will receive visualization support for ext. report; began workshopping viz ideas
  • Met with Design Research, drafted external survey
  • Received the following data
    • Effectiveness data from Finance/Admin
    • Contributor (intervention) info from Core Experience
    • Relevance data from Movement Insights
    • Content data excluding September data from Movement Insights

Looking ahead:

  • Will submit privacy policy form to Legal next week
  • Will finalize ext. survey and adapt for internal survey next week
  • Will receive input from Community Growth on ext. audience list by Oct 23
  • Will receive Content data including September data from Movement Insights by Oct 27

Weekly update:

  • Received Content data including September data from Movement Insights
  • Finished internal report (i.e. finished slides for All Staff pres)
  • Finished survey for staff; generated link and QR code
  • Finished drafting survey questions for public survey
  • Began drafting public survey in LimeSurvey
  • Finished getting privacy statement from Legal for public survey
  • Continued drafting external report; some revisions, updates, and visualizations still needed

Weekly update:

  • Presented the internal report at staff meeting
  • Solicited internal report feedback from staff
  • Continued drafting the external report
  • Visualizations: adapted for external report, with titles and captioning; uploaded to Commons

Weekly update:

  • Moved external report from Office (draft) to Meta-Wiki (draft)
    • Replaced placeholder visualizations with those uploaded to Commons
    • Incorporated feedback from Movement Comms
    • Incorporated feedback from Steering Committee
  • Determined date of external report publication: November 28
  • QuickSurvey requested (T351353) and test deployed
  • Finished programming survey in LimeSurvey

Weekly update:

  • Final revisions to report draft
  • Finalized plans with @RAdimer-WMF for Nov 28 publication of report
  • Received QuickSurvey updates from @DDeSouza via T351353
  • LimeSurvey testing

Weekly update:

  • Report publication delay
  • Discussing hypothesis strategy next week

Weekly update:
No major updates this week.

Weekly update:

Coordinating with Movement Comms to publish meta report in early January.

Weekly update:

  • Received, reviewed, and implemented suggested changes to the Q1 Report from Movement Comms
  • Closed QuickSurvey solicitation (T351353), as we will utilize the report's Discussion page for soliciting feedback from readers of the report, rather than a survey