Page MenuHomePhabricator

Data Reports (SDS 2.3.1): Plan first cycle of reporting and feedback
Closed, ResolvedPublic

Description

As part of SDS 2.3.1, we will test the following hypothesis: If we publicly publish one report aimed at a general audience, collect feedback, and iterate on the report based on the feedback, we can identify a template for accessible and transparent data reporting to use for our core metric areas.

As a first step, we will need to scope the project:

  • Complete SDS 2.3.1 hypothesis doc
  • Identify internal audience
  • Identify external/community audience
  • Determine minumum metrics to report
  • Determine dependencies
  • Determine timeline for reporting
  • Determine how we will collect feedback from Foundation staff and community members via surveys or interviews

Event Timeline

CMyrick-WMF renamed this task from Data Reports (SDS 2.3): Plan and implement first cycle of reporting and feedback to Data Reports (SDS 2.3): Plan first cycle of reporting and feedback.Jul 14 2023, 3:49 PM
CMyrick-WMF updated the task description. (Show Details)
CMyrick-WMF added subscribers: Miriam, leila.

Weekly Update:

Last week and this week, the primary focus here has been on finalizing logistics to get everything started.

  • Attended SDS 1.1 and SDS 2.3 kickoff meeting (last week)
  • Scheduled and attended meeting to finalize steering committee (this week)
    • Finalized steering committee
    • Began discussing timeline
  • Started Slack channel for our steering committee
  • Scheduled a sync with Desiree and Virginia to discuss support needs (for July 31)
  • Biweekly steering meetings have been scheduled by Mariya (to begin August 2)

Weekly Update:

  • Met with Desiree (SDS 2 Objective Owner)
  • Completed final draft of SDS 2.3 hypothesis doc
  • Steering Committee Kick-Off meeting
  • Solicited feedback on from steering committee (via Slack) on SDS 2.3 hypothesis doc

Weekly Update:

Weekly Update:

    • Biweekly Steering Committee meeting
      • Updated committee on sections of the SDS 2.3 hypothesis doc with new info learned
      • Sought feedback on meetings needed to set up: with Movement Insights, with Committee Relations/ External Comms
      • Determined who to meet with from Movement Insights and Committee Relations Specialists (with TODOs to set up those meetings)
  • Set up Movement Insights meeting
  • Set up Committee Relations meeting

Weekly Update:

  • Met with Movement Insights to sync on reporting, the hypothesis, and Core Annual Plan Metrics
  • Had follow-up meeting with Omari to discuss outstanding questions
    • Determined owners of all 4 Core Annual Plan Metrics

To Do

  • Sync with additional Core Annual Plan Metrics owners (in addition to Movement Insights, who I've already met with)
  • Determine timelines for metrics owners reporting to determine timeline for this hypothesis reporting

Weekly Update:

  • Biweekly Steering Committee meeting
  • Determined audience for internal report: general staff
  • Determined timeline for the internal report: internal report should be ready for distribution at each quarterly all-staff meeting (first, Nov)
  • Determined timelines for metrics owners reporting: one month preceding quarterly all-staff meetings (first, beginning of Oct)
  • Mapped the owners of the 4 Core Metrics that will be reported (at minimum) each quarter: see flowchart

Next week we will sync with Movement Comms to discuss details of the external report:

  • external audience(s)
  • medium(s) and/or mode(s) of report distribution
  • medium(s) and/or mode(s) of report feedback solicitation
CMyrick-WMF updated the task description. (Show Details)
CMyrick-WMF updated the task description. (Show Details)

Weekly Update:

  • Met with Movement Comms to discuss details of the external report:
    • external audience(s)
    • medium(s) and/or mode(s) of report distribution
    • medium(s) and/or mode(s) of report feedback solicitation
  • Will debrief and discuss Movement Comms feedback in steering committee next week
  • Updated hypothesis roadmap

Weekly Update:

  • Submitted T346160, requesting individual-Wikipedia-edition level breakdowns of the Content and Relevance metrics
  • Biweekly Steering Committee Meeting
    • Discussed learnings from meeting with Movement Comms
    • Discussed possibilities for what report could look like
    • Discussed phab request
  • Met with @Hghani, owner of phab request, to discuss details of the request
  • Omari will take on KR ownership on Sep 29

Weekly Update:

  • Met with Design Research.
    • DR will help with feedback solicitation and collection from Movement members, via surveying or focus groups. To take place between November and March.
    • Caroline will re-sync with DR in two weeks. Before or at the time of the re-sync, will provide the following:
      • Steering committee's decision on feedback solicitation medium (survey vs focus group)
      • List of specific users and user groups we'd like to solicit feedback from
      • Basic description of what the report will include
      • Language needs for feedback if desiring multilingual feedback
  • Worked with @Hghani on the details of the Phab T346160 request for additional Content and Relevance metric breakdowns
    • Determined format (and included variables) of datasets desired
    • Determined classification schema for gender categories
    • Determined possibilities and limitations with unique devices
  • Omari will own facilitation of the steering committee while Mariya is OOO Sep 22-Oct 3.
  • Omari will take on KR ownership on Sep 29.

Weekly Update:

Determined audiences

  • Internal: all staff
  • External: Movement members with an interest in our Core Metrics

Determined report mediums

  • Internal: 5 minute slide presentation during all-staff meeting; deck shared with staff after
  • External: meta page (possibly with a supporting mediums, e.g., Diff)

Determined feedback solicitation

  • Internal: survey, possibly with focus group to follow (+ feedback via questions/comments during meeting)
  • External: targeted survey (+ feedback on the talk page(s))
CMyrick-WMF renamed this task from Data Reports (SDS 2.3): Plan first cycle of reporting and feedback to Data Reports (SDS 2.3.1): Plan first cycle of reporting and feedback.Oct 2 2023, 12:40 PM
CMyrick-WMF updated the task description. (Show Details)