Page MenuHomePhabricator

[MI 1] Reporting, Data Visualization, and Data Communications
Open, MediumPublic

Description

Epic task for Movement Insights Pillar 1

[MI 1.1] Deliver timely monthly and quarterly reporting on Core Metrics to the Foundation.

[MI 1.2] Provide metric updates to staff through 3 metric-focused presentations.

[MI 1.3] Identify and implement 2 improvements to existing metric reporting or visualization processes.

[MI 1.4] Curate a prioritized backlog of improvements to metric reporting and/or visualization processes

Related Objects

StatusSubtypeAssignedTask
OpenMayakp.wiki
OpenMayakp.wiki
ResolvedMayakp.wiki
ResolvedMayakp.wiki
InvalidNone
ResolvedJAnstee_WMF
ResolvedSpikeMayakp.wiki
ResolvedHghani
ResolvedKhantstop
ResolvedOSefu-WMF
ResolvedMayakp.wiki
ResolvedMayakp.wiki
ResolvedMayakp.wiki
ResolvedMayakp.wiki
ResolvedHghani
OpenMayakp.wiki
ResolvedMayakp.wiki
ResolvedMayakp.wiki
ResolvedMayakp.wiki
In ProgressMayakp.wiki
ResolvedMayakp.wiki
In ProgressNone
OpenNone
OpenNone
In ProgressMayakp.wiki
ResolvedMayakp.wiki
ResolvedMayakp.wiki
ResolvedMayakp.wiki
ResolvedMayakp.wiki
Openamastilovic
ResolvedJMonton-WMF
ResolvedAhoelzl
ResolvedBTullis
DuplicateNone
ResolvedNone
ResolvedJMonton-WMF
ResolvedJMonton-WMF
ResolvedJMonton-WMF
ResolvedJMonton-WMF
OpenJMonton-WMF
Resolvedamastilovic
Openamastilovic
ResolvedJMonton-WMF
OpenBTullis
OpenBTullis
ResolvedMayakp.wiki
OpenNone

Event Timeline

There are a very large number of changes, so older changes are hidden. Show Older Changes

Jul 12, 2024
Progress update for the week

  • Read thru 'How-to' Guide: Quarterly Core Metrics Reports
  • Met with Caroline and got a lot of information about metrics reporting including background documentation on past FY’s discussions on community feedback
  • Started planning for identifying stakeholders and solicit feedback from individuals/group on improving our reporting

What are your priorities for next week

  • Meet with Kate and Omari, who have laid a good foundation for the work previously done for metrics reporting, and build some ideas together.
  • External search engine referrer pageviews analysis

Any emerging blockers or risks ? or unresolved dependencies?

  • no

Have there been any new learnings?

  • Yes! Lots of learnings and takeaways from the last 3 quarters of core metrics reporting, things we would like to stop and things we would like to do more of.

Have there been any changes to the scope or timeline?

  • no

Are you working on anything else that is not captured in any other reports?

  • Provided feedback for Essential metric documentation
  • Helped in finalizing the last Asana report for WE 1.3

Progress update for the week

  • Met with Omari and Kate this week to understand their takeways and learnings from last year’s SDS 1.4 work, and opportunities for improvement. Mapped the information gathered from them and made action items to focus on next steps.
  • Monthly reporting - reviewed the summary for publishing
  • Quarterly reporting
  • Followed up with PMs and folks to collect information about initiatives that may have impacted Q4 high level metrics
  • Created a summary of the Q4 Contributors metric initiatives

What are your priorities for next week

  • Add Q4 metric initiatives and Finalize Quarterly metrics reporting
  • Planning and reaching out for Infographics POC
  • Planning for focus group and reaching out to stakeholders
  • OOO 7/25 and 7/26

Any emerging blockers or risks ? or unresolved dependencies?

  • no

Have there been any new learnings?

  • Yes. learnings on what narrative driven metric report could look like.

Have there been any changes to the scope or timeline?

  • no

Are you working on anything else that is not captured in any other reports?

Jul 26, 2024
Progress update for the week

  • Quarterly reporting
    • Followed up with PMs and folks to collect information about initiatives that may have impacted Q4 high level metrics
    • Summarized Q4 Content gap and Relevance metric initiatives
  • Slow progress this week as Ive been OOO most of this week.

What are your priorities for next week

  • Reach out and make connections with folks that I gathered from my initial discussions with Caroline,Omari and Kate

Any emerging blockers or risks ? or unresolved dependencies?

  • no

Have there been any new learnings?

  • Yes we’re looking into the possibility of connecting dots outside of P&T to be able to incorporate them into monthly metrics updates

Have there been any changes to the scope or timeline?

  • no

Are you working on anything else that is not captured in any other reports?

  • No

Aug 2, 2024
Progress update for the week

  • Quarterly Reporting
    • Reviewed and Summarized Q4 Content gap and Relevance metric initiatives
    • Discussed QLS and Annual plan metrics presentation plan with Selena, Amanda, Kate and Omari
    • Temporary Accounts Initiative - discussed internally with the team and communicated decisions on data changes needed for the project to the data engineering team
  • Slow progress this week as Ive been OOO most of this week.

What are your priorities for next week

  • Reach out and make connections with folks that I gathered from my initial discussions with Caroline,Omari and Kate
  • Deliver Q4 report for publishing on meta

Any emerging blockers or risks ? or unresolved dependencies?

  • no

Have there been any new learnings?

  • Yes we’re looking into the possibility of connecting dots outside of P&T to be able to incorporate them into monthly metrics updates

Have there been any changes to the scope or timeline?

  • no

Are you working on anything else that is not captured in any other reports?

  • no

Aug 9, 2024
Progress update for the week

  • Reviewed the Q4 quarterly report with Caroline Myrick.
  • Started editing it on the Sandbox
  • Reached out to folks, with additional questions about the quarterly report.

What are your priorities for next week

  • Apply for schengen visa
  • Calculate July monthly metrics

Any emerging blockers or risks ? or unresolved dependencies?

  • no

Have there been any new learnings?

  • no

Have there been any changes to the scope or timeline?

  • no

Are you working on anything else that is not captured in any other reports?

  • No

Aug 16, 2024
Progress update for the week

  • Calculated July metrics and started analysis and information gathering for narrative
  • Continued editing the Q4 quarterly metrics on the Sandbox

Aug 23, 2024
Progress update for the week

Sep 13, 2024
Progress update for the week

  • Continued to brainstorm ideas for the offsite, albeit with a slight setback. Need to look for a new partner to pair on the data physicallization presentation.
  • Started looking into unique devices issue (T373630) and met with Dan to decode some hypotheses for the rise in unique devices. Also connected with Erica to work on the Fundraising Banner Impressions (T374655)
  • Data Governance Council - brought up important updates on Edge Uniques and its impact, temporary accounts initiative and impact analysis on pilot wikis.
  • Offsite : Schengen Visa appointment prep

What are your priorities for next week

  • Meet with Fundraising team on 9/18 to discuss banner impression trends and correlate with unique devices issue
  • Connect with nino on insights for August 2024 metrics

Sep 27, 2024
Progress update for the week

  • Deep dive into Unique devices analysis T373630: looked at automated heuristics and actors who contributed to the rise in unique devices these past months
  • Met with Dan, to debug our logic around redirect requests
  • Started drafting the unique devices investigation
  • Met with Claudia to brainstorm on the offsite presentation

What are your priorities for next week

  • Brainstorming ideas for offsite presentation - data physicalization
  • Complete the investigation documentation

Oct 4, 2024

Progress update for the week

What are your priorities for next week

  • Data governance council meeting
  • Fundraising banner impression issue T374655
  • Meet with DPE to modify the automata logic T376196
  • OOO on Oct 9

Any emerging blockers or risks ? or unresolved dependencies?

  • Dependent on DPE for Unique devices correction: contingent on automata logic correction impact analysis and implementation

Oct 18, 2024
Progress update for the week

  • Met with DPE to get update on changes to automata logic to include redirects. Implementation planned for Nov 1 T376196
  • Discussed new modification to automata logic with Joseph and escalated the request T377257
  • Q1 Reporting T375941
    • Reached out to PMs and PgMs to understand Q1 reporting and decisions were made on who would work on the Q1 QLS
    • Connected with Lauren to set expectations and next steps
  • RDS Offsite T377634
    • Met with Claudia to discuss challenges with representing time in the data viz
    • Worked on project proposal and added
  • EU Unique devices T377517
    • Started pulling unique devices numbers for Feb - July 2024
    • attended the Technical workshop for the draft delegated regulation by the EU commission and represented WMF

Oct 25, 2024
Progress update for the week

  • RDS Offsite T377634
    • Received approval for the session from the planning committee!
    • Met with Claudia to finalize format and goal, and started working on draft presentation
  • EU Unique devices T377517
    • Sent the revised unique devices for Feb - July 2024
    • Uploaded latest notebook
  • Temp accounts
    • Verifying workaround for pilot wiki rollout T374148 and handling editors movement metrics
  • Movement metrics
    • Supported Lauren with Q1 Quarterly Learning Slides
    • Published monthly movement report
    • Coordinated issue with Dumps1.0 and delays in content gap metrics

What are your priorities for next week

  • Meet with DPE to decide impact of not supporting dumps1.0
  • Complete draft of offsite presentation and a few do dry runs
  • OOO Oct 31 - Diwali and Halloween :)
  • Get monthly reports feedback from folks who refer to the metrics frequently

Any emerging blockers or risks ? or unresolved dependencies?

  • Unique devices counts may still be impacted until we prioritize T377257

Nov 8, 2024 and Nov 15, 2024
Progress update for the week

  • Curated a backlog of improvements to consider for prioritization T378669
  • Reached out to over 20 staff members who engage with the monthly metrics published on Slack, to get their feedback on what could be improved.
  • Attended RDS Offsite remotely
    • Team day and Bridges-Islands
    • Play doh viz was a success! T377634

Week of Nov 22, 2024, Nov 29, 2024, Dec 6, 2024

  • Thanksgiving break (Nov 26-29)

Progress update

  • October Monthly metrics run T378228
    • Pair with Kadeem and run the notebook
    • Exploring wiki of the month
    • Published the october monthly metrics and updated the repo for content gap metrics and YoY highlight changes
  • Met with Ana Eira, from movement comms team to talk about the metrics reports and sharing them out to the public
  • Exploring wiki of the month !
  • Unique devices correction: met with Hamid and discussed approach
  • Reviewed contributor metrics charts on Miro and provided feedback
  • Participated in Q3-Q4 planning

Dec 13, 2024
Progress update for the week

  • Wiki of the month - looked into uzbek wikipedia T381712
  • Reached out to Nino to get Brand Health metrics data to incorporate into monthly metrics
  • Q3 planning -
    • worked on creating a rough plan on focus areas discussed with Omari
    • Reached out to Zack McCune and the Comms team to collaborate on developing summary infographics for internal metric reporting T356522
  • Data governance council meeting
  • Provided input on T382066 via Slack
  • EU DSA - research project on user counting

Feb 21, 2025
Progress update for the week

  • Back from vacation - catching up on Communication - Slack and email

Summary Infographic

  • Worked on condensing the excellent ideas provided by @Khantstop in Movement Insights Infographic Design Shaping Feb '25 to this Miro board https://miro.com/app/board/uXjVLwTYpZA=/
    • This will serve as requirement doc for the Brand team in our upcoming discussions
  • Followed up on action items that we planned before going on leave

What are your priorities for next week

  • Meet with Omari
  • Q2 ITC write up
  • Submit session proposal for WM Connect 2025

Feb 28, 2025
Progress update for the week

  • Reviewed Shutting down the movement metrics Superset dashboards and discussed approach in the team meeting
  • Completed Self reflection for FY24-25 Cycle 1 ITC
  • Participated in the Brooklyn Data discussion for improving Contributors metrics
  • Retrospective meeting for Unique devices data issue

Mar 14, 2025
Progress update for the week

  • Metrics Infographics - Provided metrics, and reusable icons to the Brand team, and created a template skeleton,
  • Revised cycle 1 ITC
  • MI data modeling
    • Reached out to users on working-with-data about superset metrics dashboard usage, and responded to a user with further questions.
  • Submitted 2 proposals for WM Connect

Mar 21, 2025
Progress update for the week

  • MI-1 pillar
    • Prepared a detailed vision board of things to execute in the MI-1pillar for this FY cycle
    • Tried out Quarto for experimenting with metrics reporting layout.
  • Infographics
    • Received timeline from Brand team on next steps and collaboration
  • Data governance council

Mar 28, 2025
Progress update for the week

  • Made a sample Quarto output for experimenting with new metrics reporting layout.
  • Met with Velir/Brooklyn data for discussion on improving data pipelines
  • Did some follow up on wikifunctions unique devices issue - T364872
  • Project planning for 2 projects - external trends report and Centralize monthly metrics report creation and publication T390335

Apr 4, 2025
Progress update for the week

  • T359599 Metrics Infographic - reviewed the Infographic w/Kadeem and provided feedback and suggestions to the Brand team
  • External Trends: Met with Kate and exchanged ideas on the report and planned next steps
  • T390335 - Met with Neil, reviewed the work in progress quarto notebook and outputs. Modified the notebook to remove embedding and pulling charts from the charts folder.

Apr 11, 2025
Progress update for the week

  • Legal request: Paired with Hamid and posted finding on special page analysis T390785
  • Started IDEOU course
  • Met with Kate and drafted the External Trends Expansion strategy brief
  • Formatted the Quarto notebook for monthly metrics T390335
  • Met with Kadeem and planned content for Q3 Infographic

Apr 18, 2025
Progress update for the week

  • Legal request: Posted findings on special page analysis and shared UK wikipedia unique users on the Asana task T390785
  • Discussed Global Trends Expansion strategy brief with FLMC for initial feedback
  • Created Quarto notebook for monthly metrics T390335 version 1 and presented it to the team
  • Met with Kadeem and planned content for Q3 Infographic T359599

Apr 25, 2025
Progress update for the week

  • Q3 Metrics Infographic T359599
  • Added content for Contributors topic and summarized AI strategy brief and the developer satisfaction survey
  • Closed: Legal request T390785#10768933
  • IDEOU course - submitted challenge and Lesson 1 in progress
  • Found a discrepancy in the pageview data and consequently looked into replacing pageview_corrected with pageview_hourly query in the movement-metrics repo T392739

May 2, 2025
Progress update for the week

  • Q3 Metrics Infographic - reviewed first draft with the team for feedback T359599
  • Global Trends report project brief T393221
  • IDEOU course and challenge submission

May 9, 2025
Progress update for the week

  • Q3 Metrics Infographic T359599
  • Met with Maryana P to discuss Global Trends report project brief T393221
  • Legal request: UK and EU editors and unique devices T393729
  • IDEOU course - prototype assignment

May 16, 2025
Progress update for the week

  • Legal request: UK and EU editors and unique devices additional metrics T393729
  • IDEOU course and challenge submission
  • Reviewed Q3 Metrics Infographic T359599 with the team and incorporated feedback
  • Posted april monthly metrics
  • Mid year Global trends T393221

May 23, 2025
Progress update for the week

  • Closed out Metrics Infographic T359599
  • Hosted Wiki Workshop session on wikidata tools
  • Global Trends expansion T393221
    • created project plan, roadmap
    • Continued data collection
    • Started evaluation of mid year trends

May 23, 2025
Progress update for the week

  • Met with Kate and Maryana and Worked on evaluation of 2025 global trends T393221
  • Created a monthly report sample using Quarto T390335

Jun 6, 2025
Progress update for the week

  • Met with Kate and Maryana and Worked on evaluation of 2025 global trends T393221
  • Investigated Reader metrics increase T369226 with Hamid
  • Created a monthly report sample using Quarto T390335

Jun 13, 2025
Progress update for the week

  • Outlier Conference 2025
  • Reader metric investigation T395934
  • Global Trends expansion T393221

Jun 20, 2025
Progress update for the week

Jun 27, 2025
Progress update for the week

  • T393221 Shared draft deck with stakeholders and Updated the mid year trends based on feedback
  • T395934 Met with DPE to get updates on proposed fix and backfill timelines
  • T394344 published May monthly metrics

Jul 11, 2025
Progress update for the week

  • Completed FY2425 Cycle 2 ITC
  • Completed Mid year trends - final review. Wrap up next week
  • Made decision on EU DSA unique devices for latest snapshot
  • Continued FY2526 planning

Jul 18, 2025
Progress update for the week

  • Brainstormed ideas for FY2526 planning
  • Mid year trends - delivered T393221
  • June metrics analysis - Quarto report and Communication Draft
  • EU DSA unique devices T384088

Jul 25, 2025
Progress update for the week

  • Finalized ideas for FY2526 work plan
  • Mid year trends - made few changes based on feedback T393221
  • June metrics - published Quarto report, made code changes to the repo and drafted announcement T390335
  • Provided EU DSA unique devices T384088

Aug 1, 2025
Progress update for the week

  • June Quarto report - Announced!
    • Made few more code changes and documented the process T390335
  • Performed Data QA for new changes and fix for T395934
  • Mid year trends - run through preparations T393221
  • Continued building FY2526 roadmap and tasks

Aug 7, 2025
Progress update for the week

  • Started initial work planning for Overhauling metric catalogue T379904
  • Reader metric fix T395934
    • Continued Data QA and looked for false positive IPs
    • discussions with Marcel and Hamid
  • Spoke with Valentine for evaluating data loss T401246
  • Started looking into deprecating superset metrics dashboards. Spoke with Ben to know options on disabling vs deleting T359700

Aug 22, 2025
Progress update for the week

  • Started Experiment with improving Data_glossary page and creating mock-ups T402576
  • Calculated unique visitors to the new Quarto report
  • Analyzed test data for Reader metric fix T395934
  • Closed out haproxy data loss impact T401246

Aug 29, 2025
Progress update for the week

  • Deprecated superset metrics dashboards T359700
  • Created brainstorming plan for Movement metrics reporting improvements T369225
  • Analyzed test results with Hamid and Approved reader metric fix for deployment T395934
  • Analyzed access_method and domain removal changes for unique devices T401666

Sep 5, 2025
Progress update for the week

  • Generated July metrics T402060
  • Did Stakeholder mapping with Jaime and Megan; and planned for PM meeting for Contributors Metrics - Reporting and Operationalization T403305
  • Did a Brainstorming session for Movement metrics report improvements and collected a good backlog of ideas and improvements T369225

Sep 12, 2025
Progress update for the week

  • Published July metrics report T402060
  • Met with product managers to gather requirements and made user stories. Started scripting first few simple queries to test out T403305
  • Met with Guilherme to consider using DBT T403305
  • Discussed with the team about adding new category for wiki project T404401

Sep 19, 2025
Progress update for the week

  • Prototyped the Contributors metrics on Superset - Retained Editors by wiki and access method (example chart), and Account Registrations by wiki and access method (sample chart) T403305
  • Met with Andreas to request prioritzing DBT implementation; and met with Fundraising team to learn about their experience with DBT in FR-analytics
  • Met with Jaime to continue building a measurement strategy for WE 5 Infrastructure Re use objective

Progress update for the week

  • Prepared and Presented the Mid year global trends to department leadership
  • Created the Contributors Metric dashboard T403305
    • Added retained newcomers and activations data
  • Did some WE5 metric modeling with Jaime
  • Met with Comms team for updating the public comms stats

Oct 3, 2025
Progress update for the week

  • Met with MI team and Omari to review Contributors dashboard and continue iterating
  • Contributors dashboard prototype with 4 MVP metrics is available here - https://superset.wikimedia.org/superset/dashboard/p/xn8BnA4vzYy/
  • Global trends mid year check in - discussed sharing with P&T and reached out to some collaborators
  • August metrics: Shared the monthly report and provided retained newcomer data for Commons & Wikidata split to Marshall

week of Oct 10 - OOO - no update