Weekly update:

• pre-read deck preparation continues with target to share on Tuesday April 23 (pushed back target date due to illness this week).

Weekly update:

• no update this week

Weekly update:

• no update this week

Weekly update:

• Presentation to CPTO and Product Leadership group scheduled for May 1, Miriam to facilitate
• Draft deck preparation underway

Weekly update:

• Presented Global Readers Survey highlights during April 4 All-Staff Meeting

Weekly update:

• v1 follow-up survey approved and fielded

Weekly update:

• Draft deck prepared for All-Staff presentation on April 4

Weekly update:

• I've closed the project on Asana

Weekly update:

• Caroline met with the Community Growth eval team to discuss the state of Organizer Lab data pipelines (notes here)
• Yu-Ming and Caroline updated the v1 follow-up survey and shared a draft google forms survey for review

Weekly update:

• Caroline met with the Community Growth eval team to discuss the state of Organizer Lab data pipelines (notes here)
• Yu-Ming and Caroline updated the v1 follow-up survey and shared a draft google forms survey for review

Weekly update

• Pooled weighting completed
• Analysis and results presented to Foundation Level Metrics Committee meeting on March 21

Weekly updateL

• Leila has posted an updated (high-level) definition of essential metrics based on the work of the working group on Meta-Wiki
• I will continue to update with more detailed documentation and will plan to close the hypothesis on Asana next week (March 29)

Weekly update:

• Yu-Ming and Caroline met with the Community Growth eval team to discuss evaluation plans for v3 of the Organizer Lab
• Yu-Ming and Caroline met with Alex to iterate on the v1 follow-up survey with plans to share a draft with the Community Growth team early next week

Weekly update:

• Project-level weighting completed and visualization and analysis shared with Knowledge Gaps subteam for feedback
• Aligned with Isaac and Tanja on project-proportionate weighting plan (pooled data to be weighted next week)

Weekly update:

• Hypothesis has been formally accepted
• Leila plans to post high-level accepted hypothesis language on meta
• Yu-Ming to follow with documentation

No update this week

Weekly update:

• Unfortunately, weighting has been more time-consuming than expected and some methodological issues have been raised that I will bring to the GAP team meeting next Monday.
• Nonetheless, weighted data will be available no later than early next week and I don't anticipate any obstacles to presenting weighted data to the upcoming FLMC or All-Staff meetings.

Weekly update:

• cohort 2 course evaluation survey translated and fielded
• Yu-Ming and Caroline met with @Astinson to discuss cohort 1 follow up survey which will be shared next week for translation

Weekly update:

• presentation of readers research calendared for April all-staff meeting (4/4)
• weighted data should be available starting next week

Weekly update:

Weekly update:

• shared recommended revisions to language on metric in production with Leila
• Leila has approved the hypothesis and will share a formal writeup of criteria with @OSefu-WMF, @Mayakp.wiki , and @JAnstee_WMF

Weekly update:

• Cohort 2 course evaluation survey ready for translation

Weekly update:

• Revisions to cohort 2 course evaluation / cohort 1 survey underway
• translation to spanish and fielding anticipated next week

Weekly update:

• Shared high-level draft with Marcel and Virginia for input on what it means for metric to be in production

Weekly update:

• No update this week

Weekly update:

• Provided recommendations for @leila's proposal for essential metrics definition and governance
• Aligned on next steps for documentation and support for Movement Insights' SDS 1.1 work

Weekly update:

• Preliminary analysis shared as part of State of Research brief
• Continued work on data visualization and analysis
• @Isaac shared distributions that will enable data weighting

Weekly update:

Weekly update:

• Preliminary (unweighted) analysis shared with @Miriam
• Continuing analysis and visualization

Weekly update:

Weekly update:

• updates captured in posts by @Mayakp.wiki and @leila above

Weekly update:

• updated cohort 1 formal quantitative analysis accounting for blocking and pooling (and utilizing new data aggregation method) shared by @CMyrick-WMF and @YLiou_WMF with Rebecca Maung on Tuesday Jan 23 and @Astinson on Thursday Jan 25 along with relevant context and caveats

Weekly update: Analysis / preparation of visualization code continues and is on track for sharing preliminary insights by end of next week.

Update:

• survey data cleaning complete (T353843 for details)
• working on visualization code

Update:

• Proposal shared with KR owner (@leila)
• Retrospective conducted with core working group
• Decision by Leila on proposal expected no later than January 19, 2024

Update:

• Global readers survey collection closed on December 18. (T344393)
• Data cleaning and coding is underway and is expected to be completed in the first week of 2024 (T353843)
• Preliminary analysis of webrequest data by @Isaac on enwiki survey has begun and will continue (including all surveyed projects) in 2024.
• Project meta page has been updated with survey fielding details: https://meta.wikimedia.org/wiki/Research:Knowledge_Gaps_Index/Measurement/Readers_Survey_2023#Results

@DDeSouza we'd like to go ahead and undeploy all the remaining survey projects today!

@DDeSouza can we undeploy the following projects today (December 13) please?

• elwiki
• hewiki
• idwiki

@DDeSouza can we please undeploy the following projects today (December 11) as they've reached their target responses?

@DDeSouza can we please undeploy the following projects today (December 11) as they've reached their target responses?

Sorry for the misunderstanding! I do not have any updates in mind so please
go ahead and review with an eye towards decision making!

Update:

• Global readers survey data collection continues (currently planned to continue through December 15)

Update:

• Working meeting with core group to incorporate revisions from extended group session on November 30.
• Revised draft proposal shared with full core and extended group and Leila on December 8.
• Next steps: incorporating feedback from Leila and retro session with core group on December 13

Update:

• As detailed in T344393, global readers survey (non-english) launched on November 28
• Based on initial data collection November 28-29, surveys were relaunched November 29 at higher coverage for hiwiki, kowiki, elwiki, and idwiki
  • Note that we are continuing to face some challenges with hiwiki that may require further investigation: specifically, idiosyncratically low response rates among those clicking through from Quicksurvey

Update:

• Held Q&A session with extended group for feedback on draft decision making framework
  • Overall takeaways:
    • Broad alignment with draft framework, but desire for more specifics / concrete requirements for Essential metrics
      • For example: desire for pre-commitment by Essential metrics owners and end users (decision makers) to actions taken given an observed change or level in that metric
    • Concern that "Essential"-ness is in tension with annual planning cycle, push to separate Essential metrics from core annual plan metrics (specifically, the notion that Essential metrics are better understood as aligning with longer-term goals).
      • Related: concern that there not be an excessive number of Essential metrics in the interest of both continuity and limiting overall staff time devoted to Essential metrics proposals
• Next steps:
  • Incorporating extended group feedback into draft proposal during next core group meeting (December 6)
  • Revised draft proposal shared with extended group and Leila (December 8)

@DDeSouza unfortunately it looks like our response rates are lagging a bit for four projects in particular. Can we relaunch the following with increased coverage?

@DDeSouza can we up the coverage ratios for the rest of the readers survey projects tonight (November 28) as follows:
see coverage calculations in column M of https://docs.google.com/spreadsheets/d/1Z03-wFjIO29_6q9ycS4doZZoiVDylOamN54vdGFU3ng/edit#gid=0

• arwiki: 0.12355
• cswiki: 0.10000
• dewiki 0.05211
• elwiki: 0.06667
• eswiki: 0.06631
• fawiki: 0.02083
• frwiki: 0.09722
• hewiki: 0.08624
• hiwiki: 0.07500
• idwiki: 0.07500
• itwiki: 0.02500
• jawiki: 0.01579
• kowiki: 0.07500
• nlwiki: 0.07500
• plwiki: 0.07500
• ptwiki: 0.15000
• rowiki: 0.21110
• ruwiki: 0.01546
• trwiki: 0.07500
• ukwiki: 0.06445
• viwiki: 0.07500
• zhwiki: 0.07111

Update:

• Draft decision-making framework shared with extended group for feedback (November 22)
• Extended group feedback will be discussed on November 30

Update:

• enwiki global readers survey completed data collection on November 22!
• 9476 completes, 8898 18+ completes.

@DDeSouza we would like to undeploy the enwiki survey tomorrow evening (November 22, 2023)! This is to make sure that we are no longer collecting once the English fundraising campaign fully kicks off on the 28th.

Update:

• Extended group feedback session rescheduled from this week (November 16) to after Thanksgiving (November 30)
• Core team met to surface and resolve (where possible) outstanding questions in advance of draft shareout with extended group

Update:

• enwiki global readers survey launched this week at 2% coverage and is expected to complete data collection by November 23
• As of 4:31 PM on November 17, we have collected 4375 complete responses (16,118 surveys opened)
• the other 23 language versions will launch next week