Weekly updates:

• Continued QA of Incubator data:
  • qa_incubator_queries_for_analysis.ipynb: QA notebook including detailed rationales about removals and non-removals
  • final_wrangle.ipynb: new notebook that does a final wrangle after/incorporating removals from the qa_incubator_queries_for_analysis.ipynb notebook
  • README: revised to incorporate the necessary order of operations for the scripts in the 02_wrangling_scripts folder; noted that final_wrangle.ipynb can be run in place of running the preceding notebooks individually
• Generated new visualizations in
  • both_current_and_grad_incubator_history_visualizations.ipynb
  • current_incubator_history_visualizations.ipynb
  • incubator_graduate_history_visualizations.ipynb
• Uploaded visualizations to commons
  • incorporated and summarised the uploaded visualizations in the new Incubator insights section of project page on meta-wiki

Weekly updates:

• Continued QA of the Incubator data
• Discussed peer review options with colleagues
• Working on summary of data transformations that occur in the language.ipynb notebook for peer review

Weekly updates:

QA of Incubator queries

• Worked on QA involving comparison of the results of my page counts and edits queries in incubator_queries_for_analysis.ipynb with those in the Incubator Dashboard.
• Learnings: If the following 3 changes are made to the Incubator Dashboard query), the page counts numbers will closely or exactly match those in my queries. (@KCVelaga_WMF, let me know if you'd like me to add those notes to T307147).
  1. Include missing months of data as 0 counts rather than excluded from 3-month-average calculations
  2. Use actor_name and user_name instead of actor_id and user_id when joining the actor and user tables (see suggested changes here)
  3. Omit redirects

Incubator project classifications

• Context: Per https://incubator.wikimedia.org/wiki/Incubator:Wikis
  • test wikis are are "substantial" if they have "at least 25 mainspace pages"
  • test wikis are "active" if they have "some active content creation since the beginning of 2023"
• Solution:
  • generated queries in incubator_queries_for_analysis.ipynb to classify Incubator projects as active and substantial, to use in analysis
  • outputs: incubator_substantial_projects.tsv and incubator_active_projects.tsv (QA needed)
  • plan(s): incorporate stats about active and substantial test wikis into the state_of_languages.ipynb notebook; facet by these classifications in current_incubator_history_visualizations.ipynb plots to see differences when implemented

Weekly updates:

• Added queries to incubator_queries_for_analysis.ipynb to generate lists of Active and Substantial Incubator projects, per https://incubator.wikimedia.org/wiki/Incubator:Wikis
  • Using those new lists, was able to do the following:
    • added additional incubator stats to state_of_languages.ipynb
    • generated both_current_and_grad_incubator_history_visualizations-active_substantial.ipynb: which is new version of both_current_and_grad_incubator_history_visualizations.ipynb filtering current Incubator projects for only active and substantial Incubator projects
    • generated current_incubator_history_visualizations-active_substantial.ipynb which is new version of current_incubator_history_visualizations.ipynb filtering current Incubator projects for only active and substantial Incubator projects

No major updates this week.

Weekly updates:

• Provided information and notes for WE 2.2 hypothesis description
• Met with Language Engineering and Product Analytics
• Worked on Language Community Meeting presentation (T364999)
• Continued QA
  • Continued consolidating code
  • Met with Movement Insights to discuss data sources and wrangling
  • Research team (subset) finished QA tasks that I asked for them to complete
  • Reran notebooks and continued implementing checks as well as manually addressing anomalies

No major update this week

Weekly updates:

• Provided updated (April) Incubator data to Srishti for Language Community Meeting presentation
• No additional updates this week

Weekly updates:

• @KCVelaga_WMF provided notebook feedback T366516
• Will implement changes next week
• Meetings next week to discuss measurement and selection for WE 2.2 hypothesis

Weekly updates:

• Began implementing notebook feedback T366516
• Met with KC to discuss notebook feedback and WE 2.2 hypothesis
• Met with Language team to discuss WE 2.2 hypothesis
• Continuing to explore Incubator data to better understand
  • the characteristics of the current projects in them
  • measurement possibilities
• Meeting with Language team next week to continue discussing measurement and selection

Weekly updates:

• Continued implementing notebook feedback T366516
• Met with KC to discuss WE 2.2 selection and measurement
• Met with Language team to continue discussing WE 2.2 selection and measurement
• Continuing to explore Incubator data to better understand
  • the characteristics of the current projects in them
  • measurement possibilities
• Next week: aim to finalize proposed criteria and measurement plan

Weekly updates: (similar to last week)

• Finished implementing notebook feedback T366516
• Discussed WE 2.2 selection and measurement ansycronously with KC
• Met with Language team to continue discussing WE 2.2.3 selection criteria
• Continuing to explore Incubator data to better understand
  • the characteristics of the current projects in them
  • measurement possibilities
• Next week: aim to finalize proposed criteria and measurement plan

Closing/resolving this ticket.

Related Q1 work will appear in a phab task specifically related to WE 2.2.3 hypothesis.