Page MenuHomePhabricator

Support Designers and Design Researchers with Research Operations
Open, In Progress, HighPublic

Description

  • Support prioritized ad hoc research ops tasks and requests that come in throughout the quarter

Details

Due Date
Dec 31 2025, 8:00 AM

Event Timeline

  • Started working with Olga to set up operations for multilingual interviews and a survey for Edit Patrol feedback. There is a need for interpretation, so I began looking for new interpretation companies since our contract expired with our last service.
  • I provided outreach messaging for the project, a workflow, worked on a glossary, and advised on a translation request.
  • I wrote the contract terms for 3 contractors, and coordinated their hiring. I submitted the dev's contract request.
  • I submitted a BAR for the renewal of Calendly.
  • Obtained translations for iOS Year in Review prototype.
Bethany set Due Date to Mar 31 2025, 7:00 AM.Jan 10 2025, 11:38 PM
Bethany changed the task status from Open to In Progress.Jan 17 2025, 9:01 PM
Bethany triaged this task as High priority.

Helped developed communications and managed translations for Android research
More assistance on 2 UXR contracts
Met with two other language services companies

Began my conversations with Designers to hear about their participant recruitment needs
Obtained translations for Edit Patrol survey

Obtaining translations for ModTools Recent Changes survey
2 BARs for language service companies
began preparing short prez to explain changes to translations for upcoming D/DR meetup
met with Userlytics account rep to discuss our contract renewal (April)
organized Knowledge Repo working session with DR team

Met with Jahnavi to discuss research ops support for Collaborative Translations
Created recruitment materials for Collab Translations and ToolForge Feedback
created coordination plans for the aforementioned projects
Attended two demos for user research products
Submitted BAR for Japanese vendor for Barriers to Editing on iOS
fulfilled more translation requests for Design team members

materials development, recruitment, incentives, translation, and re-ops support for several projects: Flagged revisions, collaborative translation, edit patrol, toolforge feedback, alt-text project with a member of the external research community

Various supports to both DR contractors this week with their projects, including several meetings with them
Translations for Wishlist
Incentives/participant management for Toolforge Feedback, Barriers to Editing on iOS, FlaggedRevisions, Collab Translation
Userlytics renewal, setting up UL demo for D/DR team, planning a UL lead workshop, and exploring a UX consulting project

Translations for Automoderator and iOS app research
Incentives/participant management for Toolforge Feedback, iOS app research, FlaggedRevisions, Collab Translation, Wishlist
Interpretation for Collab Translations
Joy and I are engaged with Userlytics for a consulting project

Incentives/participant management for Toolforge Feedback, iOS app research, FlaggedRevisions, Collab Translation, Wishlist
Userlytics contract renewal
began testing out lookback.io capabilities

Incentives, release form tracking, and participant management for iOS app research, Collab Translation, Wishlist, and Commons Query Service
Hosted Userlytics demo with the D/DR team and did some followup
Attended a demo with Toluna and am currently trying to understand its costs and capabilities
Closed out the LimeSurvey theme task with Daniel and Tanja

leila changed Due Date from Mar 31 2025, 7:00 AM to May 30 2025, 7:00 AM.
leila moved this task from In Progress to FY2024-25-Research-April-June on the Research board.
leila edited projects, added: Research (FY2024-25-Research-April-June); removed: Research.
leila subscribed.

Thanks for the work in the previous quarter. I'm repurposing this task for this quarter's work.

Demo with SurveyMonkey
Translations for Apps team, obtaining translation reviews
re-ops support for WF post launch usability testing
working with Bárbara to replace images on Design Strategy website

Discussed the Deep Readers project with Tara and developed a strategy for recruitment.
Working on a recruitment strategy and program for Apps Ambassadors with Amal
Preparing for quick survey recruitment drive for the participant database.
DR budget planning for the next FY
Followed up with SurveyMonkey- many on their team are OOO for Easter break so things are moving slowly.
Progress on updating user interview processes to include minors, working with Legal and Human Rights groups.

Deployed a recruitment quicksurvey on en.wiki; monitored incoming responses
Onboarding Debra to the research ops and team processes
Created a flyer and prepared for an in-person recruitment drive at the Hackathon
Continued working with Bárbara on updating Des Strat website images
Heard back from SurveyMonkey and did some followup, arranged for Tanja and/or Mike to get access to test the platform via FT team
Translations for two teams

Monitoring en.wiki participant recruitment drive and working on the updates/maintenance to the database
Onboarding Debra to the research ops and team processes
SurveyMonkey exploration and coordination with Tanja and Mike
Continuity planning for my sabbatical; creating instructions and documentation
Supported Deep Readers project with recruitment strategy, messaging, planning, and more.
Supported Jahnavi's project with materials and translation.
Translations for Apps experiment
Conversation about specialized recruitment with Katie; started creating plan and materials.

Ended the en.wiki participant recruitment drive after 5255 sign ups.
Continued onboarding Debra to re-ops and team processes
SurveyMonkey evaluation and recommendation [private link]
Coordinated mod testing training with Userlytics for Design team
Wrote an RFP for an external research partner for Deep Reading
Supported with recruitment and various re-ops: Deep Reading, Wikifunctions Dagbani testing, Central Contribs for Mods
Presented continuity plan to DR team

Submitted BARs for Qualtrics and Tremendous
Submitted contract request for a Spanish speaking UXR to help with Deep Reading
Launched the es.wiki recruitment drive, monitoring
supporting our contractors with their research ops, recruitment, and workflows
created workflow and messaging for special TSP recruiting

Submitted contract renewals for our 3 current contractors and did some followup to make sure the handoff of those requests to Debra goes smoothly
Followup for Qualtrics contract
Developed a recruitment plan and participant management workflow for the Apps Ambassador program
Delivered es.wiki users for recruitment for the Deep Reading project
Delivered finalized messaging, plan, and list of users for TSP specialized recruitment project
Transferred Docusign and incentive tasks to contractors leading Centralized Contribs and Deep Reading
Supported contractors with ad hoc admin/ops needs
Initiated LimeSurvey theme improvements
Updated des strat website with a number of projects
Airtable updates and maintenance: Prog Management base, Research participant database, and Knowledge Repo

Bethany changed Due Date from May 30 2025, 7:00 AM to Sep 30 2025, 7:00 AM.Aug 29 2025, 9:35 PM
Bethany updated the task description. (Show Details)
  • Mod Tools prototype testing: created recruitment materials and screener survey, sent emails to 400 database participants based on the team's criteria, and monitored responses.
  • Wikifunctions testing with Dagbani editors: created recruitment materials, tracking signed release form and scheduled interviews.
  • Contract renewal process for AirTable. Spoke with other AT users about their plans and explored what it would entail to move to CiviCRM.
  • Took over as brand admin on Qualtrics. Onboarded as the admin and began organizing/updating the account.

Update for week of Sep 1-5th:

  • Recruitment and participant management for mod tools testing project
  • interpretation, translation, incentive requests from design researchers
  • Contract renewal process for AirTable & Prolific: meeting with AT rep about options for next cycle; starting on Prolific request.
  • Onboarding new designer to research ops
  • Updated participate.html on the design strategy site; submitted merge request.
  • incentives for Edit Check, Progression, and Mod Tools Testing
  • Recruitment, translations, and general re-ops for Guided Article/Section Creation project. Tried to query one segment of users myself with some success.
  • Submitted contract for Prolific
  • Expanded DR project database to include methodologies
  • Submitted AirTable contract renewal
  • Recruitment strategizing, materials, screener survey for Year in Review testing.
  • Participant management for for Guided Article Creation
  • Incentives for Wikifunctions testing, Mod Tools testing, Progression, Guided Article Creation
  • Followed up with Katie about special recruitment for TSP and organized database around that recruitment effort
  • Participant database management
  • UserInterviews.com platform demo
  • Big recruitment effort for Year in Review testing: multiple rounds of emails to EN and JA-EN participants in the database. Monitoring screener responses and classifying respondents into 8 groups. Sending clear and detailed instructions for the test to qualified participants. Working closely with Sarah to debug pilot and coordinate on the readiness of each individual test. Being ready to send out instructions as soon as the tests are ready. Receiving and responding to participant issues and inquiries. Contacting Userlytics support on behalf of users experiencing issues.
  • Deployed a ja.wiki participant database recruitment message with Daniel to find more JA-EN speakers that can participate in the YiR study. Using the opportunity to recruit 3000 new ja.wiki signups into the database. Monitoring incoming registrations.
  • Participant management for for Guided Article/Section Creation
  • Built a custom workflow to support the Watchlist Study, provided recruitment advice, worked with Legal to customize release form.
  • Prolific and AirTable contracts are set
Bethany changed Due Date from Sep 30 2025, 7:00 AM to Dec 31 2025, 8:00 AM.
  • Year in Review support: Lots of recruitment, participant management, and study logistics. Many of our recruited participants experienced technical challenges when trying to complete the unmod test. Due to this, we pivoted to moderated tests, which required some extra planning, materials development, and communications with participants. Additionally, we got few screener responses from a couple of key participant segments, requiring extra rounds of recruitment outreach. In the end, we got all of the interviews from all of the segments we needed 🎉, assuming the one remaining interviewee shows up today.
  • Monitoring the ongoing ja.wiki participant database recruitment drive and cleaning database records as needed.
  • Participant management and recruitment help for for Guided Article/Section Creation
  • Provided logistical support and participant management for Watchlist testing
  • Translations for iOS/Android A/B tests

Update for week of Oct 6th:

  • Small ad-hoc requests from Designers and DRs
  • Monitoring the ongoing ja.wiki participant database recruitment drive and cleaning database records.
  • Preparing presentation about participant recruitment
  • Obtaining translations, arranging internal translation checks
  • Started an initiative to standardize age of written consent and participation on DR release forms

Update from week of Oct 13:

  • Small ad-hoc requests
  • Created fliers for participant database sign ups at WikiCon NA, and arranged for Carolyn and Sarah to distribute
  • Began working on standardizing/updating our consent forms to reflect 16yo age floor, in many languages for each form.
  • Shut down ja.wiki recruitment drive with ~2500 new sign ups. Had to clean a bunch of records.

Update for week of Oct 20:

  • Ad-hoc re-ops support for Design and Design Research
  • Finished deck about participant recruitment and database, awaiting feedback, presenting Oct 28th.
  • Dug through the DR drives, scrubbed project folders on GDrive and UL of participant PII, or asked file owners to do so. arranged for deletion of archived content that contains participant PII.
  • Write up of Attribution sprint apps/games interview findings
  • Follow up tasks on a research community request about recruiting editors
  • Lead a discussion on recruitment via surveys with the DR team
  • Follow up tasks for recruiting at events

Update for week of Oct 10:

  • Contract requests for Jahnavi and Overleaf
  • Survey translations for Olga T
  • Put in a request for query support from Applied Sciences
  • Put in a request from Design management to get notified when someone is approved to attend an event
  • Advised on Prolific account usage for T406207
  • Provided recruitment advice/offer for external researcher who attended office hours
  • Gave input/feedback on recruitment and materials for Sarai's developer interview project. Coordinated on the recruitment plan.

Week of Dec 1:

  • Participant recruitment and workflow support for API Sandbox project
  • OverLeaf contract tasks
  • Translations for Apps design experiment
  • Contractor check-in about Future Audiences work
  • Submitted Calendly and Prolific Coupa requests

Week of Jan 12:

  • translation requests for Apps experiment
  • interpretation requests for Recognition interviews
  • incentives and participant database updates
  • Coupa request

Week of Jan 19:

  • translation checks
  • interpretation requests
  • incentives and participant database updates
  • Conversation with Qualtrics
  • Troubleshooting survey issues for Committees Support Satisfaction survey
  • contractor checkin/ website codex conversion coordination
  • Program Management database updates
  • Logistics and feasibility discussion with Isaac for upcoming longitudinal study

Week of Jan 26:

  • incentives, interpretation, and participant database updates for Recognition
  • special recruitment planning and assistance for technical contributors
  • recruitment and logistics planning for Growth continuous research initiative
  • specialized recruitment for accessibility testing with folks with motion sensitivities
  • onboarded Lu to research ops
  • Contacted all Qualtrics users to understand their survey plans for the rest of the FY, in prep for Comparative Reader Research
  • Created processes for Growth continuous research initiative
  • Organized special recruitment with Userlytics for motion sensitivity testing
  • Assisted Snehal in setting up/piloting user test; created screener
  • Translation and staff translation check for Apps team
  • created screener and recruitment materials for MediaWiki Interfaces team API conversations recruitment
  • discussed recruiting technical contributors pool; began process of working with Legal on data handling
  • Planning for upcoming Qualtrics usage
  • Materials development and recruitment for a quick-start session for Growth's continuous research initiative. Planning for the formal proceedure.
  • Working on recruitment plans for WE1.9.1
  • Office hours with external researcher; planning recruitment for their editor workshops
  • Finished and confirmed materials, processes, coordination for MediaWiki Interfaces team API conversations recruitment
  • Furthered collaboration with Legal on data handling for creating a Technical Contributors Pool
  • Discussions about Legal Memo re: seeking a low-risk solution to querying user email
  • Planning for upcoming Qualtrics usage
  • Discussion with Apps about upcoming research idea; submitted pre-request to Debra
  • Working with Daisy on new editor recruitment, both for Isaac's KR and Growth continuous research. Confirmed processes and materials. Sent out recruitment messages. Tracking release forms and beginning the participant management process.
  • Contractor onboarding tasks
  • Worked with Bárbara on finalizing Mobile Editing Toolbar usability tests, plus recruited experienced editors to take them
  • Recruitment/participant management for MediaWiki Interfaces team API conversations, Isaac's KR, and Mobile Editing Toolbar tests.
  • Contractor onboarding tasks
  • Submitted 2 BARs
  • Helped Uzoma finalize a community survey for article guidance, obtained translations
  • AI experimentation pre-work for team discussion
  • Housekeeping in team budget doc, program management airtable, participant database, and knowledge repo

Recruitment/participant management for MediaWiki Interfaces team API conversations, Isaac's KR
Screener writing and recruitment tasks for Guided Article in VE.
Translations for Hybrid Search: French UI, GA in VE recruitment materials, quick surveys
Budget housekeeping
Preparing for quicksurvey deployments for recruitment

Mar 20:

  • Ad hoc re-ops, translations, Coupa tasks, etc
  • Supported contractors with language services, materials, and recruiting for Guided Article in VE and Semantic search
  • Monitoring participant recruitment from TR, PT, FR wikis. Cleaning records
  • Made a draft budget for next FY
  • Researched options and workflows for video editing, redacting, and organizing for Growth team
  • Began recruitment outreach into technical contributors research participant pool

Mar 27:

  • Ad hoc re-ops, such as translation checks, coordination with vendor + Procurement, etc.
  • Supported contractors with language services and recruiting for Guided Article in VE and Semantic search
  • Finalized next FY's budget request with Debra
  • Worked through understanding DScout's offerings and pricing to determine with Debra if we should pursue some studies on that platform
  • Attended 3 demos for video editing, redacting, and indexing. Working with Daisy to determine what software approach to take.
  • Met with Chris from Dev Exp group to begin a recruitment/participant management project for his listening tour. Developed materials and walked him through the process.
  • Sorted out incorrect Adaptive records

Week of Mar 30:

  • Coordinated, planned, developed materials for Toolforge user conversations with Chris
  • Meetings with several vendors to work out potential service details and costs
  • UXR budget tasks for this FY and next
  • Translations and organized translation checks in 6 languages for Apps Reading experiment
  • Translations and translation checks in 4 languages for the community insights survey
  • Drafted SOW for the Attribution survey for an external vendor
  • Submitted a BAR for diary study platform

Week of April 6:

  • Continued work on current and next FY budget
  • Submitted 3 BARs for video editing software, participant incentives, and survey panel; retracted a BAR
  • Coordination with PA on newcomer query template
  • Recruitment for Kings College London WikiData editor workshops
  • Continued recruitment support for Toolforge conversations

Week of April 13:

SDS offsite, during which I hosted an unconference session about how to get the UX insights needed for metrics
Recruitment and participant management for Toolforge conversations
Recruitment for Kings College London workshops for pt.wiki editors
Continued coordination/negotiation with Dscout

Week of April 20:

OOO Mon-Wed
Continuation of aforementioned recruitment and participant management
Coordinating Attribution survey project with survey panel vendor and Mike
Attended a workshop on continuous research operations

Week of April 27:
Onboarded onto projects and tasks that I'll be taking over for Mike as he goes on sabbatical
Facilitated soft launch and data collection of Attribution CTA Variant survey
Organized website migration and updates
Participant management for Toolforge conversations
Contract management with Dscout
Prepared and presented materials for recruiting at Hackathon

Week of May 4:
Interviews and feedback for contract researcher
Received Attribution dataset from the vendor, checked response quality and requested replacements
Participant management for Toolforge conversations
Reviewed contractor's report updates for stage 3 of Semantic Search qual research, attended shareout and closed out project
Recruitment for Growth continuous research

Week of May 11:

  • Recruitment and participant management for Growth Continuous Research and Toolforge conversations
  • Quick turnaround translation and organized translation checks for Apps team in 6 languages
  • Provided recruitment strategy advice for upcoming Article Guidance qual research
  • Contract management with Centiment survey panel
  • Participant management for Growth Continuous Research and Toolforge conversations
  • Planning next steps with Chris re: Toolforge conversations
  • Vendor management for Attribution survey panel
  • UXR website feedback and followup

Week of May 25

  • Planned continuous research pilot for Apps team; created operational documentation
  • Planned reader focus groups: Recruited from database, developed and ran focus group screener, planned logisitcs for special recruitment from Userlytics
  • Growth continuous research cycle planning, recruitment, screening, scheduling

Week of June 1

  • Website updates: Refined the design with Daniel. Created/refined content on About Us page, descriptions of the UXR team and send to Debra, first draft of Applied Science to sent to Miriam. Updated projects on UXR site. Facilitated the creation of /UXR subsite and redirects from old site.
  • Assisted in close out duties for several UXR projects. Updated Knowledge Repo.
  • Translations for Apps team into 6 languages; plus language checks and formatting

Week of June 8 - OOO

Week of June 15

  • Reviewed and provided suggested changes to usability protocol that test new content types in the explore feed for apps
  • Helped develop/troubleshoot the test in Usyerlytics
  • Shared knowledge and learnings with WMDE UX D/R about continuous learning program
  • Developed analysis plan for Sporadic and Casual Readers study; Estimated activity timing, incentive budgets, activity credits.

Week of June 22

  • Casual/Sporadic Readers study: Refined analysis plan, monitored/checked/sorted/labeled screener respondents, set up analysis workflow
  • Assistance to contractors with screening on userlytics for 2 projects
  • Gave input and made changes to UXR use of AI experimentation document

Week of July 6:

Supported casual & sporadic readers study: various data management tasks such as joining diary study datasets, preparing them for analysis by restructuring and cleaning, translating Spanish to English
Created team AI experimentation deck, coordinated presentation with Claudia
Developed recruitment strategy and materials for Gregory's Abstract Wiki editor study

Week of July 13

Supported casual & sporadic readers study: Activity 2 analysis, including coding topics for all 490 WP visits, freq tables/charts for all MC questions, and began coding other open-ended questions
Began supporting recruitment for Abstract Wiki interviews/concept tests
Developed materials for recruitment at Wikimania, including fliers, event-specific QR codes and a bit.ly page. Developed a new, automated workflow in Airtable to label participants who registered at WM26. Handed materials to Rita and Pau to distribute.
Provided suggestions to close out documentation on the team's AI use guidelines
Research website: used feedback from Research managers to refine a draft of the website About Us copy. Collected the things requiring Leila's review and delivered to her.