Page MenuHomePhabricator

Qualitative support for PSI team
Open, Needs TriagePublic

Description

Throughout Q2 the PSI team has been running multiple major surveys and qualitative design research efforts such as T404263 and T402277, with more slated for the upcoming quarter. This ticket tracks work done to aid the team in these efforts.

Since these surveys cover multiple KRs at once, and the type of support is not structured for each survey, I've (boldly) classed this under Essential Work.

Event Timeline

Update for the week of Sep 29 - Oct 3:

  • Assisted in survey design for T402277 (wording, survey flow, survey logic)
  • Quick-turnaround analysis for closed-choice questions in T402277

Update:

  • Reviewed screener survey, test protocol, outreach messages for IRS non-emergency MVP UX test (for invited participants)
  • Helped design + port IRS non-emergency MVP UX test on to Userlytics platform, in preparation for testing with Userlytics panelists
  • Minor assistance with T407493 analysis

Update:

  • Worked with Bethany and Katie to prepare UX tests for IRS non-emergency MVP, testing with Wikipedians
  • Partially designed and then implemented screeners and a testing protocol for IRS non-emergency MVP, testing with Userlytics panelists (so non-Wikipedians), screened for familiarity with Wikipedia. We did so in order to produce quick-turnaround results on the UX test, and they did come back very quickly as we hoped. Kieran is leading the analysis of these tests at the moment, though I may be tapped to provide assistance if necessary.
  • Minor assistance with T407493 analysis, now complete

Update:

  • Reviewed final deliverables for T407493
  • Reviewed analysis for UX tests (Userlytics panelists) for IRS non-emergency MVP

Moving to Research Q3 workboard; Claudia plans to do some work to support Kiernan in the PSI space and this task will be used to continue to track that work. Claudia to update the task with the exact scope planned for Q3.

Update: I am currently supporting the PSI team by running Suggested Investigations user interviews (WMF-only link). In brief:

Research goal:

  • Insights into CheckUsers SI workflow and behaviours, to provide a holistic overview of how users engage with Suggested Investigations in their day-to-day environment

Expected impact:

  • Provide the team with a more complete understanding of the entire SI workflow and how it relates to checkuser work
  • Inform how we present signals to checkusers (which rests on our assumptions of how they understand these signals, and how they then use the information provided by signals in SI)
  • Affect future UX work on the SI interface, as it pertains to how to present information to SI users.

Approach

  • 30-minute semi-structured interview, with a participant observation section. We are offering optional research rewards to participants who complete their interview
  • Users will be recruited from closed functionary groups (mailing lists and Discord), as the pool of users who can use SI is very low
  • We are aiming for 4-6 total interviews

Deliverable

  • Recordings of interviews, for 90 days (per our research privacy statements)
  • Short report of findings and presentation deck, presentation venue TBD but likely to be during existing team check-in meetings
  • Due to the sensitive nature of the information in SI, we do not plan on publicizing details of findings beyond the immediate team

As of today, we have begun user interviews, with one complete and one more scheduled. Interviews are open until the end of next week (Feb 13) with the entire project due to be finished by the end of February.