Page MenuHomePhabricator

Add quick survey on two language wikis to recruit participants for search experimentation user research.
Closed, InvalidPublic

Description

Add a quick survey to the article page of Spanish and Arabic wikis in order to recruit participants for the search experimentation user research.

The survey CTA would link users to the screener that the user will need to fill out in order to participate.

Web team currently oversees the quicksurveys and we need to provide our own developer for this work.

Duration of survey: 3 days to start and we can look through the responses and determine if more time is needed.

Sample size: We can have a random sample.

When: As soon as we can as the research timeline depends on when we can recruit participants.

Where should it appear
See example

Survey.jpg (586×676 px, 126 KB)

Event Timeline

Sneha renamed this task from Add quick survey to recruit participants for search experimentation user research. to Add quick survey on two language wiki home pages to recruit participants for search experimentation user research..Mar 4 2022, 6:50 PM
Sneha updated the task description. (Show Details)
Sneha updated the task description. (Show Details)
Sneha updated the task description. (Show Details)
  • is quicksurveys already installed on both wikis?
  • we'll need translations for these things ahead of time
  • how do we want to sample this - every visitor, or only a certain percentage?
  • where exactly do we want to put this - the home page has a very specific layout and quicksurveys is not something that we can style much; both wikis also vary quite a bit, including text direction, so I guess we need 2 separate "designs"
  • do we already have someone with permissions to edit both pages (they're usually restricted) in case we need to edit it to get it where we want it to be (we can also request permissions, just need a headspu ahead of time)
  • can we do this? (do we need to consult with community and/or do we have approval)

@matthiasmullie

Translations
@Bethany is going to help with that

How to samples this
We can get some ideas from the quick survey that the trust and safety team did.
I am thinking we can have a random sample since as you can see it is in a very prime spot and I was told in the past we have gotten good response with such surveys.

Where exactly do we want to put this? Can we do this?
After speaking with a few people it seems that putting it on the article page will give us a best chance of recruiting readers. Apart from the issues you already mentioned home pages are also community maintained special page and we should avoid putting it there. Also it will be hard to recruit readers there as most casual readers do not visit those pages. I will updated the story to reflect it.

Here is an example of where the survey could go.

Sneha renamed this task from Add quick survey on two language wiki home pages to recruit participants for search experimentation user research. to Add quick survey on two language wikis to recruit participants for search experimentation user research..Mar 10 2022, 4:56 PM
Sneha updated the task description. (Show Details)

We are currently trying to find another solution to participant recruitment without having to use the QuickSurvey. I will keep this ticket updated if we need to move ahead with Quicksurveys.

I've collected answers to the questions posed by @matthiasmullie, if not for this time around then for everyone's learning.

  • is quicksurveys already installed on both wikis? Yes. QuickSurveys is installed on all our wikis.
  • we'll need translations for these things ahead of time. If we decide to proceed, I will provide translations.
  • how do we want to sample this - every visitor, or only a certain percentage? I don't have an answer to this. Best practice is start with a very low percentage and increase as needed. We don't know what response rates are like. If we decide to to proceed, I will bring a suggestion.
  • where exactly do we want to put this Snehal addressed this,
  • do we already have someone with permissions to edit both pages (they're usually restricted) in case we need to edit it to get it where we want it to be (we can also request permissions, just need a headspu ahead of time) Any staff account should be able to edit wiki pages. Process documented on https://office.wikimedia.org/wiki/WMF_Staff_userrights_policy
  • can we do this? (do we need to consult with community and/or do we have approval) I consulted with community ambassadors and they believe dropping a simple message on the technical village pump is sufficient.