We want to determine whether the design ideas for suggestions and lists are effective to:
- Find relevant articles to translate.
- Encourage users to translate more.
- Be more effective by better organising their translation efforts.
About current behaviour
- How are users normally finding which articles to translate?
- How are users keeping track of these articles if they don't have time immediately to work on them?
- Which factors help users decide which articles to translate (e.g., featured article, number of views, reliability based on reference count, etc.)?
- Is being part of a campaign a motivation to translate more articles?
- Is the purpose of suggestions clear?
- Is the mechanism of "saving for later" useful to keep the relevant suggestions?
- How good suggestions need to be in order to be useful for the user? Are similar topics to the ones you edit a good choice to base selections on? Is more control (e.g., selecting a category such as "science" to get suggestions in that area) desirable?
Lists fo articles
- Is creating lists useful to keep track and organise what to translate?
- Are shared lists useful to participate on collaborative translation efforts?
- Is creating campaigns a useful way to ask the community to get important articles translated?
- How do users perceive the relationship between "for later", "custom lists" and suggestion lists? Are those multiple kinds of list making things easier to understand or confusing users?
Additional ideas to test
- Are statistics providing a clear overview of the user progress?
- Is the simplified "new translation" dialog an effective way to create new translations.
Before the test
- Do you translate articles when contributing to Wikipedia?
- Do you know Content Translation? Have you used it?
- When doing translations, how do you decide which articles to translate? How do you find them?
- If you find an interesting article to work on but you don't have time right now, do you keep track of it to wok on it later?
- Have you participated in any translation campaign with other users (showing this campaign)? Would you be interested in participating in similar campaigns?
- Let's try this prototype. It is a very basic prototype to try and discuss ideas about how to translate articles. The prototype assumes you are a Spanish speaker that is interested in translating articles about science and nature.
General understanding of the "suggestions", "in progress" and "published" sections:
- This is a tool to translate Wikipedia articles. Based on what you see in this view, what can you do here? (The user is expected to identify the possibility of starting new translations, the suggestions, the statistics, the help area, and language selection).
- Are there other main views? Can you tell which is their purpose? Which information do they have or which information would you expect there? (the user is expected to identify the three main sections representing the steps of the translation process: finding articles (suggestions), translating them (in progress) and completing them (published))
- You may notice there is a list with pictures of animals, which is the purpose of that? (the user provides more details on how suggestions are expected to work)
- Which suggestions are you provided with and which information you have for each one? (the user is expected to go through the suggestions and identify aspects such as the possibility of discarding them, the expectations behind the menus and the impact indicators such as "featured").
- What would you do to start translating the "Golden toad" article? (not supported in the prototype but good to see if users click on it)
- Let's imagine that you are very interested on translating the "Lion" article but you don't have time for it now. What would you do to make it easy to find that article in the future, when you might have more time? (the user clicks on the star button next to the Lion suggestion).
- Can you describe what happened? (the user should confirm that lion is now part of the "for later" list)
- Can you tell me, but don't do it, what you'll have to do if in the future you want to translate or you are no longer interested in this article? (the user is expected to explain that by clicking the item you can start translating it, and by clicking the star you can revert the addition to the list)
- When you save a translation for later, what do you expect to happen? Would you want to keep track of changes to this article, once you've saved it for later? Why?
- Are the current suggestions provided interesting for you? What would make these suggestions to be interesting? Would it help to be related to the kind of topics you normally edit? Do you think suggestions would be better if you could select a different category other than science and nature? (the user is expected to provide details on what makes a good suggestion and the degree of control expected)
- You may have noticed that the suggestions include a "Wiki Loves Nature" list. Let's imagine that you want to keep track of your favourite scientists articles that are missing in Spanish. Would you be able to create a list named "Famous scientists"? (the user is expected to click on the "dd folder" icon).
- (when the new collection dialog is visible) Pleas, can you describe which options you have when creating this list, and which is their purpose? (the user is expected to describe the purpose of the campaign configuration options).
- Would you be able to add the article about Albert Einstein to the list of scientists? Can you describe hat do you see in each step? (the user is expected to click on add page and search for "Albert Einstein", it is interesting to check how useful the initial suggestions are perceived)
- Imagine that you want to share this list with other friends interested in science for them to add more articles, what would you do? (the user is expected to click on the link icon, which does not work but may help us to understand how collaboration is perceived in this context)
- Let's imagine you are interested in the "Wiki Loves Nature" campaign, what would you do to translate some of those articles? (the user is expected to add the list by clicking on the folder board and explore it's contents on the "All collections section").
- Based on the statistics shown, how productive do you think this user is?
- Can you go to the "In progress" section. Would you be able to start a new translation about "Albert Einstein"? What would you do if you want to translate it from German to French instead?
After the test
- Which is your general impression of the tool you tested?
- Which are the aspects that seem to work better for you based on your existing experience as a translator?
- Which are the aspects that don't seem to work based on your experience as a translator?
- Do you expect to easily find relevant articles to translate with the tool you tested before?
- Do you expect to be translating more with this system? why?
- Do you expect to be more effective with by using these tools to organise your translation efforts?