Change Details

#### Background The Android team will enhance our communication systems with a focus on messaging interfaces and workflows. Last year we released native talk pages. We want to understand what gaps exist in our current interface as-is and, which elements of our feature are a success, and we should consider not touching. #### Goals 1 ) Gauge the discoverability of user and article talk pages 2 ) Identify potential improvements to the usability of the talk page: - Do users understand how to start a new subject on an article talk page? - Are users able to successfully follow the steps to post a new discussion? - Are users able to respond to a user talk page notification they receive? - Is there anything that users would like to be able to do in our native talk page experience that they can’t currently or is there anything that would make their experience more efficient? - When receiving a revert, does the user know how to best get it resolved? - If a user posts a message on a talk page what are the expectation of when and how they will hear back 3 ) Gauge user reactions to the talk page and expectations of how their questions will be answered. 4 ) Do people expect user talk pages and article talk pages to be the same? #### Test format This will be an unmoderated remote task-based test, conducted using usertesting.com to recruit participants and record sessions. #### Variables per language **Arabic** - Article name:`قط` - Link: https://test.wikipedia.org/wiki/قط - Username: `Usertestingandroid4_Arabic` - Password: `Wikipedia4` **French** - Article name: Chat - Link: https://test.wikipedia.org/wiki/Chat - Username: `Usertestingandroid3_Francais` - Password: `Wikipedia3` **Hindi** - Article name: `बिल्ली` - Link: https://test.wikipedia.org/wiki/बिल्ली - Username: `Usertestingandroid2_Hindi` - Password: `Wikipedia2` **Indonesian** - Article name: `Kucing` - Link: https://test.wikipedia.org/wiki/Kucing - Username: `Usertestingandroid5_Bahasa` - Password: `Wikipedia5` **Japanese** - Article name: `ネコ` - Link: `https://test.wikipedia.org/wiki/ネコ` - Username: `Usertestingandroid6_Japanese` - Password: `Wikipedia6` #### Screener questions Usertesting.com allows for 4 screener questions. Given the constraint we are pursuing the following plan to reach our target audience: - Use the “Rest of the World” and “Hindi” checkbox on usertesting.com - Use a language screener question for Arabic, French, Hindi, Indonesian, Japanese 1 ) Which of the following are you familiar with? (Select all that apply) - Facebook [May select] - Google Docs [May select] - Wikipedia [Must select] - Twitter [May select] - Wordpress [May select] - WeChat [May select] - WhatsApp [May select] - None of the above [Reject] 2 ) Have you ever edited an article on Wikipedia? - Yes, many times [Reject] - Yes, once or twice [Accept] - I don’t remember [Accept] - No, because I didn't know it could be edited [Accept] - No, for other reasons [Accept] 3 ) What device are you using? - Mobile device iOS [Reject] - Mobile device Android [Accept] - Desktop [Reject] 4 ) Aside from English, which language(s) do you speak at an advanced to native level? - Arabic [Accept] - French [Accept] - Hindi [Accept] - Indonesian [Accept] - Japanese [Accept] - Spanish [Reject] - German [Reject] - Russian [Reject] - I don’t speak other languages [Reject] #### Opening Scenario Imagine you are a user logged into a Wikipedia account as: Usertestingandroid3_Francais You have just noticed the following Wikipedia article: https://test.wikipedia.org/wiki/Chat #### Protocol 1 ) The following steps are for you to log in to see the parts of the app we would like you to review. After installing and opening the app, you will see the app onboarding. Please tap 'SKIP' in the bottom area of the screen. 2 ) You should now be in the first menu item of the app, which is called the 'Explore' feed. Tap the 'More' menu item at the bottom area of the screen. 3 ) Tap the 'LOG IN / JOIN WIKIPEDIA' link Tap the 'LOG IN' button below the 'Already have an account?' text Use the following credentials to log in: Username: Usertestingandroid3_Francais Password: Wikipedia3 4 ) You should now be logged in with a username and back on the home screen (the 'Explore' feed). 5 ) Go to 'Settings' via 'More' menu item in the main app navigation and tap 'Wikipedia languages'. Please make sure that French is set as the primary language of the app. If it is not represented, please tap the 'Add language' button and add it as the primary language. 6 ) Please tap the back button (←) in the top area of the screen twice. You should now be back on the home screen (the 'Explore' feed). You are all set to start the test. 7 ) Navigate to the search field and type or copy/paste the following text into the search box: Chat Tap the search result and navigate to the article. 8 ) You should now see the Wikipedia article. Do not click on anything yet. You want to discuss a part of this article and correct, expand or reference it. Talk us through where you would go to do this? 9 ) Please tap on the three dots in the top right corner of the screen and then tap 'View talk page'. What do you notice on this screen? 10 ) Still in the mindset of someone that wants to collaborate with other editors on Wikipedia: start a new discussion thread to ask if anyone is watching the page and would want to collaborate. Please narrate your thoughts through this process. Please publish the new discussion thread. 11 ) If you have not already, please tap '+ NEW TOPIC' button in the bottom area of the screen to start a new discussion. Please publish the new topic you created by tapping the blue tick icon at the top right of the screen. 12 ) Now that you have successfully published on the talk page, please narrate how you expect to receive a reply and from whom? 13 ) Returning to the talk page for the Wikipedia article, select a conversation thread that you did not start. 14 ) Narrate your understanding of the discussion on this page 15 ) Reply to the thread in the app, write and explain your perspective 16 ) Go to your notifications 17 ) If you do not find notifications: Navigate to your notifications via the bell icon in the top area 18 ) Tap the notification item that says '...left a message on your talk page' 19 ) Narrate your understanding of this screen. 20 ) Reply to the message you just read in English or another language you speak #### Follow-up questions 1 ) Was there anything you did not like about the talk page experience? 2 ) How could we change the experience to be more helpful? 3 ) What should we not change about the current experience?

#### Background The Android team will enhance our communication systems with a focus on messaging interfaces and workflows. Last year we released native talk pages. We want to understand what gaps exist in our current interface as-is and, which elements of our feature are a success, and we should consider not touching. #### Goals 1 ) Gauge the discoverability of user and article talk pages 2 ) Identify potential improvements to the usability of the talk page: - Do users understand how to start a new subject on an article talk page? - Are users able to successfully follow the steps to post a new discussion? - Are users able to respond to a user talk page notification they receive? - Is there anything that users would like to be able to do in our native talk page experience that they can’t currently or is there anything that would make their experience more efficient? - When receiving a revert, does the user know how to best get it resolved? - If a user posts a message on a talk page what are the expectation of when and how they will hear back 3 ) Gauge user reactions to the talk page and expectations of how their questions will be answered. 4 ) Do people expect user talk pages and article talk pages to be the same? #### Test format This will be an unmoderated remote task-based test, conducted using usertesting.com to recruit participants and record sessions. #### Variables per language **Arabic** - Article name:`قط` - Link: https://test.wikipedia.org/wiki/قط - Username: `Usertestingandroid4_Arabic` - Password: `Wikipedia4` **French** - Article name: Chat - Link: https://test.wikipedia.org/wiki/Chat - Username: `Usertestingandroid3_Francais` - Password: `Wikipedia3` **Hindi** - Article name: `बिल्ली` - Link: https://test.wikipedia.org/wiki/बिल्ली - Username: `Usertestingandroid2_Hindi` - Password: `Wikipedia2` **Indonesian** - Article name: `Kucing` - Link: https://test.wikipedia.org/wiki/Kucing - Username: `Usertestingandroid5_Bahasa` - Password: `Wikipedia5` **Japanese** - Article name: `ネコ` - Link: https://test.wikipedia.org/wiki/ネコ - Username: `Usertestingandroid6_Japanese` - Password: `Wikipedia6` #### Screener questions Usertesting.com allows for 4 screener questions. Given the constraint we are pursuing the following plan to reach our target audience: - Use the “Rest of the World” and “Hindi” checkbox on usertesting.com - Use a language screener question for Arabic, French, Hindi, Indonesian, Japanese 1 ) Which of the following are you familiar with? (Select all that apply) - Facebook [May select] - Google Docs [May select] - Wikipedia [Must select] - Twitter [May select] - Wordpress [May select] - WeChat [May select] - WhatsApp [May select] - None of the above [Reject] 2 ) Have you ever edited an article on Wikipedia? - Yes, many times [Reject] - Yes, once or twice [Accept] - I don’t remember [Accept] - No, because I didn't know it could be edited [Accept] - No, for other reasons [Accept] 3 ) What device are you using? - Mobile device iOS [Reject] - Mobile device Android [Accept] - Desktop [Reject] 4 ) Aside from English, which language(s) do you speak at an advanced to native level? - Arabic [Accept] - French [Accept] - Hindi [Accept] - Indonesian [Accept] - Japanese [Accept] - Spanish [Reject] - German [Reject] - Russian [Reject] - I don’t speak other languages [Reject] #### Opening Scenario Imagine you are a user logged into a Wikipedia account as: Usertestingandroid3_Francais You have just noticed the following Wikipedia article: https://test.wikipedia.org/wiki/Chat #### Protocol 1 ) The following steps are for you to log in to see the parts of the app we would like you to review. After installing and opening the app, you will see the app onboarding. Please tap 'SKIP' in the bottom area of the screen. 2 ) You should now be in the first menu item of the app, which is called the 'Explore' feed. Tap the 'More' menu item at the bottom area of the screen. 3 ) Tap the 'LOG IN / JOIN WIKIPEDIA' link Tap the 'LOG IN' button below the 'Already have an account?' text Use the following credentials to log in: Username: Usertestingandroid3_Francais Password: Wikipedia3 4 ) You should now be logged in with a username and back on the home screen (the 'Explore' feed). 5 ) Go to 'Settings' via 'More' menu item in the main app navigation and tap 'Wikipedia languages'. Please make sure that French is set as the primary language of the app. If it is not represented, please tap the 'Add language' button and add it as the primary language. 6 ) Please tap the back button (←) in the top area of the screen twice. You should now be back on the home screen (the 'Explore' feed). You are all set to start the test. 7 ) Navigate to the search field and type or copy/paste the following text into the search box: Chat Tap the search result and navigate to the article. 8 ) You should now see the Wikipedia article. Do not click on anything yet. You want to discuss a part of this article and correct, expand or reference it. Talk us through where you would go to do this? 9 ) Please tap on the three dots in the top right corner of the screen and then tap 'View talk page'. What do you notice on this screen? 10 ) Still in the mindset of someone that wants to collaborate with other editors on Wikipedia: start a new discussion thread to ask if anyone is watching the page and would want to collaborate. Please narrate your thoughts through this process. Please publish the new discussion thread. 11 ) If you have not already, please tap '+ NEW TOPIC' button in the bottom area of the screen to start a new discussion. Please publish the new topic you created by tapping the blue tick icon at the top right of the screen. 12 ) Now that you have successfully published on the talk page, please narrate how you expect to receive a reply and from whom? 13 ) Returning to the talk page for the Wikipedia article, select a conversation thread that you did not start. 14 ) Narrate your understanding of the discussion on this page 15 ) Reply to the thread in the app, write and explain your perspective 16 ) Go to your notifications 17 ) If you do not find notifications: Navigate to your notifications via the bell icon in the top area 18 ) Tap the notification item that says '...left a message on your talk page' 19 ) Narrate your understanding of this screen. 20 ) Reply to the message you just read in English or another language you speak #### Follow-up questions 1 ) Was there anything you did not like about the talk page experience? 2 ) How could we change the experience to be more helpful? 3 ) What should we not change about the current experience?

#### Background The Android team will enhance our communication systems with a focus on messaging interfaces and workflows. Last year we released native talk pages. We want to understand what gaps exist in our current interface as-is and, which elements of our feature are a success, and we should consider not touching. #### Goals 1 ) Gauge the discoverability of user and article talk pages 2 ) Identify potential improvements to the usability of the talk page: - Do users understand how to start a new subject on an article talk page? - Are users able to successfully follow the steps to post a new discussion? - Are users able to respond to a user talk page notification they receive? - Is there anything that users would like to be able to do in our native talk page experience that they can’t currently or is there anything that would make their experience more efficient? - When receiving a revert, does the user know how to best get it resolved? - If a user posts a message on a talk page what are the expectation of when and how they will hear back 3 ) Gauge user reactions to the talk page and expectations of how their questions will be answered. 4 ) Do people expect user talk pages and article talk pages to be the same? #### Test format This will be an unmoderated remote task-based test, conducted using usertesting.com to recruit participants and record sessions. #### Variables per language **Arabic** - Article name:`قط` - Link: https://test.wikipedia.org/wiki/قط - Username: `Usertestingandroid4_Arabic` - Password: `Wikipedia4` **French** - Article name: Chat - Link: https://test.wikipedia.org/wiki/Chat - Username: `Usertestingandroid3_Francais` - Password: `Wikipedia3` **Hindi** - Article name: `बिल्ली` - Link: https://test.wikipedia.org/wiki/बिल्ली - Username: `Usertestingandroid2_Hindi` - Password: `Wikipedia2` **Indonesian** - Article name: `Kucing` - Link: https://test.wikipedia.org/wiki/Kucing - Username: `Usertestingandroid5_Bahasa` - Password: `Wikipedia5` **Japanese** - Article name: `ネコ` - Link: `https://test.wikipedia.org/wiki/ネコ` - Username: `Usertestingandroid6_Japanese` - Password: `Wikipedia6` #### Screener questions Usertesting.com allows for 4 screener questions. Given the constraint we are pursuing the following plan to reach our target audience: - Use the “Rest of the World” and “Hindi” checkbox on usertesting.com - Use a language screener question for Arabic, French, Hindi, Indonesian, Japanese 1 ) Which of the following are you familiar with? (Select all that apply) - Facebook [May select] - Google Docs [May select] - Wikipedia [Must select] - Twitter [May select] - Wordpress [May select] - WeChat [May select] - WhatsApp [May select] - None of the above [Reject] 2 ) Have you ever edited an article on Wikipedia? - Yes, many times [Reject] - Yes, once or twice [Accept] - I don’t remember [Accept] - No, because I didn't know it could be edited [Accept] - No, for other reasons [Accept] 3 ) What device are you using? - Mobile device iOS [Reject] - Mobile device Android [Accept] - Desktop [Reject] 4 ) Aside from English, which language(s) do you speak at an advanced to native level? - Arabic [Accept] - French [Accept] - Hindi [Accept] - Indonesian [Accept] - Japanese [Accept] - Spanish [Reject] - German [Reject] - Russian [Reject] - I don’t speak other languages [Reject] #### Opening Scenario Imagine you are a user logged into a Wikipedia account as: Usertestingandroid3_Francais You have just noticed the following Wikipedia article: https://test.wikipedia.org/wiki/Chat #### Protocol 1 ) The following steps are for you to log in to see the parts of the app we would like you to review. After installing and opening the app, you will see the app onboarding. Please tap 'SKIP' in the bottom area of the screen. 2 ) You should now be in the first menu item of the app, which is called the 'Explore' feed. Tap the 'More' menu item at the bottom area of the screen. 3 ) Tap the 'LOG IN / JOIN WIKIPEDIA' link Tap the 'LOG IN' button below the 'Already have an account?' text Use the following credentials to log in: Username: Usertestingandroid3_Francais Password: Wikipedia3 4 ) You should now be logged in with a username and back on the home screen (the 'Explore' feed). 5 ) Go to 'Settings' via 'More' menu item in the main app navigation and tap 'Wikipedia languages'. Please make sure that French is set as the primary language of the app. If it is not represented, please tap the 'Add language' button and add it as the primary language. 6 ) Please tap the back button (←) in the top area of the screen twice. You should now be back on the home screen (the 'Explore' feed). You are all set to start the test. 7 ) Navigate to the search field and type or copy/paste the following text into the search box: Chat Tap the search result and navigate to the article. 8 ) You should now see the Wikipedia article. Do not click on anything yet. You want to discuss a part of this article and correct, expand or reference it. Talk us through where you would go to do this? 9 ) Please tap on the three dots in the top right corner of the screen and then tap 'View talk page'. What do you notice on this screen? 10 ) Still in the mindset of someone that wants to collaborate with other editors on Wikipedia: start a new discussion thread to ask if anyone is watching the page and would want to collaborate. Please narrate your thoughts through this process. Please publish the new discussion thread. 11 ) If you have not already, please tap '+ NEW TOPIC' button in the bottom area of the screen to start a new discussion. Please publish the new topic you created by tapping the blue tick icon at the top right of the screen. 12 ) Now that you have successfully published on the talk page, please narrate how you expect to receive a reply and from whom? 13 ) Returning to the talk page for the Wikipedia article, select a conversation thread that you did not start. 14 ) Narrate your understanding of the discussion on this page 15 ) Reply to the thread in the app, write and explain your perspective 16 ) Go to your notifications 17 ) If you do not find notifications: Navigate to your notifications via the bell icon in the top area 18 ) Tap the notification item that says '...left a message on your talk page' 19 ) Narrate your understanding of this screen. 20 ) Reply to the message you just read in English or another language you speak #### Follow-up questions 1 ) Was there anything you did not like about the talk page experience? 2 ) How could we change the experience to be more helpful? 3 ) What should we not change about the current experience?