### Background
As we prepare for the Alt Text experiment, we want to observe how users interact with the prototypes and surface feedback and opportunities.
**Testing groups:**
- Experiment Group B: Add an image flow, and then dedicated Alt Text flow after
- Experiment Group C: Text edit in section with image, and then encouragement to add alt-text to that image after publishing
####Research Questions
- (B only) After image-related edit is submitted, do they understand they are adding alt-text to the image they just added?
- (C only) After non-image related edit is submitted, do they understand they are making a new edit to the same article?
- Are the tooltips sufficiently helpful?
- Do they understand the alt text guidance?
- Do they know where to go to get additional guidance?
- Are the users able to get sufficient information from the image to write the alt text?
- Are the users able to adequately get contextual information from the article to add alt-text to the image ?
- Do they know how to zoom on the image?
- Do they understand when they are previewing vs when it has been published?
- Is there anything they'd change about the feature?
#### Target Audience
- [ ] Folks in the Americas & Caribbean
- [ ] Test in English and Chinese
- [ ] There should be diversity in Gender and Age
#### Link to protocol
https://docs.google.com/document/d/1pBAbbtJcFlu5ApDIrxknLWPJNysLg4Qoc2Tc7UajP-s/edit
## Results
#### 1. Analysis of tasks for English Tests
**Testers for English - Flow B**
- Countries: UK (1), Germany (2), India (2)
- Male (4), Female (1)
- 4/5 had used the iOS app before
- 4/5 had contributed to Wikipedia before
- 1/5 had completed a structured edit task before
- 2/5 had previously added alt text to images
##### `Task B.4` Exploring the image recommendations "Add image details" page
- 4/5 understood that they had options to add caption and alt text to the image they just selected "Yes" to
- 1/5 did not scroll, and did not notice the Alt text entry screen
- 1/5 appreciated how we explained the difference between alt text and caption
##### `Task B.7` What do you think the modal is asking you? (Add alt text modal)
- 5/5 understood that they were being asked to add alt text to the previous image because it's missing
- 1/5 noted that it would be nice, but not necessary to add
- 1/5 suggested that instead of saying "previous image", it should read "the image you just added"
##### `Task B.10` Onboarding: What do you notice? How do you feel about the onboarding information?
- 5/5 thought the onboarding was clear
- 1/5 did not understand the "Type of image" point
- 1/5 was surprised by this point and found it helpful
- 2/5 did not know to scroll through the onboarding & completely missed the last point "Take care with people"
##### `Task B.13` How do you feel about these tooltips?
- 4/5 thought the tooltips were clear
- 1/5 thought there should be more guidance about the descriptions, as it will be available to the public.
- 1/5 thought they were enough for how hard this was going to be
##### `Task B.15` Did you find the article summary to be helpful?
- 3/5 agreed that the article summary was helpful
- 1/5 first clicked on the info-i
- 1/5 thought it was the entire article behind, because they didn't see the "view article" link
##### `Task B.17` Please zoom in on the image.
- 3/5 tapped on the image first, then pinch and zoom
- 2/5 would pinch and zoom first on thumbnail, then tap to open
- 1/5 minimized the half sheet and did not know to slide it back up to view the image again
##### `Task B.19` Finding additional guidance on how to write alt text
- 3/5 would open the "Guidance for writing alt text" link
- 1/5 would open the info-i next to the image
- 1/5 minimized the half sheet and did not know to slide it back up to view the image again
##### `Task B.22`Understanding additional guidance on alt text
- 4/5 thought the guidance was clear and did not need any improvements
- 1/5 was happy there were examples linked
- 1/5 was disappointed that it was shorter from the original onboarding guidance, and wishes it was the same. Especially the part about being objective and not make assumptions.
##### `Task B.24`Finding additional information about the image
- 3/5 knew to click on the info-i next to the image
- 1/5 read through article summary and clicked "View article" to find more information
- 1/5 had minimized the half sheet and did not know to slide it back up to view the image again. She would search for image on Google Lens
- 1/5 suggested that the info-i could be placed closer to the image, they weren't sure if it was related to the image or alt text guidance
##### `Task B.27`Reading additional information about the image
- 3/5 felt the information was complete and not missing anything
- 1/5 wished that it included the person responsible for creating the image (did not notice "Source" perhaps or understand)
- 1/5 suggested that the info-i could be placed closer to the image, they weren't sure if it was related to the image or alt text guidance
- 1/5 wanted more details about"Date", whether it was date created, uploaded, etc.
- 1/5 wanted to know where the information came from, if it was AI-generated or edited by humans (they assumed AI generated because there wasn't an opportunity to add "depicted persons" for example in the Add an Image task).
- 1/5 had minimized the half sheet and did not know to slide it back up to view the image again.
#### 3. Analysis follow-up questions
##### `Question B.34`How was the process of adding alt text to an image?
- 2/5 answered Easy
- 3/5 answered Medium, one because she couldn't figure out how to scroll up the halfsheet
##### `Question B.35`How did you respond to the modal asking if this should be a separate task?
- 3/5 answered Yes, that adding alt text should be a separate task. However 2 seemed to agree that the task should remain as they just completed it, pointing to a lack of clarify in the question. 1 said it should be separate so people don't get confused.
- 1/5 answered No, it should be necessary, not optional (they interpreted "suggested" as optional.
- 1/5 did not answer
##### `Question B.36`How would you explain the concept of alt text to a friend?
- 5/5 were able to summarize the task
- 2/5 mentioned that it improves articles for those who are visually impaired
- 1/5 described it as a guided tour to help users who are not experienced yet
##### `Question B.37`How was the guidance presented in the workflow?
- 4/5 answered Very Helpful
- 1/5 answered Helpful
- 1/5 reiterated that they with the guidance at the beginning of the workflow was available later on / standardized with guidance later on
##### `Question B.38`Did you find the information about the image that you expected?
- 5/5 answered Yes
- 1/5 stated that they were surprised that we weren't able to edit it the image information when we added the image, they want to know where it comes from
##### `Question B.39`Do you think you would be able to add alt text to a new image?
- 5/5 answered Yes
##### `Question B.40` Suggestions for improvements
- 1/5 asked that we make it clearer what is AI generated vs not. Source of information about the image.
- 1/5 suggested we standardize the advice given
#### 4. Recommendations
TBA
-------------
References: [[ https://docs.google.com/document/d/18HQW_dc-TcBGWu-Y8WRkZTqcsckbfWJQxCru1EiURpI/edit | Prototype Protocol ]]