Description: Ask some clickworkers to read two different sets of instructions for adding captions and descriptions to images, and see whether there is a meaningful difference in the quality of the output based on the instructions given.
Goal: Help us decide which instructions to use for redesigned Upload Wizard; evaluate whether this is a viable replacement for remote user testing for other low-level UI evaluation tasks.
Timeline: April-June 2018
- select image(s) to caption
- design MTurk task and survey
- deploy survey with one or more sets of Turkers (different demographic groups?)
- evaluate which instructions, on average, yielded better captions and descriptions
- write up results
Research project page: to come