Page MenuHomePhabricator

Crowdsourced evaluation of Upload Wizard caption/description instructions
Closed, ResolvedPublic

Description

Use Amazon Mechanical turk to A/B test different sets of instructions for eliciting captions and descriptions of pictures during the file upload workflow for Upload Wizard.

Research page: Crowdsourced evaluation of Upload Wizard instructions

Conclusions:
Instructions inviting labelers to "Add a one-line explanation of what this file represents, including only the most relevant information" about an image produced better quality captions on average than instructions inviting labelers to add a "short phrase". No differences were observed in the length of captions or descriptions produced under any of the experimental conditions (header text or instruction text). Therefore, we intend to use the phrase "one-line explanation" in the Upload Wizard instructions for eliciting captions.

Related Objects

View Standalone Graph
This task is connected to more than 200 other tasks. Only direct parents and subtasks are shown here. Use View Standalone Graph to show more of the graph.

Event Timeline

Study is concluded. Results are posted on the research page, and crowdsourced captions are posted on a subpage.

DarTar edited projects, added Research-Archive; removed Research.