Maniphest T374633

[EPIC] Run Figma Prototype experiment soliciting user feedback on lead paragraph summarization
Closed, ResolvedPublic
Actions

Assigned To

Authored By

	NBaca-WMF
	Sep 12 2024, 3:44 PM

Tags

Referenced Files

None

Subscribers

Description

Background

For https://phabricator.wikimedia.org/T374143 , we'd like to start by identifying user impressions of summarized lead paragraph content in a design-only prototype, as a means of deciding how users respond to the current UI treatment.

User story

As a designer working on article summarization, I'd like initial validation from our users that this is a good design direction

Requirements

We run a targeted userlytics survey for a hand-picked subset of users to validate initial design direction
We summarize the results to inform future direction

Communication criteria - does this need an announcement or discussion?

We should consider posting about this / updating our wiki page

This task was created by Version 1.2.0 of the Web team task template using phabulous

Related Objects
Search...

		Status	Subtype	Assigned	Task
		Resolved		Jdrewniak	T379708 [Hypothesis] [3.1.7] Article Summaries
		Resolved		NBaca-WMF	T374143 [EPIC] Test Summarization and Simplification of Article Content
		Resolved		Jdlrobson	T374633 [EPIC] Run Figma Prototype experiment soliciting user feedback on lead paragraph summarization
		Resolved		JScherer-WMF	T374636 Create an interactive Figma prototype of summarization for user testing
		Resolved		JScherer-WMF	T374638 Setup and run Userlytics test of article summarization
		Resolved		ovasileva	T374635 Precompute Article Summaries
		Resolved		jwang	T374639 Identify and document success metrics for Summarization, create spec for instrumentation
		Duplicate		JScherer-WMF	T376733 Instrument metrics for summarization
		Open		ovasileva	T376903 [Spike] How to Instrument metrics for summarization experiment
		Resolved		ovasileva	T379214 Instrument basic metrics for summarization experiment
		Resolved		ovasileva	T381253 [Analysis] Analyze summarization experiment
		Resolved		ovasileva	T370212 [Experiment] Design the reading experience of simplified article summaries

Event Timeline

NBaca-WMF created this task.Sep 12 2024, 3:44 PM

Restricted Application added a project: Epic. · View Herald TranscriptSep 12 2024, 3:44 PM

Restricted Application added a subscriber: Aklapper. · View Herald Transcript

NBaca-WMF mentioned this in T374636: Create an interactive Figma prototype of summarization for user testing.Sep 12 2024, 3:56 PM

NBaca-WMF mentioned this in T374639: Identify and document success metrics for Summarization, create spec for instrumentation.Sep 12 2024, 4:01 PM

Jdlrobson moved this task from Incoming to Epics/Goals on the Web-Team-Backlog-Archived board.Sep 12 2024, 4:04 PM

Jdlrobson added a subtask: T374636: Create an interactive Figma prototype of summarization for user testing.

Jdlrobson added a subtask: T374638: Setup and run Userlytics test of article summarization .Sep 12 2024, 4:06 PM

Jdlrobson triaged this task as High priority.Sep 13 2024, 8:51 PM

ovasileva added a subtask: T374635: Precompute Article Summaries .Sep 16 2024, 10:12 AM

ovasileva added a subtask: T374639: Identify and document success metrics for Summarization, create spec for instrumentation.

ovasileva added a parent task: T374143: [EPIC] Test Summarization and Simplification of Article Content.Sep 17 2024, 11:14 AM

ovasileva added a subtask: T370212: [Experiment] Design the reading experience of simplified article summaries.Sep 17 2024, 3:51 PM

ovasileva closed subtask T374635: Precompute Article Summaries as Resolved.Sep 30 2024, 4:50 PM

JScherer-WMF closed subtask T374636: Create an interactive Figma prototype of summarization for user testing as Resolved.Oct 2 2024, 4:16 PM

ovasileva closed subtask T374638: Setup and run Userlytics test of article summarization as Resolved.Oct 14 2024, 10:14 PM

Jdlrobson moved this task from Epics/Goals to Groomed on the Web-Team-Backlog-Archived board.Nov 13 2024, 11:16 PM

Jdlrobson edited projects, added Web-Team; removed Web-Team-Backlog-Archived.Nov 13 2024, 11:35 PM

Jdlrobson moved this task from Incoming to Freezer on the Web-Team board.Nov 13 2024, 11:45 PM

NBaca-WMF closed subtask T374639: Identify and document success metrics for Summarization, create spec for instrumentation as Resolved.Nov 18 2024, 6:49 PM

Jdlrobson-WMF edited projects, added FY2024-25 KR 3.1 Content Discovery, Web-Team-Roadmap; removed Web-Team.Jan 16 2025, 8:04 PM

Checked with @NBaca-WMF and this is done.