Page MenuHomePhabricator

Simple summary experiment - Update summaries
Closed, DeclinedPublic3 Estimated Story Points

Description

Background

In T378098 we launched an experiment presenting simplified summaries to users in an experimental context. Although the summaries went through legal and quality review, the quality of the summaries was sometimes spotty. Since launching the experiment, with the help of folks from Cohere Inc. we've been given a prompt that can generate higher quality summaries, as well as an updated version of the multi-lingual Aya model (aya-expanse).

User story

As a user participating in this experiment, I'd like to receive the highest quality summaries available.

Requirements

  • Re-generate summaries using the prompt below and the new aya-expanse.
  • Ensure summaries meet the filtering criteria previously agreed to with legal.
  • Generate summaries for an additional 5k articles to compensate for legal exclusions.
prompt
## Task and Context
Summarize the text below into a clear and simple paragraph that is easy to understand for a general audience. You will always generate the text in the source language of the input text. Keep the summary concise, with a target of 100 words or less, capturing only the essential points of the content. Focus on readability, accessibility, and neutrality.

## Tone
Write the summary in a style and tone appropriate for Wikipedia. Avoid any editorializing, opinions, or expressive language about the subject. Ensure the tone remains neutral, professional and factual.

## Summarization Guidelines
- The source language of the input text is in {language}
- Provide an accessible, straightforward summary suitable for readers seeking a quick, understandable overview.
- Refrain from using humorous or imaginative titles; provide only the summary itself as output.
- Summarize the text above in simple language, using 100 words or less. Do not expand content beyond its original length if it is already brief.
- Return only the summary. Avoid any in-text citations, footnotes or reference links in the summary.

## Input Text
{input_text}

Acceptance criteria

  • new summaries have been generated
  • new summaries have been uploaded and published to the Chrome extension.

This task was created by Version 1.2.0 of the Web team task template using phabulous

Event Timeline

ovasileva changed the task status from Open to In Progress.Nov 27 2024, 5:18 PM
Jdrewniak changed the task status from In Progress to Open.Nov 28 2024, 6:18 PM
Jdrewniak set the point value for this task to 3.
ovasileva changed the task status from Open to Stalled.Dec 5 2024, 9:46 AM
ovasileva lowered the priority of this task from High to Medium.

Marking as stalled

@ovasileva is this done? If not, could you elaborate on what it is stalled on? This came up in refinement today.

I think we can close this for now. We'll likely need to do this for pt2 of summaries, but requirements and article number might change. cc @Jdrewniak