Page MenuHomePhabricator

Present “AI tells” within suggestion mode
Open, Needs TriagePublic

Description

In T398478, we implemented a way for anyone with the technical know-how to show a suggestion when a specific span of text is matched/present within the article someone is editing.

In an effort to demonstrate one potential application of this capability, we'd like to implement a suggestion that surfaces when a community-defined "sign" of AI writing is detected within a given article.

Stories

As an experienced volunteer who is particularly interested in reducing the amount of content present on Wikipedia that is generated by AI without human intervention, I would value knowing if any "signs" of AI writing are present within the article I am reviewing/editing using the visual editor, so that I can use this information/signal to inform what – if any – moderation action I take in response.

Note: we can imagine a future wherein the suggestion this task is asking for could be combined with T402465 to further enable the above.

Requirements

  • Within the TextMatchEditCheck config, create rules that detect common language found in AI-generated content, as agreed upon in Signs of AI writing. To start, create these in en and fr.
  • Add the rules to their respective wikis, so they can be viewed live in suggestion mode.
  • To start, the only action that should accompany this particular suggestion is Dismiss

Event Timeline

@ppelberg, let me know if you'd rather this be a child of T404220.

ppelberg updated the task description. (Show Details)

@ppelberg, let me know if you'd rather this be a child of T404220.

The way you've related it works for me!

[Please review project tags/subscribers when creating subtasks - thanks!]

[Please review project tags/subscribers when creating subtasks - thanks!]

Sorry about that. Thank you!

First pass at configs for enwiki:

Configs for dewiki: