Page MenuHomePhabricator

Develop an extension to implement LLM summaries of changes
Open, Needs TriagePublicFeature

Description

Feature summary (what you would like to be able to do and where):

Related a bit to T14411, but also distinct as this does not auto fill the edit summary field.

There should be an extension that summarizes changes between two revisions using LLMs. It would be visible as a tooltip on history pages, and at the top of diffs, fetching data from a backend that uses Ollama, and then displaying a summary of the change. This is intended to supplement, not replace, edit summaries.

This would be hidden if the change itself is revision deleted.

Use case(s) (list the steps that you performed to discover that problem, and describe the actual underlying problem which you want to solve. Do not describe only a solution):

The primary use case is for when edit summaries are insufficient for describing the change, as is common with some edits. We can potentially also flag to see whether the change is adequately described by the edit summary, and if not, we can mark the change for review with a lower ORES score.

Benefits (why should this be implemented?):

This should be implemented to benefit patrollers when an edit summary is insufficient to describe the edits.