Link Recommendations: write a maintenance script to analyze the cached link recommendation contents
Open, Needs TriagePublic
Actions

Assigned To

None

Authored By

	KStoller-WMF
	Jul 25 2023, 5:06 PM

Description

Follow up task related to: T316079: Bump threshold for confidence score on link recommendation service suggestions

Write a maintenance script to analyze the cached link recommendation contents, which we can then re-use for improved monitoring in T278083: Define SLIs/SLOs for link recommendation service.

User story & summary:

As the Growth team, I want to analyze cached link recommendations, so that I can set up better monitoring and SLOs.

Acceptance Criteria:

Create a histogram / overview of how the minimum link-score of a page is distributed across the suggestions in the database (see T316079#9091797 for reference).

Related Objects

Mentioned In: T316079: Bump threshold for confidence score on link recommendation service suggestions
Mentioned Here: T278083: Define SLIs/SLOs for link recommendation service
T316079: Bump threshold for confidence score on link recommendation service suggestions

Event Timeline

KStoller-WMF created this task.Jul 25 2023, 5:06 PM

Restricted Application added a subscriber: Aklapper. · View Herald TranscriptJul 25 2023, 5:06 PM

KStoller-WMF mentioned this in T316079: Bump threshold for confidence score on link recommendation service suggestions.Jul 25 2023, 5:09 PM

Urbanecm_WMF moved this task from Inbox to Triaged on the Growth-Team board.Jan 23 2024, 3:30 PM

Michael subscribed.Jul 24 2024, 9:59 AM

This maintenance tasks should probably provide a histogram / overview of how the minimum link-score of a page is distributed across the suggestions in the database (see T316079#9091797 for reference).
Also, I think it would maybe be nice to have a breakdown of the number of suggestions per topic. (Though this info is already available on Special:NewcomerTasksInfo, albeit with some delay.)

I wonder if there are any other topics we may wish to investigate?

Do we maybe want to make the distribution of minimum link-scores also available on Special:NewcomerTasksInfo instead of in a script?

KStoller-WMF updated the task description. (Show Details)Oct 23 2024, 12:16 AM

Link Recommendations: write a maintenance script to analyze the cached link recommendation contentsOpen, Needs TriagePublicActions