In the past, we had issues with the Add Link recommended task no longer being sufficiently available for our users, and us only noticing this after users complained. We made fixes to resolve the issues, but we still have to add alerts for there being a problem in the first place.
Metrics to consider alerting on:
- Add Link clicks and/or Add Link saves being 0 overall (see KPI dashboard)
- refreshLinkRecommendation maintenance script not adding new recommendations (metric mediawiki_GrowthExperiments_refreshLinks_total with label outcome=success)
- tags ingested by elasitc/Cirrus search, see T373459: SUP: set up alerting for page_change_weighted_tags ingestion