Page MenuHomePhabricator

Use a standard markup specification for collecting featured feed content from individual wikis
Open, Needs TriagePublic

Description

Currently, featured feed content is scraped from individual wikis using custom, per-wiki selectors due to differences in how they lay out and present featured content. This approach is inherently brittle, since it can break at any time due to layout changes; and it limits the number of wikis for which we can practically support featured content feeds.

A better approach is to publish a markup specification containing agreed-upon selectors that the wikifeeds service can use to efficiently identify featured content. This will improve the stability of the service and allow any wiki to opt in to featured feed support if there is editor motivation to do so.

A draft feed content markup specification is published at https://www.mediawiki.org/wiki/User:CFloyd_(WMF)/Feed_Markup_Documentation. We should begin implementing feed content aggregation logic based on it, making adjustments as needed as the spec is finalized.

Event Timeline

Restricted Application added a subscriber: Aklapper. · View Herald TranscriptSep 30 2019, 2:13 PM
Mholloway renamed this task from Create a feed content parser based on a standard markup specification to Aggregate featured feed content based on a standard markup specification.Sep 30 2019, 2:14 PM

@eprodromou We can discuss this in the next Feature Request meeting. IIRC, you were working on something adjacent to this.

Just to clarify: My understanding was that it would be Product Infrastructure implementing this; I just tagged CPT for notice since it did indeed arise out of discussions with @eprodromou.

LGoto added a project: Epic.Oct 2 2019, 3:39 PM
LGoto moved this task from Needs triage to Epics on the Product-Infrastructure-Team-Backlog board.
Mholloway renamed this task from Aggregate featured feed content based on a standard markup specification to Use a standard markup specification for collecting featured feed content from individual wikis.Oct 2 2019, 7:17 PM

Updated the title for clarity.

Hooray! Glad to see this coming in

I linked this to our project for increasing the number of featured feeds.