Page MenuHomePhabricator

[Scraper] Intended for reuse - new flag
Closed, ResolvedPublic5 Estimated Story Points

Description

As a Wikibase user and reuser, I want to explore Wikibases that are intended for data reuse and federation via the public discovery prototype.

Context:

  • The Wikibase wikibase-metadata prototype should only display those instances that are flagged for reuse and federation
  • We are aiming for the same functionality as Wikibase Cloud
  • We will select the intended instances manually in the beginning, until we have a clear opt-in and opt-out path in place

AC

  • The scraper API returns one additional flag per instance: 'reuse' true/false
  • When true: Scraper is collecting and storing all data from the instance, and data is available in a CSV file and exposed wikibase-metadata prototype
  • When false or null: Scraper is collecting and storing all data from the instance, data is only available in CSV file
  • We can manually set true or false
  • Make it an optional parameter in the AddWikibase query

Related ticket from Cloud team: https://phabricator.wikimedia.org/T421877

Event Timeline

Restricted Application changed the subtype of this task from "Task" to "Spike". · View Herald TranscriptNov 6 2025, 12:48 PM
Leif_WMDE triaged this task as Medium priority.Nov 12 2025, 10:09 AM
Leif_WMDE renamed this task from [Scraper] CallBack - track rejections to [Discovery] CallBack - track opt-in & opt-out.Feb 3 2026, 4:03 PM
Leif_WMDE renamed this task from [Discovery] CallBack - track opt-in & opt-out to [Discovery] CallBack - store opt-in & opt-out.Feb 3 2026, 4:09 PM
Leif_WMDE updated the task description. (Show Details)
Leif_WMDE edited projects, added: Story; removed: Spike.
Leif_WMDE changed the subtype of this task from "Spike" to "Task".
Leif_WMDE renamed this task from [Discovery] CallBack - store opt-in & opt-out to [Scraper] CallBack - store opt-in & opt-out.Feb 18 2026, 8:43 AM
Leif_WMDE set the point value for this task to 5.
Leif_WMDE renamed this task from [Scraper] CallBack - store opt-in & opt-out to [Scraper] Reuse (CallBack) - store opt-in & opt-out.Apr 28 2026, 9:47 AM
Leif_WMDE raised the priority of this task from Medium to Needs Triage.Apr 28 2026, 12:46 PM
Leif_WMDE renamed this task from [Scraper] Reuse (CallBack) - store opt-in & opt-out to [Scraper] Intended for reuse - new flag.Apr 28 2026, 4:45 PM
Leif_WMDE updated the task description. (Show Details)
Jacob_WMDE subscribed.