Page MenuHomePhabricator
Create Task
Maniphest T265290

Rediscover, review, and update the federation input process for WDQS
Open, HighPublic5 Estimated Story Points
Actions

Description

As a user of WDQS, I want to have an easy way to submit additional federation endpoints.

As an operator of WDQS, I want to have a simple process that provides flexibility but also protects the service from abuses.

https://www.wikidata.org/wiki/Wikidata:SPARQL_federation_input has been marked as inactive. Some dicussion around this topic: https://lists.wikimedia.org/pipermail/wikidata/2020-March/013929.html

We need community input on the process, the Search Platform team should not be in charge of deciding which request make sense and which does not.

We don't have a good understanding of the cost of federation from the WDQS perspective, we want to make sure there are no negative impact.

AC:

Event Timeline

Gehel created this task.Oct 12 2020, 2:47 PM
Restricted Application added a project: Wikidata. · View Herald TranscriptOct 12 2020, 2:47 PM
Restricted Application added a subscriber: Aklapper. · View Herald Transcript
Lea_Lacroix_WMDE subscribed.Oct 12 2020, 2:53 PM
Gehel moved this task from Incoming to Current work on the Wikidata-Query-Service board.Oct 12 2020, 3:32 PM
Gehel added a project: Discovery-Search (Current work).
Bugreporter subscribed.Oct 13 2020, 12:15 AM

Currently another way is to create a Phabricator task for each request of federation endpoint.

Zache subscribed.Oct 15 2020, 12:09 PM
Zache added a comment.Oct 25 2020, 9:37 AM

I created a discussion on the wikidata project chat for defining the community side of the process.

TJones renamed this task from Review the federation input process for WDQS to Rediscover, review, and update the federation input process for WDQS.Oct 26 2020, 6:34 PM
CBogen moved this task from Incoming to Blocked/Waiting on the Discovery-Search (Current work) board.Oct 26 2020, 6:35 PM
Salgo60 subscribed.Oct 29 2020, 10:19 AM
CBogen moved this task from Blocked/Waiting to Incoming on the Discovery-Search (Current work) board.Jan 25 2021, 4:43 PM
Gehel updated the task description. (Show Details)Feb 1 2021, 4:42 PM
CBogen set the point value for this task to 5.Feb 1 2021, 4:42 PM
CBogen moved this task from Incoming to Ready for Dev -- SWE on the Discovery-Search (Current work) board.
MPhamWMF claimed this task.Feb 4 2021, 3:59 PM
MPhamWMF moved this task from Ready for Dev -- SWE to In Progress on the Discovery-Search (Current work) board.
Psychoslave subscribed.Apr 7 2021, 5:17 PM
In T265290#6576489, @Zache wrote:

I created a discussion on the wikidata project chat for defining the community side of the process.

https://www.wikidata.org/wiki/Wikidata:Project_chat/Archive/2020/10#Updating_SPARQL_federation_input_review_process is the archived version link.

MPhamWMF removed a project: Discovery-Search (Current work).Aug 5 2021, 10:06 PM
MPhamWMF moved this task from Current work to User support on the Wikidata-Query-Service board.Aug 5 2021, 10:09 PM
MPhamWMF moved this task from User support to Docs on the Wikidata-Query-Service board.
Gehel triaged this task as High priority.Dec 16 2021, 1:33 PM
MPhamWMF removed MPhamWMF as the assignee of this task.Mar 14 2022, 2:28 PM
MPhamWMF subscribed.
Multichill added subscribers: OlafJanssen, Multichill.May 31 2022, 4:48 PM

@OlafJanssen is the latest victim at https://www.wikidata.org/wiki/Wikidata:SPARQL_federation_input

EgonWillighagen awarded a token.Aug 13 2022, 6:22 AM
mxn subscribed.Oct 7 2022, 8:45 PM
jleedev subscribed.Oct 7 2022, 8:52 PM
Zache added a comment.Oct 18 2022, 11:14 AM

I am still a little bit puzzled about what this needs to get forward. Is it a community process or WMF search team actions?

If it is a community discussion, could the process just:

  • Data in the endpoint needs to be openly licensed (CC-BY, CC0, CC-BY-SA, ODbL ... )
  • create a phabricator ticket for enabling the endpoint for federation
Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL