Page MenuHomePhabricator

Add RKD to WDQS allowlist
Closed, ResolvedPublic1 Estimated Story Points

Description

Request to allow federation with the knowledge graph of the RKD (Netherlands Institute for Art History)

Details

Other Assignee
bking
Related Changes in Gerrit:

Event Timeline

pfischer set the point value for this task to 1.Jul 14 2025, 3:45 PM

Change #1169208 had a related patch set uploaded (by Ebernhardson; author: Ebernhardson):

[operations/puppet@production] Add RKD to WDQS allowlist

https://gerrit.wikimedia.org/r/1169208

It looks like the provided endpoint goes to the UI, whereas actual SPARQL requests sent via that UI hit https://rkd.triply.cc/_api/datasets/rkd/RKD-Knowledge-Graph/services/SPARQL/sparql. So I believe that https://rkd.triply.cc/_api/datasets/rkd/RKD-Knowledge-Graph/services/SPARQL/sparql is the value we'll want to use as the actual sparql endpoint for the purposes of the allowlist.

RKemper updated Other Assignee, added: bking.
RKemper added a subscriber: EBernhardson.

Change #1169208 merged by Ryan Kemper:

[operations/puppet@production] Add RKD to WDQS allowlist

https://gerrit.wikimedia.org/r/1169208

@EBernhardson When I run this query, I am getting the error:

image.png (452×1 px, 67 KB)

Construct an awkward thing that checks all the servers for errors:

for host in $(cat /etc/dsh/group/wdqs | grep -v ^# | grep -v ^$ | sort); do 
    echo "$host: $(curl -sk "https://$host/sparql?query=SELECT%20%3Fs%20%3Fp%20%3Fo%20%7B%0A%20%20SERVICE%20%3Chttps%3A%2F%2Frkd.triply.cc%2F_api%2Fdatasets%2Frkd%2FRKD-Knowledge-Graph%2Fservices%2FSPARQL%2Fsparql%3E%20%7B%0A%20%20%20%20%3Fs%20%3Fp%20%3Fo%0A%20%20%7D%0A%7D%0ALIMIT%2010" | grep '^Caused by: java.lang.IllegalArgumentException: Service URI https://rkd.triply.cc/_api/datasets/rkd/RKD-Knowledge-Graph/services/SPARQL/sparql is not allowed$')"
done

Looks like eqiad didn't pick up the change, similarly two hosts in codfw missed it as well (but they are wdqs::internal_{scolarly,main} and wouldn't effect query.wikidata.org).

wdqs1011.eqiad.wmnet: Caused by: java.lang.IllegalArgumentException: Service URI https://rkd.triply.cc/_api/datasets/rkd/RKD-Knowledge-Graph/services/SPARQL/sparql is not allowed
wdqs1012.eqiad.wmnet: Caused by: java.lang.IllegalArgumentException: Service URI https://rkd.triply.cc/_api/datasets/rkd/RKD-Knowledge-Graph/services/SPARQL/sparql is not allowed
wdqs1013.eqiad.wmnet: Caused by: java.lang.IllegalArgumentException: Service URI https://rkd.triply.cc/_api/datasets/rkd/RKD-Knowledge-Graph/services/SPARQL/sparql is not allowed
wdqs1014.eqiad.wmnet: Caused by: java.lang.IllegalArgumentException: Service URI https://rkd.triply.cc/_api/datasets/rkd/RKD-Knowledge-Graph/services/SPARQL/sparql is not allowed
wdqs1015.eqiad.wmnet: Caused by: java.lang.IllegalArgumentException: Service URI https://rkd.triply.cc/_api/datasets/rkd/RKD-Knowledge-Graph/services/SPARQL/sparql is not allowed
wdqs1016.eqiad.wmnet: Caused by: java.lang.IllegalArgumentException: Service URI https://rkd.triply.cc/_api/datasets/rkd/RKD-Knowledge-Graph/services/SPARQL/sparql is not allowed
wdqs1017.eqiad.wmnet: Caused by: java.lang.IllegalArgumentException: Service URI https://rkd.triply.cc/_api/datasets/rkd/RKD-Knowledge-Graph/services/SPARQL/sparql is not allowed
wdqs1018.eqiad.wmnet: Caused by: java.lang.IllegalArgumentException: Service URI https://rkd.triply.cc/_api/datasets/rkd/RKD-Knowledge-Graph/services/SPARQL/sparql is not allowed
wdqs1019.eqiad.wmnet: Caused by: java.lang.IllegalArgumentException: Service URI https://rkd.triply.cc/_api/datasets/rkd/RKD-Knowledge-Graph/services/SPARQL/sparql is not allowed
wdqs1020.eqiad.wmnet: Caused by: java.lang.IllegalArgumentException: Service URI https://rkd.triply.cc/_api/datasets/rkd/RKD-Knowledge-Graph/services/SPARQL/sparql is not allowed
wdqs1021.eqiad.wmnet: Caused by: java.lang.IllegalArgumentException: Service URI https://rkd.triply.cc/_api/datasets/rkd/RKD-Knowledge-Graph/services/SPARQL/sparql is not allowed
wdqs1022.eqiad.wmnet: Caused by: java.lang.IllegalArgumentException: Service URI https://rkd.triply.cc/_api/datasets/rkd/RKD-Knowledge-Graph/services/SPARQL/sparql is not allowed
wdqs1023.eqiad.wmnet: Caused by: java.lang.IllegalArgumentException: Service URI https://rkd.triply.cc/_api/datasets/rkd/RKD-Knowledge-Graph/services/SPARQL/sparql is not allowed
wdqs1024.eqiad.wmnet: Caused by: java.lang.IllegalArgumentException: Service URI https://rkd.triply.cc/_api/datasets/rkd/RKD-Knowledge-Graph/services/SPARQL/sparql is not allowed
wdqs1025.eqiad.wmnet: Caused by: java.lang.IllegalArgumentException: Service URI https://rkd.triply.cc/_api/datasets/rkd/RKD-Knowledge-Graph/services/SPARQL/sparql is not allowed
wdqs1026.eqiad.wmnet: Caused by: java.lang.IllegalArgumentException: Service URI https://rkd.triply.cc/_api/datasets/rkd/RKD-Knowledge-Graph/services/SPARQL/sparql is not allowed
wdqs1027.eqiad.wmnet: Caused by: java.lang.IllegalArgumentException: Service URI https://rkd.triply.cc/_api/datasets/rkd/RKD-Knowledge-Graph/services/SPARQL/sparql is not allowed
wdqs2007.codfw.wmnet: 
wdqs2008.codfw.wmnet: 
wdqs2009.codfw.wmnet: 
wdqs2010.codfw.wmnet: 
wdqs2011.codfw.wmnet: 
wdqs2012.codfw.wmnet: 
wdqs2013.codfw.wmnet: 
wdqs2014.codfw.wmnet: 
wdqs2015.codfw.wmnet: 
wdqs2016.codfw.wmnet: 
wdqs2017.codfw.wmnet: 
wdqs2018.codfw.wmnet: 
wdqs2019.codfw.wmnet: 
wdqs2020.codfw.wmnet: 
wdqs2021.codfw.wmnet: 
wdqs2022.codfw.wmnet: 
wdqs2023.codfw.wmnet: 
wdqs2024.codfw.wmnet: 
wdqs2025.codfw.wmnet: 
wdqs2026.codfw.wmnet: Caused by: java.lang.IllegalArgumentException: Service URI https://rkd.triply.cc/_api/datasets/rkd/RKD-Knowledge-Graph/services/SPARQL/sparql is not allowed
wdqs2027.codfw.wmnet: Caused by: java.lang.IllegalArgumentException: Service URI https://rkd.triply.cc/_api/datasets/rkd/RKD-Knowledge-Graph/services/SPARQL/sparql is not allowed