Kartotherian should use discovery endpoint to connect to wikidata query service
Open, NormalPublic

Description

Kartotherian (as part of geoshape service) connects to WDQS through a web proxy and via query.wikidata.org. Since this is functionally internal traffic, it should go to wdqs.discovery.wmnet instead, and not use a proxy at all. We still want Kartotherian to use the "public" wdqs cluster, since it allows arbitrary queries directly from user. See T200594, T195438 and T195559 for more context.

It seems that configuring the wdqs endpoint is already possible, but undocumented. It is not clear to me if bypassing web proxy is configurable or not.

Gehel created this task.Sep 27 2018, 8:46 AM
Restricted Application added a subscriber: Aklapper. · View Herald TranscriptSep 27 2018, 8:46 AM

Change 463281 had a related patch set uploaded (by Mholloway; owner: Mholloway):
[operations/puppet@production] Kartotherian: Add wikidata_query_service var for configuring WDQS endpoint

https://gerrit.wikimedia.org/r/463281

Change 463285 had a related patch set uploaded (by Mholloway; owner: Mholloway):
[maps/kartotherian/deploy@master] Explicitly specify WDQS endpoint

https://gerrit.wikimedia.org/r/463285

Change 463281 merged by Gehel:
[operations/puppet@production] Kartotherian: Add wikidata_query_service var for configuring WDQS endpoint

https://gerrit.wikimedia.org/r/463281

Change 463285 merged by Mholloway:
[maps/kartotherian/deploy@master] Explicitly specify WDQS endpoint

https://gerrit.wikimedia.org/r/463285

Mentioned in SAL (#wikimedia-operations) [2018-10-03T07:05:38Z] <mholloway-shell@deploy1001> Started deploy [kartotherian/deploy@27062b4] (maps1004): Specify WDQS endpoint at wdqs.discovery.wmnet in the service config (T205607)

Mentioned in SAL (#wikimedia-operations) [2018-10-03T07:06:06Z] <mholloway-shell@deploy1001> Finished deploy [kartotherian/deploy@27062b4] (maps1004): Specify WDQS endpoint at wdqs.discovery.wmnet in the service config (T205607) (duration: 00m 28s)

Mentioned in SAL (#wikimedia-releng) [2018-10-03T07:07:40Z] <mdholloway> deployment-maps04 deployed [kartotherian/deploy@27062b4]: Specify WDQS endpoint in the service config (T205607)

Mholloway triaged this task as Normal priority.

Deployment to the remaining maps hosts is blocked on the stretch upgrade.