Page MenuHomePhabricator

Generate TLS certs for new WDQS endpoints
Closed, ResolvedPublic

Description

AC:

  • One TLS cert each, generated via cergen, for:
    • full-graph
    • main-graph
    • scholarly-articles

Event Timeline

I wonder whether should look at using the PKI for these certificates, rather than cergen.
I can look out some examples of where we have done this elsewhere in the Data Engineering infrastrcuture, in case that helps.
https://wikitech.wikimedia.org/wiki/PKI/Clients

We did the initial work to get envoy via PKI / cfssl operational in https://phabricator.wikimedia.org/T354555#9454855. Next up is adding specific alt-names for the three new endpoints. Here's a few different proposals for naming scheme:

  • full.query.wikidata.org, main.query.wikidata.org, scholar.query.wikidata.org
  • full.wikidata.org, main.wikidata.org, scholar.wikidata.org
  • full-query.wikidata.org, main-query.wikidata.org, and scholarly-query.wikidata.org
  • full-query.wikidata.org, main-query.wikidata.org, and scholar.wikidata.org
  • full-graph.wikidata.org, main-graph.wikidata.org, and scholar-graph.wikidata.org

Basically the main uncertainties are: do we want query in the domain? If so, do we want it to be X.query.wikidata.org where X is one of [full, main, scholarly] or rather X-query.wikidata.org?

Talked with gehel, ebernhardson, and inflatador. We're going to start with full-experimental.query.wikidata.org, main-experimental.query.wikidata.org, scholarly-experimental.query.wikidata.org to get these 3 test endpoints up. Meanwhile, we can open up the convo with the community as far as what the ultimate "final" naming/domain scheme will be wrt https://phabricator.wikimedia.org/T354043

Change 991088 had a related patch set uploaded (by Ryan Kemper; author: Ryan Kemper):

[operations/puppet@production] wdqs: add exp graph split endpoints to alt_names

https://gerrit.wikimedia.org/r/991088

Change 991088 merged by Ryan Kemper:

[operations/puppet@production] wdqs: add exp graph split endpoints to alt_names

https://gerrit.wikimedia.org/r/991088

Change 991089 had a related patch set uploaded (by Ryan Kemper; author: Ryan Kemper):

[operations/puppet@production] wdqs graph-split: subdomain of query.wikidata.org

https://gerrit.wikimedia.org/r/991089

Change 991089 merged by Ryan Kemper:

[operations/puppet@production] wdqs graph-split: subdomain of query.wikidata.org

https://gerrit.wikimedia.org/r/991089

Gehel triaged this task as High priority.Jan 22 2024, 2:27 PM

These 3 new services have their internal certs working with Envoy. Moving to Done and spun off https://phabricator.wikimedia.org/T355593 for the last cert-related work.