We have deployed our first test OpenSearch cluster in dse-k8s-eqiad (ref T404907). Our next step is to repeat the process for the opensearch-ipoid-test and opensearch-ipoid namespaces, in both eqiad and codfw datacenters.
Creating this ticket to:
| Status | Subtype | Assigned | Task | ||
|---|---|---|---|---|---|
| Stalled | None | T357753 Build next iteration of IPoid using OpenSearch/ElasticSearch as backend | |||
| Resolved | kostajh | T408238 Create Airflow job that loads Spur data | |||
| Resolved | bking | T408012 Roll out OpenSearch cluster in `opensearch-ipoid-test` and `opensearch-ipoid` namespaces | |||
| Resolved | bking | T408919 OpenSearch on K8s: Create separate user for the OpenSearch operator |
Change #1198139 had a related patch set uploaded (by Bking; author: Bking):
[operations/deployment-charts@master] WIP: deploy a test OpenSearch cluster in opensearch-ipoid-test ns
Change #1198381 had a related patch set uploaded (by Bking; author: Bking):
[operations/deployment-charts@master] admin_ng (dse-k8s): watch more OpenSearch-related namespaces
Change #1198381 merged by jenkins-bot:
[operations/deployment-charts@master] admin_ng (dse-k8s): watch more OpenSearch-related namespaces
Change #1199030 had a related patch set uploaded (by Bking; author: Bking):
[operations/deployment-charts@master] opensearch-operator: Update image version
Change #1199030 merged by Bking:
[operations/deployment-charts@master] opensearch-operator: Update image version
Change #1199075 had a related patch set uploaded (by Bking; author: Bking):
[operations/deployment-charts@master] admin_ng (dse-k8s): watch more OpenSearch-related namespaces
Change #1199075 merged by Bking:
[operations/deployment-charts@master] admin_ng (dse-k8s): watch more OpenSearch-related namespaces
Per today's Airflow/OpenSearch meeting with @brouberol and @kostajh , we need to enable outbound access to the urldownloader so the iPoid Airflow job can download its data from an external source.
Change #1199297 had a related patch set uploaded (by Brouberol; author: Brouberol):
[operations/puppet@production] global_config: add an urldownloader external service
Change #1199297 merged by Brouberol:
[operations/puppet@production] global_config: add an urldownloader external service
Change #1199778 had a related patch set uploaded (by Brouberol; author: Brouberol):
[operations/puppet@production] global_config/hotifx: urldownloader hosts are addressable via a wikimedia.org host
Change #1199778 merged by Brouberol:
[operations/puppet@production] global_config: urldownloader hostnames end with wikimedia.org
Change #1199818 had a related patch set uploaded (by Bking; author: Bking):
[operations/deployment-charts@master] dse-k8s-eqiad: Raise default resources of for opensearch namespaces
Change #1199818 merged by jenkins-bot:
[operations/deployment-charts@master] dse-k8s-eqiad: Raise default resources of for opensearch namespaces
Change #1200093 had a related patch set uploaded (by Bking; author: Bking):
[operations/deployment-charts@master] opensearch-cluster: temporarily remove prometheus-related annotations from chart
Change #1200093 merged by Bking:
[operations/deployment-charts@master] opensearch-cluster: temporarily remove prometheus-related annotations from chart
Change #1200135 had a related patch set uploaded (by Bking; author: Bking):
[operations/deployment-charts@master] opensearch-cluster: stop hard-coding admin username
Change #1200135 merged by Bking:
[operations/deployment-charts@master] opensearch-cluster: stop hard-coding admin username
Change #1200145 had a related patch set uploaded (by Bking; author: Bking):
[operations/dns@master] dse-k8s: Create CNAME record for opensearch-ipoid-test
Change #1200145 merged by Bking:
[operations/dns@master] dse-k8s: Create CNAME record for opensearch-ipoid-test
Change #1200171 had a related patch set uploaded (by Bking; author: Bking):
[operations/deployment-charts@master] opensearch-cluster: fix chart typo
Change #1200171 merged by Bking:
[operations/deployment-charts@master] opensearch-cluster: fix chart typo
I've deployed opensearch-ipoid-test successfully from my homedir:
$ kubectl get po NAME READY STATUS RESTARTS AGE opensearch-ipoid-test-masters-0 1/1 Running 0 11m opensearch-ipoid-test-masters-1 1/1 Running 0 7m3s opensearch-ipoid-test-masters-2 1/1 Running 0 5m14s opensearch-ipoid-test-securityconfig-update-n9kn5 0/1 Completed 0
We'll work on T408919 before proceeding with opensearch-ipoid, as it is considered a production namespace.
Change #1198139 merged by Bking:
[operations/deployment-charts@master] Add OpenSearch cluster configs for net-new clusters
Change #1206969 had a related patch set uploaded (by Bking; author: Bking):
[operations/deployment-charts@master] dse-k8s-codfw: set minimum resources for opensearch namespaces
Change #1206973 had a related patch set uploaded (by Bking; author: Bking):
[operations/deployment-charts@master] opensearch on k8s: Add CODFW environment to helmfiles
Change #1207166 had a related patch set uploaded (by Bking; author: Bking):
[operations/deployment-charts@master] opensearch-cluster: give 'opensearch' user access to bulk API
Change #1206969 merged by Bking:
[operations/deployment-charts@master] dse-k8s-codfw: set minimum resources for opensearch namespaces
Change #1207166 merged by Bking:
[operations/deployment-charts@master] opensearch-cluster: give 'opensearch' user access to bulk API
Change #1206973 merged by jenkins-bot:
[operations/deployment-charts@master] opensearch on k8s: Add CODFW environment to helmfiles
Change #1207194 had a related patch set uploaded (by Bking; author: Bking):
[operations/deployment-charts@master] opensearch-cluster: Add cluster ro permissions to 'opensearch' user
Change #1207194 merged by Bking:
[operations/deployment-charts@master] opensearch-cluster: Add cluster ro perms to 'opensearch' user, increase default num of replicas
I forgot to update this before the break, but looking at the OpenSearch on K8s dashboard we can see that opensearch-ipoid and opensearch-ipoid-test clusters are deployed in codfw and eqiad. As such, I'm closing this one out.
@kostajh , please reopen this ticket if you are unable to access the clusters or if you need any other assistance.