Page MenuHomePhabricator

Create a helm chart for Superset
Closed, ResolvedPublic

Description

We require a helm chart for Superset.

This may be created from scratch ourselves, or it could be based upon the upstream chart at: helm/superset.

If we wish to make substantial use of the upstream chart then it would have to be assessed under the Kubernetes upstream helm charts policy.

The chart should define the memcached cache services to be used.
The chart should also include the TLS terminator component.

Event Timeline

BTullis moved this task from Incoming to Quarterly Goals on the Data-Platform-SRE board.

Change 984869 had a related patch set uploaded (by Btullis; author: Btullis):

[operations/deployment-charts@master] WIP Add a superset chart and helmfiles

https://gerrit.wikimedia.org/r/984869

Change 987785 had a related patch set uploaded (by Btullis; author: Btullis):

[operations/deployment-charts@master] Add a deployment chart for Superset

https://gerrit.wikimedia.org/r/987785

Change 984869 abandoned by Btullis:

[operations/deployment-charts@master] WIP Add a superset chart and helmfiles

Reason:

Replaced with split patches instead.

https://gerrit.wikimedia.org/r/984869

Reassigning to @brouberol for now, as he is going to take over my in-progress patch for the helm chart.

Change 997423 had a related patch set uploaded (by Brouberol; author: Brouberol):

[operations/deployment-charts@master] Set large pod CPU/memory limits for the superset namespaces

https://gerrit.wikimedia.org/r/997423

Change 997423 merged by Brouberol:

[operations/deployment-charts@master] Set large pod CPU/memory limits for the superset namespaces

https://gerrit.wikimedia.org/r/997423

Mentioned in SAL (#wikimedia-analytics) [2024-02-05T13:50:36Z] <brouberol> increasing pod & container limits in the dse-k8s-eqiad superset/superset-next namespaces - T352166

We're at a point where the superset container runs in Kubernetes and responds to health checks:

brouberol@deploy2002:~/charts/superset$ kubectl get pod -w
NAME                                 READY   STATUS    RESTARTS   AGE
superset-superset-76fbcf76cb-v7mwk   4/4     Running   0          6m45s

Change 987785 merged by Brouberol:

[operations/deployment-charts@master] Add a deployment chart for Superset

https://gerrit.wikimedia.org/r/987785

Change 1006521 had a related patch set uploaded (by Brouberol; author: Brouberol):

[operations/deployment-charts@master] superset: disable rate limiting

https://gerrit.wikimedia.org/r/1006521

Change 1006856 had a related patch set uploaded (by Brouberol; author: Brouberol):

[operations/deployment-charts@master] superset: fix the memcached service label selector

https://gerrit.wikimedia.org/r/1006856

Change 1006856 merged by Brouberol:

[operations/deployment-charts@master] superset: fix the memcached service label selector

https://gerrit.wikimedia.org/r/1006856

Change 1006521 abandoned by Brouberol:

[operations/deployment-charts@master] superset: disable rate limiting

Reason:

You're right Ben, and I could have sworn that I had abandoned this change due to this very reason. Oh well, abandoning now.

https://gerrit.wikimedia.org/r/1006521

Change 1007618 had a related patch set uploaded (by Brouberol; author: Brouberol):

[operations/deployment-charts@master] superset: include all configuration checksums into the Deployment annotations

https://gerrit.wikimedia.org/r/1007618

Change 1007618 merged by Brouberol:

[operations/deployment-charts@master] superset: include all configuration checksums into the Deployment annotations

https://gerrit.wikimedia.org/r/1007618