Page MenuHomePhabricator

Create helm chart for kartotherian k8s deployment
Open, In Progress, LowPublic

Description

This task is complete when we have a proof-of-concept helm chart ready for beta cluster or production deployment.

  • Generate a new, blank helm chart for kartotherian.
  • Copy existing deployment config template and variables over to a helm chart.
  • Minimize unnecessary customizations. Put configuration directly into the kartotherian-config.yaml file unless it really needs to vary between environments. Standardize the entry point so that defaults can be used.
  • Wire the beta and production, postgis replica database hosts. Should go through a load balancer or round-robin to the replica pool.
  • Wire postgres user and password as secrets.

Follow-up: Where should the OSM sync to master postgres be run? Perhaps in a specialized variant of the image and chart?

Event Timeline

Change 531699 had a related patch set uploaded (by Mathew.onipe; owner: Mathew.onipe):
[operations/deployment-charts@master] kartotherian: add kartotherian chart

https://gerrit.wikimedia.org/r/531699

akosiaris changed the task status from Open to Stalled.Mar 9 2020, 10:50 AM
akosiaris removed a project: SRE.
akosiaris subscribed.

Removing SRE for now (feel free to readd serviceops when needed) and settings as stalled since the old assignee is no longer around

awight changed the task status from Stalled to In Progress.Nov 3 2022, 4:04 PM
awight updated the task description. (Show Details)
awight removed awight as the assignee of this task.Nov 8 2022, 7:04 AM
awight moved this task from Doing to Sprint Backlog on the WMDE-TechWish-Sprint-2022-10-26 board.
awight added subscribers: jijiki, SLopes-WMF.
awight subscribed.

The patch feels pretty close, but I'm having trouble with the basic step of getting it to launch locally so will unassign myself in hope that better-educated devs can take over!

Where should the OSM sync to master postgres be run? Perhaps in a specialized variant of the image and chart?

IMHO, this will be a cookbook/automated script that runs in the bare metal cluster, specifically the master machines (maps[1-2]009). Considering that, the scripts will be available through the puppet rules and can be executed from the maps-master equivalent in the beta cluster.

Change 863260 had a related patch set uploaded (by Awight; author: Awight):

[operations/deployment-charts@master] [WIP] Port kartotherian chart to scaffolding v0.4 schema

https://gerrit.wikimedia.org/r/863260

Change 863260 abandoned by Awight:

[operations/deployment-charts@master] [WIP] Port kartotherian chart to v2 scaffolding schema

Reason:

Squashed.

https://gerrit.wikimedia.org/r/863260

Change 948551 had a related patch set uploaded (by Effie Mouzeli; author: Effie Mouzeli):

[operations/deployment-charts@master] (WIP) kartotherian: add kartotherian chart

https://gerrit.wikimedia.org/r/948551

Change 531699 abandoned by Effie Mouzeli:

[operations/deployment-charts@master] kartotherian: add kartotherian chart

Reason:

While we have done some good work here, there have been significant changes in our charts repository, making this patch difficult to update. I bootstrapped a new chart, where we can continue kartotherian's migration to k8s: I257fc19f781a54663f6ac420318ebf20e5a6c94d

https://gerrit.wikimedia.org/r/531699

Change 979092 had a related patch set uploaded (by Awight; author: Awight):

[operations/deployment-charts@master] [WIP] Include the application config volume

https://gerrit.wikimedia.org/r/979092

I've created a second patch to tweak some of the helm chart details, but now I see there's another layer of brokenness at the moment: the published container is missing an important dependency (this is a new problem),

libmapnik.so.3.0: cannot open shared object file: No such file or directory
Tobi_WMDE_SW subscribed.

the WMDE-TechWish team can dedicate some (timeboxed) support to this in the next sprint.

This isn't prioritized on the WMF side at the moment, so we can do the reviews we've been planning since December, then leave on ice again.