Page MenuHomePhabricator

Deploy tegola-vector-tiles to kubernetes
Closed, ResolvedPublic

Description

  • Review charts
  • tegola-vector-tiles namespaces in k8s. Example: a009787baa26fe8
  • tegola-vector-tiles accounts in k8s. Example: 15071cdd43ac50df0f
  • tegola-vector-tiles puppet private tokens. Example for labs/private: 2078705f3c40c99105d37fcaaac872bd5e28929e, puppet-private is on puppetmaster1001.
  • create swift account T283049
  • tegola-vector-tiles helmfile.d files
  • create postgres users allowed to connect from kubernetes pods
  • LVS setup
  • DNS for LVS records
  • Discovery DNS
  • Integration and Acceptance tests

Non Blockers for early deployments:

  • Use either envoy or pgbouncer for load balancing reads between postgress servers
  • Create a separate RO postgres user for tegola T292694

Details

ProjectBranchLines +/-Subject
operations/software/tegolawmf/v0.14.x+9 -1
operations/deployment-chartsmaster+1 -3
operations/deployment-chartsmaster+5 -1
operations/deployment-chartsmaster+2 -1
operations/deployment-chartsmaster+1 -1
operations/puppetproduction+1 -1
operations/puppetproduction+1 -1
operations/puppetproduction+1 -1
operations/puppetproduction+40 -0
operations/deployment-chartsmaster+2 -5
operations/deployment-chartsmaster+49 -1
operations/puppetproduction+92 -41
operations/puppetproduction+24 -0
operations/deployment-chartsmaster+4 -0
operations/deployment-chartsmaster+3 -1
operations/deployment-chartsmaster+20 -0
operations/deployment-chartsmaster+1 -0
operations/dnsmaster+2 -0
operations/puppetproduction+21 -2
operations/deployment-chartsmaster+176 -0
operations/deployment-chartsmaster+1 -0
operations/puppetproduction+10 -0
labs/privatemaster+12 -0
operations/deployment-chartsmaster+2 -1
Show related patches Customize query in gerrit

Event Timeline

jijiki renamed this task from Deploy maps-vector-server to kubernetes to Deploy tegola-vector-tiles to kubernetes.May 24 2021, 4:40 PM
jijiki updated the task description. (Show Details)

Change 693917 had a related patch set uploaded (by Effie Mouzeli; author: Effie Mouzeli):

[operations/deployment-charts@master] Rename maps-vector-server to tegola-vector-tiles

https://gerrit.wikimedia.org/r/693917

Change 692669 had a related patch set uploaded (by Effie Mouzeli; author: Effie Mouzeli):

[operations/puppet@production] Add tokens and users for tegola-vector-tiles

https://gerrit.wikimedia.org/r/692669

Change 693924 had a related patch set uploaded (by Effie Mouzeli; author: Effie Mouzeli):

[labs/private@master] Add tokens and users for tegola-vector-tiles

https://gerrit.wikimedia.org/r/693924

Change 693927 had a related patch set uploaded (by Effie Mouzeli; author: Effie Mouzeli):

[operations/deployment-charts@master] Add a namespace for tegola-vector-tiles service

https://gerrit.wikimedia.org/r/693927

Change 693917 merged by jenkins-bot:

[operations/deployment-charts@master] Rename maps-vector-server to tegola-vector-tiles

https://gerrit.wikimedia.org/r/693917

Change 693924 merged by Effie Mouzeli:

[labs/private@master] Add tokens and users for tegola-vector-tiles

https://gerrit.wikimedia.org/r/693924

Change 692669 merged by Effie Mouzeli:

[operations/puppet@production] Add tokens and users for tegola-vector-tiles

https://gerrit.wikimedia.org/r/692669

Change 693927 merged by jenkins-bot:

[operations/deployment-charts@master] Add a namespace for tegola-vector-tiles service

https://gerrit.wikimedia.org/r/693927

Change 701138 had a related patch set uploaded (by Effie Mouzeli; author: Effie Mouzeli):

[operations/deployment-charts@master] tegola-vector-tiles: add helmfile.d config

https://gerrit.wikimedia.org/r/701138

Change 701138 merged by Effie Mouzeli:

[operations/deployment-charts@master] tegola-vector-tiles: add helmfile.d config

https://gerrit.wikimedia.org/r/701138

tegola-vector-tiles is deployed to staging, but it is non functional as we need to create postgres users which are allowed to connect from the kubernetes pod subnets

Change 704394 had a related patch set uploaded (by Effie Mouzeli; author: Effie Mouzeli):

[operations/puppet@production] profile::osm_master: add tilenator users for kubepod subnets

https://gerrit.wikimedia.org/r/704394

Change 704394 merged by Effie Mouzeli:

[operations/puppet@production] profile::osm_master: add tilerator users for kubepod subnets

https://gerrit.wikimedia.org/r/704394

Change 704949 had a related patch set uploaded (by Effie Mouzeli; author: Effie Mouzeli):

[operations/puppet@production] conftool-data: add tegola-vector-tiles discovery

https://gerrit.wikimedia.org/r/704949

Change 704955 had a related patch set uploaded (by Effie Mouzeli; author: Effie Mouzeli):

[operations/dns@master] Add entries for tegola-vector-tiles service

https://gerrit.wikimedia.org/r/704955

Change 704955 merged by Effie Mouzeli:

[operations/dns@master] Add entries for tegola-vector-tiles service

https://gerrit.wikimedia.org/r/704955

Change 709717 had a related patch set uploaded (by Hnowlan; author: Hnowlan):

[operations/puppet@production] postgresql::user: split HBA configuration into a different define

https://gerrit.wikimedia.org/r/709717

Change 710013 had a related patch set uploaded (by Hnowlan; author: Hnowlan):

[operations/puppet@production] profile::maps::osm_replica: Allow replicas to be connected to by tegola

https://gerrit.wikimedia.org/r/710013

Change 713266 had a related patch set uploaded (by Jgiannelos; author: Jgiannelos):

[operations/deployment-charts@master] tegola-vector-tiles: Connect staging to test-eqiad kafka

https://gerrit.wikimedia.org/r/713266

Change 713467 had a related patch set uploaded (by Jgiannelos; author: Jgiannelos):

[operations/deployment-charts@master] tegola-vector-tiles: Reduce staging max_connections

https://gerrit.wikimedia.org/r/713467

Change 713467 merged by jenkins-bot:

[operations/deployment-charts@master] tegola-vector-tiles: Reduce staging max_connections

https://gerrit.wikimedia.org/r/713467

Change 713266 merged by jenkins-bot:

[operations/deployment-charts@master] tegola-vector-tiles: Connect staging to test-eqiad kafka

https://gerrit.wikimedia.org/r/713266

Change 713975 had a related patch set uploaded (by Jgiannelos; author: Jgiannelos):

[operations/deployment-charts@master] tegola-vector-tiles: Enable pregeneration job on staging

https://gerrit.wikimedia.org/r/713975

Change 713975 merged by jenkins-bot:

[operations/deployment-charts@master] tegola-vector-tiles: Enable pregeneration job on staging

https://gerrit.wikimedia.org/r/713975

Change 714044 had a related patch set uploaded (by Jgiannelos; author: Jgiannelos):

[operations/deployment-charts@master] tegola-vector-tiles: Add missing labels on cron pods

https://gerrit.wikimedia.org/r/714044

Change 714044 merged by jenkins-bot:

[operations/deployment-charts@master] tegola-vector-tiles: Add missing labels on cron pods

https://gerrit.wikimedia.org/r/714044

Change 709717 merged by Hnowlan:

[operations/puppet@production] postgresql::user: split HBA configuration into a different define

https://gerrit.wikimedia.org/r/709717

Change 710013 merged by Hnowlan:

[operations/puppet@production] profile::maps::osm_replica: Allow replicas to be connected to by tegola

https://gerrit.wikimedia.org/r/710013

Change 721894 had a related patch set uploaded (by Effie Mouzeli; author: Effie Mouzeli):

[operations/deployment-charts@master] tegola-version-tiles: enable tcp load balancer for postgres

https://gerrit.wikimedia.org/r/721894

Change 721894 merged by jenkins-bot:

[operations/deployment-charts@master] tegola-version-tiles: enable tcp load balancer for postgres

https://gerrit.wikimedia.org/r/721894

Change 722652 had a related patch set uploaded (by Jgiannelos; author: Jgiannelos):

[operations/deployment-charts@master] tegola-vector-tiles: Use envoy as DB proxy in all envs

https://gerrit.wikimedia.org/r/722652

Change 722652 merged by jenkins-bot:

[operations/deployment-charts@master] tegola-vector-tiles: Use envoy as DB proxy in all envs

https://gerrit.wikimedia.org/r/722652

We tried testing codfw/eqiad by just reaching out to one of the kubernetes nodes but since there is no discovery in place we faced TLS issues (kinda expected):
https://phabricator.wikimedia.org/P17315

Change 723476 had a related patch set uploaded (by Effie Mouzeli; author: Effie Mouzeli):

[operations/puppet@production] conftool-data: tegola-vector-tiles LVS 2

https://gerrit.wikimedia.org/r/723476

Change 723481 had a related patch set uploaded (by Effie Mouzeli; author: Effie Mouzeli):

[operations/puppet@production] conftool-data: tegola-vector-tiles LVS 3

https://gerrit.wikimedia.org/r/723481

Change 723485 had a related patch set uploaded (by Effie Mouzeli; author: Effie Mouzeli):

[operations/puppet@production] conftool-data: tegola-vector-tiles LVS 4

https://gerrit.wikimedia.org/r/723485

Change 704949 merged by Effie Mouzeli:

[operations/puppet@production] conftool-data: tegola-vector-tiles LVS 1

https://gerrit.wikimedia.org/r/704949

Change 723476 merged by Effie Mouzeli:

[operations/puppet@production] conftool-data: tegola-vector-tiles LVS 2

https://gerrit.wikimedia.org/r/723476

Change 723481 merged by Effie Mouzeli:

[operations/puppet@production] conftool-data: tegola-vector-tiles LVS 3

https://gerrit.wikimedia.org/r/723481

Change 723485 merged by Effie Mouzeli:

[operations/puppet@production] conftool-data: tegola-vector-tiles LVS 4

https://gerrit.wikimedia.org/r/723485

We are currently mirroring traffic from maps1* kartotherian to tegola on codfw k8s. Production requests are still served from kartotherian backed by cassandra.
Started gradually from 1% and now its responding to 50% of the mirrored traffic.

Change 725296 had a related patch set uploaded (by Jgiannelos; author: Jgiannelos):

[operations/deployment-charts@master] tegola-vector-tiles: Increase codfw replicas

https://gerrit.wikimedia.org/r/725296

Change 725296 merged by jenkins-bot:

[operations/deployment-charts@master] tegola-vector-tiles: Increase codfw replicas

https://gerrit.wikimedia.org/r/725296

Change 726891 had a related patch set uploaded (by Jgiannelos; author: Jgiannelos):

[operations/deployment-charts@master] tegola-vector-tiles: Use envoy for cronjob pods

https://gerrit.wikimedia.org/r/726891

Change 727134 had a related patch set uploaded (by Jgiannelos; author: Jgiannelos):

[operations/deployment-charts@master] tegola-vector-tiles: Fix config key for envoy timeout

https://gerrit.wikimedia.org/r/727134

Change 727133 had a related patch set uploaded (by Jgiannelos; author: Jgiannelos):

[operations/deployment-charts@master] tegola-vector-tiles: Use envoy for cronjob pods

https://gerrit.wikimedia.org/r/727133

Change 727133 abandoned by Jgiannelos:

[operations/deployment-charts@master] tegola-vector-tiles: Use envoy for cronjob pods

Reason:

Duplicate patch

https://gerrit.wikimedia.org/r/727133

jijiki updated the task description. (Show Details)

Tegola is running on kubernetes, Maps mirrored 100% of production traffic where we had no SRE-swift-storage issues. 🎉

Change 726891 merged by jenkins-bot:

[operations/deployment-charts@master] tegola-vector-tiles: Use envoy for cronjob pods

https://gerrit.wikimedia.org/r/726891

Change 727134 merged by jenkins-bot:

[operations/deployment-charts@master] tegola-vector-tiles: Fix config keys for envoy

https://gerrit.wikimedia.org/r/727134

Change 729959 had a related patch set uploaded (by Jgiannelos; author: Jgiannelos):

[operations/software/tegola@wmf/v0.14.x] tile-pregeneration: Exit envoy sidecar gracefully

https://gerrit.wikimedia.org/r/729959

Change 729959 merged by jenkins-bot:

[operations/software/tegola@wmf/v0.14.x] tile-pregeneration: Exit envoy sidecar gracefully

https://gerrit.wikimedia.org/r/729959