Page MenuHomePhabricator

move micro site transparency.wikimedia.org to kubernetes
Closed, ResolvedPublic

Description

Tracking task for migration of transparency.wikimedia.org and transparency-archive.wikimedia.org from Ganeti VMs to Kubernetes

Migration checklist (see complete steps here):

Event Timeline

Restricted Application added a subscriber: Aklapper. · View Herald Transcript

Change 929667 had a related patch set uploaded (by Jelto; author: Jelto):

[operations/deployment-charts@master] miscweb: add transparencyreport release to miscweb staging

https://gerrit.wikimedia.org/r/929667

Change 929667 merged by jenkins-bot:

[operations/deployment-charts@master] miscweb: add transparencyreport release to miscweb staging

https://gerrit.wikimedia.org/r/929667

Change 930180 had a related patch set uploaded (by Jelto; author: Jelto):

[operations/deployment-charts@master] misweb: use different host http header for readiness probe

https://gerrit.wikimedia.org/r/930180

Change 930180 merged by jenkins-bot:

[operations/deployment-charts@master] misweb: use different host http header for readiness probe

https://gerrit.wikimedia.org/r/930180

Change 930188 had a related patch set uploaded (by Jelto; author: Jelto):

[operations/deployment-charts@master] miscweb: add transparencyreport release to eqiad and codfw

https://gerrit.wikimedia.org/r/930188

Change 930188 merged by jenkins-bot:

[operations/deployment-charts@master] miscweb: add transparencyreport release to eqiad and codfw

https://gerrit.wikimedia.org/r/930188

Change 931894 had a related patch set uploaded (by Jelto; author: Jelto):

[operations/puppet@production] traficserver: switch miscweb transparency backend

https://gerrit.wikimedia.org/r/931894

Change 931897 had a related patch set uploaded (by Jelto; author: Jelto):

[operations/puppet@production] httpbb: move tests for transparency.wikimedia.org to miscweb-k8s

https://gerrit.wikimedia.org/r/931897

Change 931898 had a related patch set uploaded (by Jelto; author: Jelto):

[operations/puppet@production] miscweb: move probes for transparency to profile::microsites::monitoring

https://gerrit.wikimedia.org/r/931898

Service is deployed to Kubernetes and curl looks fine:

curl -I --resolve transparency.wikimedia.org:30443:$(dig +short k8s-ingress-wikikube.svc.eqiad.wmnet) https://transparency.wikimedia.org:30443 
HTTP/2 302 
date: Wed, 21 Jun 2023 11:46:55 GMT
server: istio-envoy
location: https://wikimediafoundation.org/about/transparency/current/
content-type: text/html; charset=iso-8859-1
x-envoy-upstream-service-time: 12

curl -I --resolve transparency-archive.wikimedia.org:30443:$(dig +short k8s-ingress-wikikube.svc.eqiad.wmnet) https://transparency-archive.wikimedia.org:30443 
HTTP/2 200 
date: Wed, 21 Jun 2023 11:47:29 GMT
server: istio-envoy
last-modified: Mon, 12 Jun 2023 13:37:57 GMT
accept-ranges: bytes
content-length: 5628
content-type: text/html

Above I prepared the changes to switch the traffic, tests and monitoring.

Change 931894 merged by Dzahn:

[operations/puppet@production] traficserver: switch miscweb transparency backend

https://gerrit.wikimedia.org/r/931894

Change 931897 merged by Dzahn:

[operations/puppet@production] httpbb: move tests for transparency.wikimedia.org to miscweb-k8s

https://gerrit.wikimedia.org/r/931897

Change 931898 merged by Dzahn:

[operations/puppet@production] miscweb: move probes for transparency to profile::microsites::monitoring

https://gerrit.wikimedia.org/r/931898

deployed the switch and moving the tests and probes.

after running puppet on cp4* via cumin, I confirmed I can still open transparency and transparency-archive while there were no more log entries in the apache logs on miscweb1003, the previous backend.

@Jelto Since I just gave the gerrit admin back already I gotta ask you to do the repo deprecation now. cheers

I will take care of removal on old backends ..right now.

Change 931966 had a related patch set uploaded (by Dzahn; author: Dzahn):

[operations/puppet@production] microsites: delete transparency.wikimedia.org classes

https://gerrit.wikimedia.org/r/931966

Change 931966 merged by Dzahn:

[operations/puppet@production] microsites: delete transparency.wikimedia.org classes

https://gerrit.wikimedia.org/r/931966

Mentioned in SAL (#wikimedia-operations) [2023-06-21T18:06:56Z] <mutante> miscweb1003/miscweb2003 - rm -rf /srv/org/wikimedia/TransparencyReport T338781