Page MenuHomePhabricator

Migrate recommendation-api to mw-api-int
Closed, ResolvedPublic

Description

Switch backend mw-api calls from baremetal api_appserver cluster to kubernetes hosted mw-api-int

Event Timeline

Clement_Goubert created this task.
Clement_Goubert moved this task from Incoming 🐫 to this.quarter 🍕 on the serviceops board.

Change 905943 had a related patch set uploaded (by Clément Goubert; author: Clément Goubert):

[operations/deployment-charts@master] recommendation-api: Switch to mw-api-int-async on k8s

https://gerrit.wikimedia.org/r/905943

@leila @ori If you could provide me with a way to test that recommendation-api works correctly after changing api backend, it'd be much appreciated :)

Hi @santhosh. given that you or your team have worked most closely with the recommendation-api as of the past few years, will you be able to help Clement here?

Without further input, I will be relying on our monitoring and service-checker-swagger which checks the x-amples from the /?spec path.
I'm scheduling this migration for May 3rd, 10:00UTC.

Change 905943 merged by jenkins-bot:

[operations/deployment-charts@master] recommendation-api: Switch to mw-api-int-async on k8s

https://gerrit.wikimedia.org/r/905943

Mentioned in SAL (#wikimedia-operations) [2023-05-03T10:40:26Z] <claime> Migrating recommendation-api staging to mw-api-int-async - T334062

cgoubert@deploy1002:/srv/deployment-charts/helmfile.d/services/recommendation-api$ service-checker-swagger staging.svc.eqiad.wmnet https://staging.svc.eqiad.wmnet:4632
All endpoints are healthy

All good on staging, proceeding with production in codfw

Mentioned in SAL (#wikimedia-operations) [2023-05-03T10:50:10Z] <claime> Migrating recommendation-api codfw to mw-api-int-async - T334062

cgoubert@deploy1002:/srv/deployment-charts/helmfile.d/services/recommendation-api$ service-checker-swagger recommendation-api.svc.codfw.wmnet https://recommendation-api.svc.codfw.wmnet:4632
All endpoints are healthy

All good in codfw, proceeding with eqiad.

Mentioned in SAL (#wikimedia-operations) [2023-05-03T10:51:32Z] <claime> Migrating recommendation-api eqiad to mw-api-int-async - T334062

cgoubert@deploy1002:/srv/deployment-charts/helmfile.d/services/recommendation-api$ service-checker-swagger recommendation-api.svc.eqiad.wmnet https://recommendation-api.svc.eqiad.wmnet:4632
All endpoints are healthy

Looks good in eqiad, request graphs are crossing over

image.png (916×1 px, 116 KB)

Requests have now completely crossed over from mwapi-async (baremetal) to mw-api-int-async (k8s).

Resolving the task, feel free to reopen in case of issue.