Page MenuHomePhabricator

Create k8s ingress config and VIP for ores-legacy
Closed, ResolvedPublic

Description

Same work done for T335756, but in production (ml-serve k8s clusters).

The new VIP will be ores-legacy.discovery.wmnet, and it will not be a single catch-all VIP like in the staging use case.

Event Timeline

Change 920216 had a related patch set uploaded (by Elukey; author: Elukey):

[operations/dns@master] Add VIP records for the new k8s-ingress-ml-serve endpoint

https://gerrit.wikimedia.org/r/920216

Change 920218 had a related patch set uploaded (by Elukey; author: Elukey):

[operations/puppet@production] service::catalog: add initial config for k8s-ingress-ml-serve

https://gerrit.wikimedia.org/r/920218

Change 920219 had a related patch set uploaded (by Elukey; author: Elukey):

[operations/puppet@production] service::catalog: switch k8s-ingress-ml-serve to lvs_setup

https://gerrit.wikimedia.org/r/920219

Change 920220 had a related patch set uploaded (by Elukey; author: Elukey):

[operations/puppet@production] service::catalog: switch k8s-ingress-ml-serve to production

https://gerrit.wikimedia.org/r/920220

Change 920221 had a related patch set uploaded (by Elukey; author: Elukey):

[operations/dns@master] Add discovery configuration for k8s-ingress-ml-serve

https://gerrit.wikimedia.org/r/920221

Change 920222 had a related patch set uploaded (by Elukey; author: Elukey):

[operations/dns@master] Add ores-legacy.discovery.wment configuration

https://gerrit.wikimedia.org/r/920222

Change 920216 merged by Elukey:

[operations/dns@master] Add VIP records for the new k8s-ingress-ml-serve endpoint

https://gerrit.wikimedia.org/r/920216

Change 920218 merged by Elukey:

[operations/puppet@production] service::catalog: add initial config for k8s-ingress-ml-serve

https://gerrit.wikimedia.org/r/920218

Change 920219 merged by Elukey:

[operations/puppet@production] service::catalog: switch k8s-ingress-ml-serve to lvs_setup

https://gerrit.wikimedia.org/r/920219

Mentioned in SAL (#wikimedia-operations) [2023-05-17T09:39:07Z] <elukey> roll restart pybal on lvs2010, lvs2009, lvs1020, lvs1019 to pick up a VIP (see https://gerrit.wikimedia.org/r/c/operations/puppet/+/920219) - T336726

Change 920220 merged by Elukey:

[operations/puppet@production] service::catalog: switch k8s-ingress-ml-serve to production

https://gerrit.wikimedia.org/r/920220

Change 920221 merged by Elukey:

[operations/dns@master] Add discovery configuration for k8s-ingress-ml-serve

https://gerrit.wikimedia.org/r/920221

Change 920222 merged by Elukey:

[operations/dns@master] Add ores-legacy.discovery.wment configuration

https://gerrit.wikimedia.org/r/920222

Mentioned in SAL (#wikimedia-operations) [2023-05-17T14:17:41Z] <elukey> run authdns-update for new ml-serve/ores discovery endpoints - T336726

Change 920712 had a related patch set uploaded (by Elukey; author: Elukey):

[operations/dns@master] Add discovery configuration for k8s-ingress-ml-serve

https://gerrit.wikimedia.org/r/920712

Change 920712 merged by Elukey:

[operations/dns@master] Add discovery configuration for k8s-ingress-ml-serve

https://gerrit.wikimedia.org/r/920712

elukey@stat1004:~$ time curl "https://ores-legacy.discovery.wmnet:31443/v3/scores/enwiki/123433/damaging" -i --http1.1 
HTTP/1.1 200 OK
date: Wed, 17 May 2023 15:54:01 GMT
server: istio-envoy
content-length: 377
content-type: application/json
x-envoy-upstream-service-time: 135

{
  "enwiki": {
    "models": {
      "damaging": {
        "version": "0.5.1"
      }
    }, 
    "scores": {
      "123433": {
        "damaging": {
          "score": {
            "prediction": false, 
            "probability": {
              "false": 0.9899875154315122, 
              "true": 0.010012484568487832
            }
          }
        }
      }
    }
  }
}
real	0m0.168s
user	0m0.013s
sys	0m0.003s