Paste P67272

Results of deploying and testing langid model-server that was migrated to src dir
ActivePublic
Actions

Authored by kevinbazira on Aug 12 2024, 12:14 PM.

Tags

Referenced Files

	F57269258: Results of deploying and testing langid model-server that was migrated to src dir
	Aug 12 2024, 12:14 PM

Subscribers

None

	# pod running in eqiad
	kevinbazira@deploy1003:~$ kube_env llm ml-serve-eqiad
	kevinbazira@deploy1003:~$ kubectl get pods
	NAME READY STATUS RESTARTS AGE
	langid-predictor-default-00008-deployment-5d9cd57bfc-5djpd 3/3 Running 0 83s

	# pod running in codfw
	kevinbazira@deploy1003:~$ kube_env llm ml-serve-codfw
	kevinbazira@deploy1003:~$ kubectl get pods
	NAME READY STATUS RESTARTS AGE
	langid-predictor-default-00006-deployment-54547c56d4-xbgd7 3/3 Running 0 10s

	# isvc run successfully
	kevinbazira@deploy1003:~$ curl "https://inference.svc.codfw.wmnet:30443/v1/models/langid:predict" -X POST -d '{"text": "Some sample text in any language that we want to identify"}' -H "Host: langid.llm.wikimedia.org"
	{"language":"eng_Latn","wikicode":"en","languagename":"English","score":0.4073379337787628}

Event Timeline

kevinbazira created this paste.Aug 12 2024, 12:14 PM

kevinbazira mentioned this in T369344: Reorganize LiftWing isvcs repo structure to improve maintainability.