(An Untitled Masterwork)
ActivePublic
Actions

Authored by klausman on Feb 12 2024, 5:22 PM.

Tags

None

Referenced Files

	F41868832: raw-paste-data.txt
	Feb 12 2024, 5:22 PM

Subscribers

None

	Db schema for result cache, and a few entries:

	cqlsh:isvc_cache_revertrisk_multilingual> select * from rrml_res_cache ;

	wiki_db \| rev_id \| lastuse \| model_version \| p_false \| p_true \| prediction
	---------+--------+---------------------------------+---------------+----------+----------+------------
	enwiki \| 12345 \| 2024-02-12 18:03:24.387000+0100 \| 4 \| 0.406081 \| 0.593919 \| True
	enwiki \| 12346 \| 2024-02-12 18:08:07.462000+0100 \| 4 \| 0.498812 \| 0.501188 \| True
	enwiki \| 12399 \| 2024-02-12 18:16:07.154000+0100 \| 4 \| 0.549421 \| 0.450579 \| False
	enwiki \| 124810 \| 2024-02-12 18:16:30.479000+0100 \| 4 \| 0.47939 \| 0.52061 \| True


	Client view:

	~ $ time curl -sq localhost:8080/v1/models/revertrisk-multilingual:predict -X POST -d '{"lang": "en", "rev_id": 124810}'\|jq
	{
	"model_name": "revertrisk-multilingual",
	"model_version": "4",
	"wiki_db": "enwiki",
	"revision_id": 124810,
	"cache_hit": false,
	"output": {
	"prediction": true,
	"probabilities": {
	"true": 0.520610438460253,
	"false": 0.479389561539747
	}
	}
	}

	real 0m0.606s
	user 0m0.013s
	sys 0m0.014s
	~ $ time curl -sq localhost:8080/v1/models/revertrisk-multilingual:predict -X POST -d '{"lang": "en", "rev_id": 124810}'\|jq
	{
	"model_name": "revertrisk-multilingual",
	"model_version": 4,
	"wiki_db": "enwiki",
	"revision_id": 124810,
	"output": {
	"prediction": true,
	"probabilities": {
	"true": 0.5206104516983032,
	"false": 0.4793895483016968
	}
	},
	"cache_hit": true
	}

	real 0m0.025s
	user 0m0.012s
	sys 0m0.008s


	Server log:

	$ make USE_CACHE=1
	MODEL_PATH=revert_risk_model/models/model.pkl MODEL_NAME=revertrisk-multilingual .venv/bin/python revert_risk_model/model_server/model.py
	INFO:kserve:Registering model: revertrisk-multilingual
	INFO:kserve:Setting max asyncio worker threads as 12
	INFO:kserve:Starting uvicorn with 1 workers
	2024-02-12 18:21:49.219 uvicorn.error INFO: Started server process [61312]
	2024-02-12 18:21:49.219 uvicorn.error INFO: Waiting for application startup.
	2024-02-12 18:21:49.222 61312 kserve INFO [start():62] Starting gRPC server on [::]:8081
	2024-02-12 18:21:49.223 uvicorn.error INFO: Application startup complete.
	2024-02-12 18:21:49.223 uvicorn.error INFO: Uvicorn running on http://0.0.0.0:8080 (Press CTRL+C to quit)
	INFO:root:Received request for revision 124810 (en).
	WARNING:cassandra.cluster:Cluster.__init__ called with contact_points specified, but no load_balancing_policy. In the next major version, this will raise an error; please specify a load-balancing policy. (contact_points = ['172.17.1.3'], lbp = None)
	INFO:cassandra.policies:Using datacenter 'datacenter1' for DCAwareRoundRobinPolicy (via host '172.17.1.3:9042'); if incorrect, please specify a local_dc to the constructor, or limit contact points to local cluster nodes
	INFO:root:Could not find pp cache entry for en-124810 (res count 0)
	INFO:root:Opening a new Asyncio session for mwapi.
	INFO:root:Could not find res cache entry for enwiki 124810 (res count 0)
	2024-02-12 18:22:06.069 kserve.trace requestId: N.A., preprocess_ms: 453.232288361, explain_ms: 0, predict_ms: 97.497463226, postprocess_ms: 0.004768372
	2024-02-12 18:22:06.069 uvicorn.access INFO: 127.0.0.1:51542 61312 - "POST /v1/models/revertrisk-multilingual%3Apredict HTTP/1.1" 200 OK
	2024-02-12 18:22:06.069 kserve.trace kserve.io.kserve.protocol.rest.v1_endpoints.predict: 0.552250862121582
	2024-02-12 18:22:06.069 kserve.trace kserve.io.kserve.protocol.rest.v1_endpoints.predict: 0.31227200000000366
	INFO:root:Received request for revision 124810 (en).
	INFO:root:Returning cached preproc for en 124810
	INFO:root:Returning cached response for en 124810
	2024-02-12 18:22:06.933 kserve.trace requestId: N.A., preprocess_ms: 5.501270294, explain_ms: 0, predict_ms: 4.477262497, postprocess_ms: 0.002861023
	2024-02-12 18:22:06.933 uvicorn.access INFO: 127.0.0.1:35776 61312 - "POST /v1/models/revertrisk-multilingual%3Apredict HTTP/1.1" 200 OK
	2024-02-12 18:22:06.934 kserve.trace kserve.io.kserve.protocol.rest.v1_endpoints.predict: 0.011009931564331055
	2024-02-12 18:22:06.934 kserve.trace kserve.io.kserve.protocol.rest.v1_endpoints.predict: 0.005678999999

Event Timeline

klausman created this paste.Feb 12 2024, 5:22 PM

(An Untitled Masterwork)ActivePublicActions

Event Timeline

(An Untitled Masterwork)
ActivePublic
Actions