OpusMT Openblas performance 100 requests with concurrency 10
ActivePublic
Actions

Authored by santhosh on Apr 8 2020, 11:55 AM.

Tags

None

Referenced Files

	F31743189: raw.txt
	Apr 8 2020, 11:55 AM

Subscribers

None

	santhosh@stat1008:~$ ab -n 100 -c 10 -p English.txt -T "application/json" http://localhost:8888/api/translate
	This is ApacheBench, Version 2.3 <$Revision: 1843412 $>
	Copyright 1996 Adam Twiss, Zeus Technology Ltd, http://www.zeustech.net/
	Licensed to The Apache Software Foundation, http://www.apache.org/

	Benchmarking localhost (be patient).....done


	Server Software: TornadoServer/6.0.4
	Server Hostname: localhost
	Server Port: 8888

	Document Path: /api/translate
	Document Length: 1065 bytes

	Concurrency Level: 10
	Time taken for tests: 727.528 seconds
	Complete requests: 100
	Failed requests: 0
	Total transferred: 121900 bytes
	Total body sent: 112200
	HTML transferred: 106500 bytes
	Requests per second: 0.14 [#/sec] (mean)
	Time per request: 72752.764 [ms] (mean)
	Time per request: 7275.276 [ms] (mean, across all concurrent requests)
	Transfer rate: 0.16 [Kbytes/sec] received
	0.15 kb/s sent
	0.31 kb/s total

	Connection Times (ms)
	min mean[+/-sd] median max
	Connect: 0 0 0.1 0 0
	Processing: 7309 68807 13392.6 72702 73311
	Waiting: 7309 68807 13392.6 72702 73311
	Total: 7310 68807 13392.6 72702 73311

	Percentage of the requests served within a certain time (ms)
	50% 72702
	66% 72803
	75% 72871
	80% 72903
	90% 73016
	95% 73127
	98% 73268
	99% 73311
	100% 73311 (longest request)

Event Timeline