Page MenuHomePhabricator
Paste P59447

[load test] revertrisk language agnostic
ActivePublic
Actions

Authored by achou on Apr 4 2024, 9:33 AM.
Tags
None
Referenced Files
F44466566: [load test] revertrisk language agnostic
Apr 4 2024, 9:33 AM
Subscribers
None
aikochou@deploy1002:~/wrk/revertrisk$ wrk -c 1 -t 1 --timeout 3s -s revertrisk.lua https://inference-staging.svc.codfw.wmnet:30443/v1/models/revertrisk-language-agnostic:predict --header "Host: revertrisk-language-agnostic.revertrisk.wikimedia.org" --latency -- input
thread 1 created logfile wrk_1.log created
Running 10s test @ https://inference-staging.svc.codfw.wmnet:30443/v1/models/revertrisk-language-agnostic:predict
1 threads and 1 connections
Thread Stats Avg Stdev Max +/- Stdev
Latency 157.07ms 24.76ms 238.97ms 62.26%
Req/Sec 5.70 2.17 10.00 73.58%
Latency Distribution
50% 160.33ms
75% 171.71ms
90% 183.24ms
99% 238.97ms
53 requests in 10.02s, 19.43KB read
Requests/sec: 5.29
Transfer/sec: 1.94KB
thread 1 made 55 requests and got 53 responses
aikochou@deploy1002:~/wrk/revertrisk$ wrk -c 2 -t 2 --timeout 3s -s revertrisk.lua https://inference-staging.svc.codfw.wmnet:30443/v1/models/revertrisk-language-agnostic:predict --header "Host: revertrisk-language-agnostic.revertrisk.wikimedia.org" --latency -- input
thread 1 created logfile wrk_1.log created
thread 2 created logfile wrk_2.log created
Running 10s test @ https://inference-staging.svc.codfw.wmnet:30443/v1/models/revertrisk-language-agnostic:predict
2 threads and 2 connections
Thread Stats Avg Stdev Max +/- Stdev
Latency 136.30ms 24.13ms 308.42ms 92.44%
Req/Sec 6.73 2.56 10.00 56.30%
Latency Distribution
50% 131.23ms
75% 137.41ms
90% 148.95ms
99% 255.87ms
119 requests in 10.01s, 43.60KB read
Requests/sec: 11.88
Transfer/sec: 4.35KB
thread 1 made 61 requests and got 59 responses
thread 2 made 60 requests and got 60 responses
aikochou@deploy1002:~/wrk/revertrisk$ wrk -c 4 -t 4 --timeout 3s -s revertrisk.lua https://inference-staging.svc.codfw.wmnet:30443/v1/models/revertrisk-language-agnostic:predict --header "Host: revertrisk-language-agnostic.revertrisk.wikimedia.org" --latency -- input
thread 1 created logfile wrk_1.log created
thread 2 created logfile wrk_2.log created
thread 3 created logfile wrk_3.log created
thread 4 created logfile wrk_4.log created
Running 10s test @ https://inference-staging.svc.codfw.wmnet:30443/v1/models/revertrisk-language-agnostic:predict
4 threads and 4 connections
Thread Stats Avg Stdev Max +/- Stdev
Latency 135.20ms 27.44ms 362.52ms 94.17%
Req/Sec 6.79 2.62 10.00 50.63%
Latency Distribution
50% 127.99ms
75% 136.53ms
90% 149.08ms
99% 288.12ms
239 requests in 10.02s, 87.54KB read
Requests/sec: 23.85
Transfer/sec: 8.74KB
thread 1 made 61 requests and got 59 responses
thread 2 made 61 requests and got 60 responses
thread 3 made 60 requests and got 60 responses
thread 4 made 61 requests and got 60 responses
aikochou@deploy1002:~/wrk/revertrisk$ wrk -c 8 -t 4 --timeout 3s -s revertrisk.lua https://inference-staging.svc.codfw.wmnet:30443/v1/models/revertrisk-language-agnostic:predict --header "Host: revertrisk-language-agnostic.revertrisk.wikimedia.org" --latency -- input
thread 1 created logfile wrk_1.log created
thread 2 created logfile wrk_2.log created
thread 3 created logfile wrk_3.log created
thread 4 created logfile wrk_4.log created
Running 10s test @ https://inference-staging.svc.codfw.wmnet:30443/v1/models/revertrisk-language-agnostic:predict
4 threads and 8 connections
Thread Stats Avg Stdev Max +/- Stdev
Latency 152.79ms 48.78ms 502.30ms 90.05%
Req/Sec 11.61 4.39 20.00 73.08%
Latency Distribution
50% 136.78ms
75% 153.12ms
90% 200.32ms
99% 403.37ms
435 requests in 10.02s, 159.46KB read
Requests/sec: 43.43
Transfer/sec: 15.92KB
thread 1 made 110 requests and got 108 responses
thread 2 made 111 requests and got 109 responses
thread 3 made 111 requests and got 109 responses
thread 4 made 111 requests and got 109 responses
aikochou@deploy1002:~/wrk/revertrisk$ wrk -c 16 -t 4 --timeout 3s -s revertrisk.lua https://inference-staging.svc.codfw.wmnet:30443/v1/models/revertrisk-language-agnostic:predict --header "Host: revertrisk-language-agnostic.revertrisk.wikimedia.org" --latency -- input
thread 1 created logfile wrk_1.log created
thread 2 created logfile wrk_2.log created
thread 3 created logfile wrk_3.log created
thread 4 created logfile wrk_4.log created
Running 10s test @ https://inference-staging.svc.codfw.wmnet:30443/v1/models/revertrisk-language-agnostic:predict
4 threads and 16 connections
Thread Stats Avg Stdev Max +/- Stdev
Latency 169.68ms 57.09ms 547.37ms 90.23%
Req/Sec 20.44 8.61 40.00 40.32%
Latency Distribution
50% 150.90ms
75% 177.95ms
90% 224.09ms
99% 399.33ms
791 requests in 10.02s, 290.15KB read
Requests/sec: 78.97
Transfer/sec: 28.97KB
thread 1 made 201 requests and got 197 responses
thread 2 made 203 requests and got 200 responses
thread 3 made 200 requests and got 196 responses
thread 4 made 202 requests and got 198 responses
Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL