Page MenuHomePhabricator
Paste P85616

[Locust Tests] RevertRisk - Wikidata using prod configuration
ActivePublic
Actions

Authored by gkyziridis on Nov 25 2025, 2:06 PM.
# 500 users | 5 per second
$ MODEL_LOCUST_DIR="revertrisk_wikidata" make run-locust-test
[2025-11-25 13:54:07,783] stat1010/INFO/locust.main: Run time limit set to 120 seconds
[2025-11-25 13:54:07,783] stat1010/INFO/locust.main: Starting Locust 2.31.5
[2025-11-25 13:54:07,784] stat1010/INFO/locust.runners: Ramping to 500 users at a rate of 5.00 per second
[2025-11-25 13:55:46,924] stat1010/INFO/locust.runners: All users spawned: {"RevertriskWikidata": 500} (500 total users)
[2025-11-25 13:56:07,316] stat1010/INFO/locust.main: --run-time limit reached, shutting down
Load test results are within the threshold
[2025-11-25 13:56:07,494] stat1010/INFO/locust.main: Shutting down (exit code 1)
Type Name # reqs # fails | Avg Min Max Med | req/s failures/s
--------|----------------------------------------------------------------------------|-------|-------------|-------|-------|-------|-------|--------|-----------
POST /v1/models/revertrisk-wikidata:predict 6126 12(0.20%) | 2644 61 9392 2600 | 51.21 0.10
--------|----------------------------------------------------------------------------|-------|-------------|-------|-------|-------|-------|--------|-----------
Aggregated 6126 12(0.20%) | 2644 61 9392 2600 | 51.21 0.10
Response time percentiles (approximated)
Type Name 50% 66% 75% 80% 90% 95% 98% 99% 99.9% 99.99% 100% # reqs
--------|--------------------------------------------------------------------------------|--------|------|------|------|------|------|------|------|------|------|------|------
POST /v1/models/revertrisk-wikidata:predict 2600 3300 3700 3900 4600 5400 6500 7300 8500 9400 9400 6126
--------|--------------------------------------------------------------------------------|--------|------|------|------|------|------|------|------|------|------|------|------
Aggregated 2600 3300 3700 3900 4600 5400 6500 7300 8500 9400 9400 6126
Error report
# occurrences Error
------------------|---------------------------------------------------------------------------------------------------------------------------------------------
12 POST /v1/models/revertrisk-wikidata:predict: BadStatusCode('https://inference-staging.svc.codfw.wmnet:30443/v1/models/revertrisk-wikidata:predict', code=502)
------------------|---------------------------------------------------------------------------------------------------------------------------------------------
++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
# 500 users | 2 per second
$ MODEL_LOCUST_DIR="revertrisk_wikidata" make run-locust-test
[2025-11-25 13:57:54,409] stat1010/INFO/locust.main: Run time limit set to 120 seconds
[2025-11-25 13:57:54,409] stat1010/INFO/locust.main: Starting Locust 2.31.5
[2025-11-25 13:57:54,410] stat1010/INFO/locust.runners: Ramping to 500 users at a rate of 2.00 per second
[2025-11-25 13:59:53,905] stat1010/INFO/locust.main: --run-time limit reached, shutting down
Load test results are within the threshold
[2025-11-25 13:59:54,026] stat1010/INFO/locust.main: Shutting down (exit code 0)
Type Name # reqs # fails | Avg Min Max Med | req/s failures/s
--------|----------------------------------------------------------------------------|-------|-------------|-------|-------|-------|-------|--------|-----------
POST /v1/models/revertrisk-wikidata:predict 3715 0(0.00%) | 943 364 11883 860 | 31.07 0.00
--------|----------------------------------------------------------------------------|-------|-------------|-------|-------|-------|-------|--------|-----------
Aggregated 3715 0(0.00%) | 943 364 11883 860 | 31.07 0.00
Response time percentiles (approximated)
Type Name 50% 66% 75% 80% 90% 95% 98% 99% 99.9% 99.99% 100% # reqs
--------|--------------------------------------------------------------------------------|--------|------|------|------|------|------|------|------|------|------|------|------
POST /v1/models/revertrisk-wikidata:predict 860 1000 1100 1200 1400 1600 1900 2200 3300 12000 12000 3715
--------|--------------------------------------------------------------------------------|--------|------|------|------|------|------|------|------|------|------|------|------
Aggregated 860 1000 1100 1200 1400 1600 1900 2200 3300 12000 12000 3715
++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
# 100 users | 2 per second
$ MODEL_LOCUST_DIR="revertrisk_wikidata" make run-locust-test
[2025-11-25 14:01:11,144] stat1010/INFO/locust.main: Run time limit set to 120 seconds
[2025-11-25 14:01:11,145] stat1010/INFO/locust.main: Starting Locust 2.31.5
[2025-11-25 14:01:11,145] stat1010/INFO/locust.runners: Ramping to 100 users at a rate of 5.00 per second
[2025-11-25 14:01:30,186] stat1010/INFO/locust.runners: All users spawned: {"RevertriskWikidata": 100} (100 total users)
[2025-11-25 14:03:10,665] stat1010/INFO/locust.main: --run-time limit reached, shutting down
Load test results are within the threshold
[2025-11-25 14:03:10,772] stat1010/INFO/locust.main: Shutting down (exit code 0)
Type Name # reqs # fails | Avg Min Max Med | req/s failures/s
--------|----------------------------------------------------------------------------|-------|-------------|-------|-------|-------|-------|--------|-----------
POST /v1/models/revertrisk-wikidata:predict 3000 0(0.00%) | 705 352 11618 670 | 25.10 0.00
--------|----------------------------------------------------------------------------|-------|-------------|-------|-------|-------|-------|--------|-----------
Aggregated 3000 0(0.00%) | 705 352 11618 670 | 25.10 0.00
Response time percentiles (approximated)
Type Name 50% 66% 75% 80% 90% 95% 98% 99% 99.9% 99.99% 100% # reqs
--------|--------------------------------------------------------------------------------|--------|------|------|------|------|------|------|------|------|------|------|------
POST /v1/models/revertrisk-wikidata:predict 670 740 810 850 960 1100 1200 1300 1800 12000 12000 3000
--------|--------------------------------------------------------------------------------|--------|------|------|------|------|------|------|------|------|------|------|------
Aggregated 670 740 810 850 960 1100 1200 1300 1800 12000 12000 3000
Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL · Credits