Page MenuHomePhabricator

Reduce Test Flake in Evaluator CI
Closed, ResolvedPublic

Description

Description

A few tests are still flaky. The main sources of flake are

  • test-load, which fails because the runtime expectations are too stringent;
  • lost artifacts due to the long wasmtime compile step, which usually manifests in javascript - test debug

Desired behavior/Acceptance criteria (returned value, expected error, performance expectations, etc.)

  • the tests are not flaky anymore

Completion checklist

Event Timeline

Sharvaniharan lowered the priority of this task from High to Medium.
Sharvaniharan moved this task from To triage to 25Q2 (Oct–Dec) on the Abstract Wikipedia team board.

Change #1078950 had a related patch set uploaded (by Jforrester; author: Jforrester):

[operations/deployment-charts@master] wikifunctions: Upgrade evaluators from 2024-09-24-221243 to 2024-10-08-175510

https://gerrit.wikimedia.org/r/1078950

Change #1078950 merged by jenkins-bot:

[operations/deployment-charts@master] wikifunctions: Upgrade evaluators from 2024-09-24-221243 to 2024-10-08-175510

https://gerrit.wikimedia.org/r/1078950