Page MenuHomePhabricator
Create Task
Maniphest T391013

Add an end-to-end Wikifunctions test suite from the MW API through the orchestrator to the evaluator and back, via Catalyst
Open, HighPublic
Actions

Description

  • We used to have this via PHPUnit on the Beta Cluster, but it flaked and we switched it off.
  • We also used to have e.g. the AppArmor tests, but had to disable them.
  • We re-enabled it as mock tests, testing the integration of the various WF components together, but now we're not testing that these mocks are actual reality.
  • We should re-establish these tests (or something like them) as a suite of end-to-end tests.
  • They shouldn't be browser tests (which are slow and flaky); we have those already, these should just hit the API.
  • For some paths, e.g. the AppArmor ones, they may need to be authenticated as a user.
  • Let's add this suite to the helm chart's test command for AW CI?
Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL · Credits