Page MenuHomePhabricator

[SPIKE] - Document and determine gaps for Experiment Platform automation
Open, Needs TriagePublic

Description

Work with @KReid-WMF and other members of the Experiment Platform team to document:

Existing test coverage, frameworks and suites for Experiment Platform code.
Potential improvements or gaps in coverage
Understanding of how unit tests are created - are they based off of Acceptance Criteria?

Output would be either a document or spreadsheet or something that shows:

Tests - Framework used - What they cover

Questions to answer include:

Do automated tests cover "Critical User Journeys" or anything that might be an Unbreak Now

Event Timeline

@KReid-WMF Can you add links to the following to help us out:

Repo name
Docs page link (is there a good starting place on mediawiki)
Any other information that would be useful

Based on refinement conversation this morning:

This is intertwined with another ticket (T417926).

Emeka is researching and understanding the new functionality within Test Kitchen and the scope of the current project, which will lead him to a plan for creating new tests to cover the new functionality.

Some open questions:

Does the testing continue living in its own repo?
What test cases that are discovered should be covered by automation?