Maniphest T221096

Phester: parallel test execution
Closed, InvalidPublic
Actions

Assigned To

None

Authored By

	daniel
	Apr 16 2019, 2:22 PM

Tags

Referenced Files

None

Subscribers

• CCicalese_WMF

Description

Phester should be able to execute multiple tests in parallel. Tests within one suite can be executed in parallel as well, so all tests can be managed as a single "bucket". The requests within one test however have to be sequential.

All fixtures should be run before any test suites. The output for a test suite needs to be collected and written in one go, to avoid garbled output due to multiple test suites writing to the log in parallel.

Parallel execution is controlled with the --parallel <n> option, with 1 (no parallelism) being the default.

Side note: fixture execution could as well be parallelized, but that is more complex, since fixtures may depend on each other, so some fixtures need to to run before some others.

Related Objects
Search...

		Status	Subtype	Assigned	Task
		Stalled		Atieno	T219873 Create a suite of end-to-end API test for MediaWiki core
		Invalid		None	T219879 Create a test runner for end-to-end API tests (Phester)
		Invalid		None	T221096 Phester: parallel test execution

Event Timeline

daniel created this task.Apr 16 2019, 2:22 PM

daniel updated the task description. (Show Details)Apr 16 2019, 2:26 PM

daniel added a parent task: T221088: Baseline implementation of Phester test runner.

daniel updated the task description. (Show Details)Apr 16 2019, 2:37 PM

daniel removed parent tasks: T221088: Baseline implementation of Phester test runner, T221091: Phester: feature complete.Apr 16 2019, 4:09 PM

daniel added a subtask: T221088: Baseline implementation of Phester test runner.

daniel added a parent task: T221091: Phester: feature complete.

daniel edited parent tasks, added: T219879: Create a test runner for end-to-end API tests (Phester); removed: T221091: Phester: feature complete.Apr 16 2019, 4:11 PM

zeljkofilipin updated the task description. (Show Details)Jun 7 2019, 2:57 PM

daniel edited projects, added Platform Engineering (API Integration Tests); removed Platform Engineering (Needs Cleaning - Code Health (TEC13)).Jul 9 2019, 7:06 PM

• CCicalese_WMF removed a project: Platform Team Legacy (Next).Jul 14 2019, 3:13 PM

• CCicalese_WMF removed a parent task: T219879: Create a test runner for end-to-end API tests (Phester).Jul 14 2019, 10:13 PM

• CCicalese_WMF added a parent task: T227999: Full implementation of test runner.

• CCicalese_WMF removed a subtask: T221088: Baseline implementation of Phester test runner.Jul 14 2019, 10:15 PM

• WDoranWMF moved this task from API Integration Tests to mop on the Platform Engineering board.Jul 26 2019, 7:08 PM

• WDoranWMF edited projects, added Core Platform Team Initiatives (API Integration Tests); removed Platform Engineering (API Integration Tests).

We will not be building Phester.

• CCicalese_WMF edited parent tasks, added: T219879: Create a test runner for end-to-end API tests (Phester); removed: T227999: Full implementation of test runner.Aug 12 2019, 6:59 PM