Automated Visual Regression Testing for GrowthExperiments
Open, MediumPublic
Actions

Assigned To

Authored By

	Etonkovidova
	Jul 27 2022, 9:30 PM

Description

GrowthExperiments projects have a heavy reliance on providing consistent user experience via UI features, so a visual regression tool will ensure the quality of the projects' deliverables.

https://pixel.wmcloud.org/ tool (https://github.com/nicholasray/pixel) was created to alleviate UI regression testing for Echo project (see T302246: [GOAL] Leverage Automated Visual Regression Testing for more details).

What needs to be done:

Define a catalog of UIs that we want to test for visual regressions
- AddImage inspector
- AddLink inspector
- Suggested edits card
- ?
Incorporate checking for UI regressions into the chore list (it is not currently possible to do in CI)
make https://github.com/nicholasray/pixel work for GrowthExperiments projects

Related Objects
Search...

		Status	Subtype	Assigned	Task
		Open		Etonkovidova	T313993 Automated Visual Regression Testing for GrowthExperiments
		Resolved	BUG REPORT	• nray	T319480 Add Special:Homepage visual regression test to Pixel

Event Timeline

Etonkovidova created this task.Jul 27 2022, 9:30 PM

Restricted Application added a project: Growth-Team. · View Herald TranscriptJul 27 2022, 9:30 PM

Restricted Application added a subscriber: Aklapper. · View Herald Transcript

KStoller-WMF awarded a token.Jul 27 2022, 11:27 PM

kostajh awarded a token.Jul 28 2022, 2:12 PM

kostajh updated the task description. (Show Details)

kostajh moved this task from Inbox to Upcoming Work on the Growth-Team board.Jul 29 2022, 3:25 PM

Etonkovidova edited projects, added User-Etonkovidova; removed GrowthExperiments, Growth-Team.Aug 22 2022, 4:56 PM

Etonkovidova moved this task from Incoming to In progress on the User-Etonkovidova board.

I did installation and running commands according to https://github.com/nicholasray/pixel (for Echo extension); the following error was displayed when I ran

~/Documents/docker/pixel$ ./pixel.js reference
/Users/etonkovidova/Documents/docker/pixel/src/BatchSpawn.js:19
	#batchSize;
	^

SyntaxError: Invalid or unexpected token
    at Module._compile (internal/modules/cjs/loader.js:723:23)
    at Object.Module._extensions..js (internal/modules/cjs/loader.js:789:10)
    at Module.load (internal/modules/cjs/loader.js:653:32)
    at tryModuleLoad (internal/modules/cjs/loader.js:593:12)
    at Function.Module._load (internal/modules/cjs/loader.js:585:3)
    at Module.require (internal/modules/cjs/loader.js:692:17)
    at require (internal/modules/cjs/helpers.js:25:18)
    at Object.<anonymous> (/Users/etonkovidova/Documents/docker/pixel/pixel.js:6:20)
    at Module._compile (internal/modules/cjs/loader.js:778:30)
    at Object.Module._extensions..js (internal/modules/cjs/loader.js:789:10)