Maniphest T343729

<SPIKE> Discovery for CI/CD Testing for AQS 2.0
Open, HighPublic
Actions

Assigned To

None

Authored By

	VirginiaPoundstone
	Aug 7 2023, 3:34 PM

Tags

Referenced Files

None

Subscribers

VirginiaPoundstone

Description

Once deployed to production, the AQS 2.0 services need a way to run the tests continuously to ensure stability and quality. When discussed running the Python-based test suite in CI previously (citation needed), there were a lot of challenges.

Open Questions

could automated tests run in a cron-based fashion on Toolforge/Cloud VPS?
Is there an automated report system that AQS team members are prompted to check regularly
is there a way to implement an automated alert system?
how will we check for regressions?
can we use gitlab?
how does RESTbase do it?
Does serviceops have insights?
Are AQS test environments (cassandra/druid) ready to run into a CICD pipeline?

References

Doing Unique CI Things: DUCT
AQS 2.0: Revisit in-service testing approach: https://phabricator.wikimedia.org/T328969#8623061

Related Objects
Search...

		Status	Subtype	Assigned	Task
		Open		None	T343729 <SPIKE> Discovery for CI/CD Testing for AQS 2.0
		Open		None	T330223 AQS 2.0: refactor Cassandra testing env for use in CI

Event Timeline

VirginiaPoundstone created this task.Aug 7 2023, 3:34 PM

Restricted Application added a subscriber: Aklapper. · View Herald TranscriptAug 7 2023, 3:34 PM

VirginiaPoundstone updated the task description. (Show Details)Aug 7 2023, 3:34 PM

Sfaci updated the task description. (Show Details)Aug 7 2023, 4:59 PM

Sfaci updated the task description. (Show Details)

Sfaci added a subtask: T330223: AQS 2.0: refactor Cassandra testing env for use in CI.Aug 7 2023, 5:03 PM

Sfaci updated the task description. (Show Details)Aug 17 2023, 7:46 AM

VirginiaPoundstone added a project: Data Products.Aug 25 2023, 5:15 PM

VirginiaPoundstone moved this task from Incoming to To be discussed/To be estimated on the AQS2.0 board.

VirginiaPoundstone moved this task from To be discussed/To be estimated to AQS 2.0 Epics on the AQS2.0 board.

VirginiaPoundstone triaged this task as High priority.Aug 25 2023, 5:18 PM

VirginiaPoundstone moved this task from Incoming to Epics / Initiatives / Projects in Process on the Data Products board.Aug 25 2023, 5:42 PM

VirginiaPoundstone moved this task from Epics / Initiatives / Projects in Process to Epics Timeline on the Data Products board.Sep 10 2023, 1:03 AM

VirginiaPoundstone edited projects, added Data Products (Epics Timeline); removed Data Products.

VirginiaPoundstone moved this task from Backlog to Q1 23/24 on the Data Products (Epics Timeline) board.Sep 10 2023, 1:06 AM

VirginiaPoundstone renamed this task from <discovery> CI/CD Testing to <SPIKE> Discovery for CI/CD Testing for AQS 2.0.Sep 10 2023, 1:31 AM

VirginiaPoundstone moved this task from Epics Timeline to To be discussed/To be estimated on the Data Products board.

VirginiaPoundstone edited projects, added Data Products; removed Data Products (Epics Timeline).

VirginiaPoundstone removed a project: Epic.

VirginiaPoundstone moved this task from To be discussed/To be estimated to Epics Timeline on the Data Products board.Sep 19 2023, 2:47 PM

VirginiaPoundstone edited projects, added Data Products (Epics Timeline); removed Data Products.

VirginiaPoundstone moved this task from Q1 23/24 to Backlog on the Data Products (Epics Timeline) board.Jan 24 2024, 9:24 PM

VirginiaPoundstone moved this task from Backlog to Q3 23/24 on the Data Products (Epics Timeline) board.Mar 22 2024, 12:14 PM