Page MenuHomePhabricator

AQS 2.0 Druid-based services: Explore how to run QA test suite using Docker
Closed, ResolvedPublic

Description

Goals

To run the QA test suite using docker before deploying any druid service

Background

Our entry point is the blubber file we use to deploy the service. Using that file we should be able to create a docker image to run the service as a docker container in our laptop. Once done that, we'd need run a docker-compose project in such a way we run a project with two containers in the same network: service and druid. If we export the service port, we will be to run the QA test against the dockerized service that will connect to the druid one to fetch the data.

Tasks
  • Blubber file
    • Prepare the blubber file. We can take the one we use for cassandra-based services
  • Dockerize the service
    • Create a docker image with the service from the blubber file. We can do it the same way we did for cassandra-based services
  • Customize Druid test env to run in a docker-compose project with the service (merged)
    • Prepare a docker-compose project to be able to run the service and test env container together in the same docker network
  • Document all the needed steps (shared document for both cassandra and druid services)
  • Test it first in an specific service and prepare the rest of them according to the steps that are explained in the documentation
Related tasks

T344373: AQS 2.0 Cassandra-based services: Explore how to run QA test suite using Docker

Event Timeline

Sfaci updated the task description. (Show Details)
Sfaci triaged this task as Low priority.Sep 13 2023, 9:01 AM
Sfaci moved this task from Sprint Backlog to In Process on the Data Products (Sprint 01) board.

Change 957315 had a related patch set uploaded (by Santiago Faci; author: Santiago Faci):

[generated-data-platform/aqs/editor-analytics@main] Ready to be dockerized for deployment and QA purposes

https://gerrit.wikimedia.org/r/957315

Sfaci updated the task description. (Show Details)
Sfaci moved this task from In Process to Ready for Code Review on the Data Products (Sprint 01) board.

Besides the previous patch related to editor-analytics (https://gerrit.wikimedia.org/r/957315), there is another pull request about the druid test environment: https://github.com/bpirkle/aqs-docker-druid-test-env/pull/4

The pull request about druid test environment has been already merged

Change 957315 merged by jenkins-bot:

[generated-data-platform/aqs/editor-analytics@main] Ready to be dockerized for deployment and QA purposes

https://gerrit.wikimedia.org/r/957315

This comment was removed by Sfaci.
Sfaci removed a project: Patch-For-Review.
Sfaci added a subscriber: SGupta-WMF.

Change 960577 had a related patch set uploaded (by Santiago Faci; author: Santiago Faci):

[generated-data-platform/aqs/edit-analytics@main] Prepared to be dockerized and tested using QA test suite via Docker

https://gerrit.wikimedia.org/r/960577

Besides the previous MR about the needed changes made to the service, another MR is ready to be reviewed (and merged) about adding this service to the Druid test env for QA: https://github.com/bpirkle/aqs-docker-druid-test-env/pull/5

Hi @Sfaci I think Bill should review and merge this one as its in his repo

Change 960577 merged by Santiago Faci:

[generated-data-platform/aqs/edit-analytics@main] Prepared to be dockerized and tested using QA test suite via Docker

https://gerrit.wikimedia.org/r/960577

Just for the record and to reply Surbhi's comment: I'm sorry, I forgot to mention that Bill already merged the last MR I mentioned about Druid test env.
So, in this moment, all pending changes have been merged.