Page MenuHomePhabricator

Create the MPIC docker image build pipeline
Closed, ResolvedPublic

Description

Goal

As the MPIC app will need to run a docker container from a docker image, this image will need to be built and deployed to our registry in the first place.

This is something that should be tackled by the Metrics Platform team, with help from the Data Platform SREs, as a way to share knowledge and experience.

AC

  • mpic repo has been added to trusted-runners (merged)
  • mpic repo has a gitlab CI/CD set up with blubber and kokkuri (review)
  • mpic repo has the main branch and tags protected (no tags at this moment but the main branch is already protected)

Notes

  • From Thomas at slack:
    • To create the docker image and put it on the registry, you need to:
      • Have the repo added to trusted-runners
      • Have a gitlab CI/CD set up with blubber and kokkuri
      • Have the main branch and tags protected

Details

TitleReferenceAuthorSource BranchDest Branch
Add repos/data-engineering/mpic to trusted runnersrepos/releng/gitlab-trusted-runner!72dancymain-Idac5121fcc6d2e7cc78f6663599bb75899c88ebamain
Customize query in GitLab

Event Timeline

Sfaci updated the task description. (Show Details)
Sfaci added a subscriber: cjming.
Sfaci updated the task description. (Show Details)

Hi @BTullis !

As a first step, I have been working on the GitLab CI/CD and I have added you as reviewer for a MR I have prepared: https://gitlab.wikimedia.org/repos/data-engineering/mpic/-/merge_requests/8
Can you take a look?

At this moment the new pipeline is failing while pushing a change for this MR during the test stage because we have a couple of sample integration test cases that try to connect to the database we have in our development environment (we have a couple of unit test cases that worked well). Is there any way to have something similar to run with the pipeline or should we avoid running that step?

mpic:v0.0.1 was just released!