Page MenuHomePhabricator

Create DAG for gathering initial Bulk Injestion Service dataset
Closed, ResolvedPublic8 Estimated Story Points

Description

When we are trying to start up new environment we want to be able to collect initial dataset (namespaces, projects, languages, codes) from our Bulk Ingestion Service using DAG, so that we can manually control when and how we can run this job.

Acceptance criteria
We can go in and trigger bulk-ingestion DAG that will call the service and collect initial dataset.

To-Do

  • create bulk-ingestion DAG that will trigger appropriate gRPC endpoints
  • make sure it's running correctly
  • add support for mutual TLS

Event Timeline

Daria_Kevana changed the task status from Open to In Progress.Nov 17 2022, 1:41 PM
Daria_Kevana changed the task status from In Progress to Open.Jan 3 2023, 3:55 PM