User Story
As a platform engineer I need to deploy data pipeline code and dependencies to production infra, using generally available tools and practices
Success Criteria
- Data pipelines modules and dependencies are published to Archiva
- Data pipelines modules and dependencies are automatically deployed on build
Notes for grooming
- This is a requirement for https://phabricator.wikimedia.org/T295807
- Need to make sure we can auth to archiva
- The dep management model won't change, we'll just need to publish conda-env artifacts and jars to archiva instead of Gitlab.