Page MenuHomePhabricator

Set up a working, usable dbt installation on stat boxes
Closed, ResolvedPublic

Description

Use Puppet to facilitate a working copy of the dbt tool on our stat10XX.eqiad.wmnet machines.

Done is:

NOTE: As per DPE - dbt Platform Integration - The first connector that we wish to test is dbt-spark running in session mode.
  • dbt-core package/binaries installable through Puppet (via conda-analytics)
  • dbt-spark package supported, with proper configuration files either automatically installed or documented for personal use
  • dbt-hive package supported, with proper configuration files either automatically installed or documented for personal use
  • dbt-trino package supported for Presto/Trino access, with proper configuration files either automatically installed or documented for personal use

Event Timeline

LSobanski subscribed.

Presumably this is correct, please revert if not.

Ahoelzl updated the task description. (Show Details)

@BTullis with https://phabricator.wikimedia.org/T406766 being completed, what is the additional work here? Thanks!

Ahoelzl claimed this task.