Page MenuHomePhabricator

[Airflow] Implement Dataset module
Closed, ResolvedPublic

Description

The Dataset module will help create Sensors more easily.
The properties of a dataset should be specified in a yaml file,
Then a Dataset class will read that, and be able to generate the correct Sensor
for a particular partitioning scheme and DAG granularity,
by just a line of code.