Change Details

This will cover 2 validations at the moment: - article count sanity - corruption **To do** [] Allow configurable airflow variables for: - Tolerance (start with 10 %) - Validated projects (default: consider using few main ones enwiki, frwiki, dewiki, etc.) - Validated namespaces (default [0]) [] Create tasks to call `IsCorrupt` and `ValidateArticleCounts` as per the env variables. [] Test dag in dev (using your feature branch) [] Tune task timeouts [] Deploy `snapshotsvalidations` service to prod [] Deploy dag to prod (this means merging feature -> main) [] Test dag in prod **Acceptance criteria** [] Dag runs with expected task outputs in dev [] Dag runs with expected task outputs in prod

This will cover 2 validations at the moment: - article count sanity - corruption **To do** [] Dag that runs everyday at 12 UTC. Allow configurable airflow variables for: - Tolerance (start with 10 %) - Validated projects (default: consider using few main ones enwiki, frwiki, dewiki, etc.) - Validated namespaces (default [0]) [] Create tasks to call `IsCorrupt` and `ValidateArticleCounts` as per the env variables. [] Test dag in dev (using your feature branch) [] Tune task timeouts [] Deploy `snapshotsvalidations` service to prod [] Deploy dag to prod (this means merging feature -> main) [] Test dag in prod **Acceptance criteria** [] Dag runs with expected task outputs in dev [] Dag runs with expected task outputs in prod

This will cover 2 validations at the moment: - article count sanity - corruption **To do** [] Dag that runs everyday at 12 UTC. Allow configurable airflow variables for: - Tolerance (start with 10 %) - Validated projects (default: consider using few main ones enwiki, frwiki, dewiki, etc.) - Validated namespaces (default [0]) [] Create tasks to call `IsCorrupt` and `ValidateArticleCounts` as per the env variables. [] Test dag in dev (using your feature branch) [] Tune task timeouts [] Deploy `snapshotsvalidations` service to prod [] Deploy dag to prod (this means merging feature -> main) [] Test dag in prod **Acceptance criteria** [] Dag runs with expected task outputs in dev [] Dag runs with expected task outputs in prod