Page MenuHomePhabricator

[Dataset Config Store] Setup initial CI checks
Closed, DeclinedPublic5 Estimated Story Points

Description

Setup initial CI checks in the poc repo. The purpose of this task is to just start the process of having some simple checks on the config files (not expected to be exhaustive of all the checks we want).

Done is:

  • Simple CI checks (files conform to json or simple schema, certain files like purge information are mandatory (tbd))

Related Objects

StatusSubtypeAssignedTask
OpenNone
Declinedtchin

Event Timeline

lbowmaker set the point value for this task to 5.Feb 16 2024, 7:47 PM
lbowmaker moved this task from Backlog to Dataset Config Store on the Data-Engineering board.

Config store repo does CI checks for jsonschema correctness and config values against its jsonschema. The Datasets Config service repo has dockerized CI using Kokkuri and Blubber.

certain files like purge information are mandatory

I'm not sure what this is referring to?

I think if we organized files by dataset we discussed at one point requiring things like config for deleting data after a certain time (for example).

Maybe we don’t need that just yet.

Ottomata subscribed.

Being bold and declining task, please reopen if incorrect.