Change Details

This allows to validate that the snapshots ndjson lines are parseable according to the right schema. **To do** [] Create a new proto //snapshotsvalidations.proto// and add method "IsCorrupt" (or "HasCorruption") with the following minimum arguments and minimum output. ``` //Request// int32 namespace = 1; string project = 2; string type = 3; //Response// int32 total = 1; bool hascorruption = 2; ``` [] Create a new repo `snapshotsvalidations`. Implement "IsCorrupt" handler with the following minimum funtionality: - Fetch a few chunks of the snapshot - Parse few lines of the chunks with the appropriate schema (article or structured) based on type - Report a bool for corruption. - Report total for number of lines analysed. If the snapshot does not have chunk, total will be 0. **Acceptance criteria** [] Able to run `IsCorrupt` locally for both main snapshot and structured-contents snapshot [] With mock good and corrupt chunks, make sure IsCorrupt response is correct. [] For missing chunks, make sure total is 0

This allows to validate that the snapshots ndjson lines are parseable according to the right schema. **To do** [] Create a new proto //snapshotsvalidations.proto// and add method "IsCorrupt" (or "HasCorruption") with the following minimum arguments and minimum output. ``` //Request// int32 namespace = 1; string project = 2; string type = 3; //Response// int32 total = 1; // total lines analysed bool hascorruption = 2; // true if all analysed lines are parsed correctly ``` [] Create a new repo `snapshotsvalidations`. Implement "IsCorrupt" handler with the following minimum funtionality: - Fetch a few chunks of the snapshot - Parse few lines of the chunks with the appropriate schema (article or structured) based on type - Report a bool for corruption. - Report total for number of lines analysed. If the snapshot does not have chunk, total will be 0. **Acceptance criteria** [] Able to run `IsCorrupt` locally for both main snapshot and structured-contents snapshot [] With mock good and corrupt chunks, make sure IsCorrupt response is correct. [] For missing chunks, make sure total is 0

This allows to validate that the snapshots ndjson lines are parseable according to the right schema. **To do** [] Create a new proto //snapshotsvalidations.proto// and add method "IsCorrupt" (or "HasCorruption") with the following minimum arguments and minimum output. ``` //Request// int32 namespace = 1; string project = 2; string type = 3; //Response// int32 total = 1; // total lines analysed bool hascorruption = 2; // true if all analysed lines are parsed correctly ``` [] Create a new repo `snapshotsvalidations`. Implement "IsCorrupt" handler with the following minimum funtionality: - Fetch a few chunks of the snapshot - Parse few lines of the chunks with the appropriate schema (article or structured) based on type - Report a bool for corruption. - Report total for number of lines analysed. If the snapshot does not have chunk, total will be 0. **Acceptance criteria** [] Able to run `IsCorrupt` locally for both main snapshot and structured-contents snapshot [] With mock good and corrupt chunks, make sure IsCorrupt response is correct. [] For missing chunks, make sure total is 0