Currently our LLM services do not take advantage of Structured Outputs, which make sure that the model output follows the exact structure we expect.

We should explore if we can enable this in our LLM models and how to best place it in our codebase.

Reference: https://docs.vllm.ai/en/latest/features/structured_outputs/