As WME engineer i need to have an automated way to create and update topics for structured contents
Acceptance Criteria
- Topics created in dev environment
TODO
- Enhance current topic creation for structured contents with the same partitions for compacted topics
- Add ACLs to new topics as needed
- Investigate if kafka brokers need upscaling
Additional Info
2 Types of topics:
- Non Compacted, retention 4 days. aws.structured-contents.article.v1
- Compacted topics: aws.structured-contents.<proj>.article.v1
- Be sure structured-data v1 topics are deleted before pushing this to an environment