Page MenuHomePhabricator

Create Kafka Topics and ACLs
Closed, ResolvedPublic3 Estimated Story Points

Description

As WME engineer i need to have an automated way to create and update topics for structured contents

Acceptance Criteria

  • Topics created in dev environment

TODO

  • Enhance current topic creation for structured contents with the same partitions for compacted topics
  • Add ACLs to new topics as needed
  • Investigate if kafka brokers need upscaling

Additional Info

2 Types of topics:

  1. Non Compacted, retention 4 days. aws.structured-contents.article.v1
  2. Compacted topics: aws.structured-contents.<proj>.article.v1
  3. Be sure structured-data v1 topics are deleted before pushing this to an environment

Event Timeline

REsquito-WMF updated the task description. (Show Details)
REsquito-WMF set the point value for this task to 3.

Moving this back to incoming, to keep my tickets easier to understand

JArguello-WMF updated the task description. (Show Details)
JArguello-WMF moved this task from MR to QA on the Wikimedia Enterprise (Sprint 61) board.