Test creation of Kafka v2 topic in EC2 instance and then dev
Open, HighPublic3 Estimated Story Points
Actions

Assigned To

Authored By

	ROdonnell-WMF
	Thu, Apr 11, 11:23 AM

Description

User Story: “As a developer deploying the Kafka v2 topics, I want to test that the Terraform update will not break existing infrastructure and applies the appropriate Kafka changes,
so that I can be confident the IAC changes will work as expected.”

Acceptance criteria

The Terraform changes for Kafka work in dev

ToDo

Spin up new EC2 instance in same VPC as dev MSK cluster
Connect with AWS SSM to the instance and run the Python deployer with write mode disabled
Output the MSK changes to a JSON file
Review the JSON changes and share with team to verify deployment plan
Upgrade the DEV brokers EC2 instances to X-Large, so they are the same as Prod hardware
Deploy to DEV and check that the topics and partitions are allocated correctly
Monitor DEV reingest of the first two or three projects

Test Strategy

Share the Topic and ACL file with the team. And compare the JSON topic/partition list with the TF code

Things to consider:

Check that we can connect to the MSK cluster using an EC2 instance and run the Python deployer script without other IAC dependencies

Event Timeline

ROdonnell-WMF created this task.Thu, Apr 11, 11:23 AM

Restricted Application added a subscriber: Aklapper. · View Herald TranscriptThu, Apr 11, 11:23 AM

REsquito-WMF triaged this task as High priority.Thu, Apr 11, 11:24 AM

REsquito-WMF edited projects, added Wikimedia Enterprise Engineering; removed WME-API-Usability.

REsquito-WMF moved this task from Incoming to To Be Estimated/To Be Discussed on the Wikimedia Enterprise board.

Python deploy logs are in GD in folder Misc/kafka_deployer.out

The screenshot shows no structural changes except for 3600 new topics. ACL changes are there as well

should we scale the dev cluster? or merge as is?

Recommendations?

I didn't change the broker EC2 instance types, because I wanted to check the added topics first. The team decision was to keep 4 brokers and see how DV copes with the load.

I will update the MR, so DV has the same instance types as PR

Add it as part of the ticket...and address it when ticket is picked up please

JArguello-WMF set the point value for this task to 3.Thu, Apr 11, 1:33 PM

JArguello-WMF moved this task from To Be Estimated/To Be Discussed to Sprint 58 on the Wikimedia Enterprise board.

JArguello-WMF edited projects, added Wikimedia Enterprise (Sprint 58); removed Wikimedia Enterprise.

ROdonnell-WMF claimed this task.Thu, Apr 11, 1:51 PM

ROdonnell-WMF updated the task description. (Show Details)

ROdonnell-WMF moved this task from Next Up to In Progress on the Wikimedia Enterprise (Sprint 58) board.

ROdonnell-WMF updated the task description. (Show Details)Thu, Apr 11, 1:54 PM

ROdonnell-WMF moved this task from In Progress to Blocked/Paused on the Wikimedia Enterprise (Sprint 58) board.Mon, Apr 15, 10:47 AM

v1 is ingested into compact topics
v2 is not ingested

Possibly an issue with v2 Env variables not being set in dev?