Working on building th etopic operator and provisioning the services

Working on data ingestion

deploying services

@RThomas-WMF will document on the ticket to wrap up

As part of this ticket the below were achieved in EKS environment:

1. Umbrella chart or common template to provision all the WME services and APIs
2. Provisioned the critical system components required to run the WME services - k8s components like the service mesh etc., kafka components - schema registry, ksqldb, kafka ui
3. Deployed the latest MSK Kafka version - 3.6.x. The goal is migrate to EKS, connected to the lates kafka version. 4.Made use of the latest for ksqldb, schema registry, kafka ui opensource images and configuration and moved away from custom images. Also, added the HA features and some performance configuration for pull queries in ksqldb.
4. Analysed the current Kakfa topics, acls, consumers, producers and also explored a better way of managing the topics and acls going forward
5. Provisioned api, event-bridge services, content-integrity, structured-data services

The goal is to review the findings with the team and create the required tickets to ensure a seamless migration to k8s.