CODEWITHSUNDEEP
amazon-web-servicesapache-kafkaapache-kafka-streamsaws-msk
Amitb
Amitb

Reputation: 462

Using Kafka Streams with MSK Express brokers - internal topic creation

I want to migrate my Kafka infrastructure to AWS MSK, and I've noticed there is new broker type called Express Brokers. I really want to use it since it is supposed to be faster, supports "hands-free storage management," and more.

The issue is that I currently am using Kafka Streams, and relay on it to create the internal topics for me. Per this AWS documentation - I have to create the internal topics manually, which seems a bit complicated.

Each time that I will make a stateful operation I will have to call some kind of a create topic function and implement a naming functionality as well.

Has anyone done this and can share an example? How hard is it to maintain in a production code, with multiple services doing these stateful operations?

Upvotes: 0

Views: 47

Answers (0)

Related Questions