Get IPv4 of AWS MSK kafka brokers

Question

I am following https://aws.amazon.com/blogs/big-data/how-goldman-sachs-builds-cross-account-connectivity-to-their-amazon-msk-clusters-with-aws-privatelink/#:~:text=Register%20the%20MSK%20broker%20as%20a%20target%20by%20its%20IP%20address.

above blog to create a private link, to access Kafka brokers. trying to imitate pattern 1 of the blog but when trying to create a target group for Network Load Balancer, the form is asking for Ipv4 for MSK, but I don't have that. AWS MSK exposes the address of the broker like this

b-3.xxxxx.xxxxx.c5.kafka.ap-xxxx-1.amazonaws.com:9094 , this is not getting accepted in the target group.

what can be the workaround?

Answer 1

You can nslookup each of the private endpoint of the nodes in your cluster. For example, if your client information is:

b-2.mskcluster.xxxxx.c4.kafka.eu-west-1.amazonaws.com:9092,b-1.mskcluster.xxxxx.c4.kafka.eu-west-1.amazonaws.com:9092

you can do : nslookup b-2.mskcluster.xxxxx.c4.kafka.eu-west-1.amazonaws.com to get the private ip of this node