CODEWITHSUNDEEP
kubernetesapache-kafkaapache-kafka-connectconfluent-platformmongodb-kafka-connector
codependent
codependent

Reputation: 24442

High availability configuration for Kafka Connect Mongodb source connector

I've been looking for specific information about high availability deployments of Kafka Connect connectors but found nothing.

In my case I have a Mongodb source connector deployed using the Confluent Helm chart. This chart supports setting the number of replicas.

Is setting replicaCount to a value >1 enough or there are other factors to consider (tasks.max, ...)?

Upvotes: 2

Views: 834

Answers (1)

OneCricketeer
OneCricketeer

Reputation: 191671

If you want highly available workers, then it's pod replicas, yes.

If you want distributed tasks across workers, that's tasks.max; if one worker dies, then tasks get rebalanced

Upvotes: 2

Related Questions