CODEWITHSUNDEEP
apache-kafkaapache-kafka-connectconfluent-platformdistributed-transactions
xrcsblue
xrcsblue

Reputation: 530

KafkaConnect sink set kafka consumer isolation level

In a standard/custom kafkaconnect sink how can we specify that it should only consume read_comitted messages from kafka topics. I can see the config here but can't see any options (unless it is the default behaviour). Thanks. https://docs.confluent.io/current/installation/configuration/connect/sink-connect-configs.html

Upvotes: 1

Views: 1320

Answers (1)

Iskuskov Alexander
Iskuskov Alexander

Reputation: 4375

If you want to override consumer properties (isolation.level in your case) for a specific connector, enable client overrides in the worker configuration and then use consumer.override.* for a sink connector config:

"consumer.override.isolation.level": "read_committed"

Source: Kafka Connect Worker Configuration Properties: Override the Worker Configuration

Note: Prior to Kafka 2.3 you will need to set it at worker level by adding the line below in worker config

consumer.isolation.level=read_committed

Please see how to set kafka connect auto.offset.reset with rest api

Upvotes: 3

Related Questions