CODEWITHSUNDEEP
apache-kafkaazure-blob-storageapache-kafka-connectdebeziumapache-iceberg
gt1
gt1

Reputation: 17

Writing debezium CDC events from Kafka Connect to Iceberg

We want to ingest Debezium CDC events into Iceberg Tables on Azure Blob. We aim to do so using Kafka Connect Iceberg Sink Connector, and a Snowflake Catalog for Iceberg.

Questions that have surfaced -

  1. Can Avro file types be inserted into Iceberg tables?

  2. If 'yes' to 1, are further operations required if we want to query Iceberg tables as columnar-based, parquet files

  3. If 'no' to 1, which alternatives exist for capturing CDC into Iceberg as parquet files?

We have tried researching a variety of approaches - thanks in advance for your help.

Upvotes: 0

Views: 216

Answers (0)

Related Questions