CODEWITHSUNDEEP
apache-kafkaksqldb
Luke Knepper
Luke Knepper

Reputation: 961

How can I deduplicate streams in KSQL?

I have a Kafka topic / stream that sometimes receives duplicates of events. How can I deduplicate the stream in KSQL?

Upvotes: 0

Views: 770

Answers (1)

Luke Knepper
Luke Knepper

Reputation: 961

De-duplicating a stream is not currently possible in raw KSQL. You might be able to write a UDF for this.

Note that a table will only store the latest update (message) for a given key. Depending on your usecase, that could be helpful.

Upvotes: 1

Related Questions