Mark Fursht
Reputation: 21
Global KTable storage limitations
What is the limit that GLobalKTable can store? Is it possible to store 50 millions mappings from long to long in GLobalKtable? How to configure the kafka-streams properly to do it? Thanks, Mark
Upvotes: 0
Views: 1309
Answers (1)
Matthias J. Sax
Reputation: 62350
Only your local disk is your limit. Check out the capacity planning guide to learn how to estimate the required storage: https://docs.confluent.io/current/streams/sizing.html
Upvotes: 2
Related Questions
- How long is the data in KTable stored?
- Kafka Streams K-Table size monitoring
- KTable state store infinite retention
- Getting Out of Memory exception possibly due to the ktable related state store
- Kafka Streams limiting off-heap memory
- Calculating Memory Footprint of GlobalKTables
- Apache Kafka - KStream and KTable hard disk space requirements
- KTable/KStream memory consumption over time
- KTable state store persistence
- How to Stream to a Global Kafka Table