Andras Hatvani
Reputation: 4491
RocksDB with jemalloc or tcmalloc in KafkaStreams
My KafkaStreams apps run as Docker images in Kubernetes cluster and thus had to configure the pods to contain jemalloc and tcmalloc. By adding
LD_PRELOAD=/usr/lib/x86_64-linux-gnu/libjemalloc.so.2
# or
LD_PRELOAD=/usr/lib/x86_64-linux-gnu/libtcmalloc.so.4
the standard glibc memory allocator will be overridden, but it doesn't work as expected:
- with
jemallocthe streams stall in rebalancing state and - with
tcmallocthe override just doesn't happen.
Did anyone successfully use either of these with Kafka Streams?
Upvotes: 1
Views: 167
Answers (0)
Related Questions
- What are the differences between (and reasons to choose) tcmalloc/jemalloc and memory pools?
- RocksDB data loss
- Install jemalloc on Centos 8
- Failed to lock the state directory for task 0_13
- How to achieve high availability in a Kafka Streams app during deployment?
- Can't enable jemalloc for MySQL 5.7
- How do jemalloc and tcmalloc track threads?
- How to control location of Rocksdb shared object in KafkaStreams
- RocksDB Disk Usage