Reputation: 111
What is the max throughput of kafka in MB/second. I am trying to send messages of size 2MB each and get a throughput of about 30 records per second (i.e. 60 MB/second) I wanted to check what was the theoretical max throughput that could be reached.
Upvotes: 1
Views: 7150
Reputation: 62330
Kafka is usually network bound -- so it depends on your hardware. Theoretical max for 1Gbit Ethernet would be 125MB/sec.
Also check out this blog post: https://engineering.linkedin.com/kafka/benchmarking-apache-kafka-2-million-writes-second-three-cheap-machines
Upvotes: 1