CODEWITHSUNDEEP
apache-kafkaapache-stormkafka-consumer-api
Alex Stanovsky
Alex Stanovsky

Reputation: 1366

KafkaSpout(Storm) uncompression messages

I am using KafkaSpout to consume messages from Kafka.

The messages are produced with org.apache.kafka.clients.producer.KafkaProducer With gzip compression props.put(ProducerConfig.COMPRESSION_TYPE_CONFIG, "gzip");

How do i set the compression type in KafkaSpout to consume the uncompressed messages?

Upvotes: 0

Views: 156

Answers (1)

Vijay Innamuri
Vijay Innamuri

Reputation: 4372

gzip compression is handled automatically. If it is a text file then you can directly read with an input stream or for XML files you parse it as regular files.

Property props.put(ProducerConfig.COMPRESSION_TYPE_CONFIG, "gzip"); is not required.

If there are any errors, please post it.

Upvotes: 0

Related Questions