Reputation: 323
I am new to apache beam, and i have a use case where I need to write a java streaming code to read from a KafkaTopic (from which i extract some CustomObject.class) and output the entries to hdfs in ORC format. I see there no ORC IO connector. Is it possible to write the results in ORC format using HadoopFormatIO connector? Is yes, can you please help me with this? The documentation for HadoopFormatIO connector in beam is not so clear to me.
Upvotes: 0
Views: 136