CODEWITHSUNDEEP
hadoopcloudera
nes1983
nes1983

Reputation: 15756

LZO for cloudera cdh3u2

With some bewilderment I read cloudera's blog post on lzo on cloudera. Due to some licensing bs, lzo compression is not part of standard hadoop, ok. But what's stopping cloudera from making it part of their distribution? Or has this happened?

In short, how do you make lzo compression happen on cloudera cdh3u2?

Upvotes: 1

Views: 1016

Answers (2)

Lynn Langit
Lynn Langit

Reputation: 4060

I have heard very positive feedback from clients who are using Snappy, rather than LZO - Cloudera has an article about this topic on their blog.

Upvotes: 1

Praveen Sripati
Praveen Sripati

Reputation: 33495

But what's stopping cloudera from making it part of their distribution? Or has this happened?

Both Apache Hadoop and Cloudera CDH are released under the same Apache Public License version 2, so I don't think LZO can be included in CDH due to the GPL restrictions.

In short, how do you make lzo compression happen on cloudera cdh3u2?

I haven't tried them out, but here are the instructions for using LZO with Hadoop.

Upvotes: 1

Related Questions