CODEWITHSUNDEEP
apache-kafkahdfscloudera-cdhcloudera-manager
Vaishak
Vaishak

Reputation: 617

Download Kafka or confluent platform in package distributed CDH 5.16

I have installed CDH 5.16 Express using packages in a RHEL server. I am trying to install Kafka now and i observed that it can be installed only if CDH is installed as parcels.

1) Is it possible to install Kafka or confluent platform" separately in the server and use it along withCDH` components.

2) Is there any other workaround to install Kafka using Cloudera Manager

Upvotes: 0

Views: 596

Answers (1)

Prashant
Prashant

Reputation: 772

In order use the CDK 4.0 (cloudera distribution of Kafka) with Cloudera 5.13, I was forced to install CDK 4.0 as a parcel.

I had a cloudera quickstart docker VM that I downloaded. It runs without Kerberos authentication. After starting the quickstart VM, I separately installed the quickstart Kafka from Apache kafka's website. This was required as the kafka packaged within cloudera was a older version. Since, this was non kerberos environment, the Kafka server upon startup started using the zookeeper that was running in quickstart VM. This way I achieved connection of Kafka with cloudera VM.

If you are new to CDH/CM then I suggest you first try and use the Kafka service that is bundled within Cloudera. Go to 'Add Service' within Cloudera drop-down and select kafka. Enabling this Kafka service will give you a set of brokers for kafka to run. Also, Kafka needs Zookeeper to run. Zookeeper comes by default in Cloudera. So, you would get a working cluster with kafka enabled in it. You can think of changing to the latest version of Kafka (using the approach mentioned above) once you are comfortable with inbuilt tools of CDH/CM.

Upvotes: 1

Related Questions