Reply
Highlighted
Explorer
Posts: 13
Registered: ‎03-25-2016

Issue Activating Kafka

Unable to get Kafka activated on my cluster. When I distribute the parcel and attempt to activate I get an error stating, "CDH (5.2 and higher) parcel required for KAFKA (2.0.1-1.2.0.1.p0.5) is not available." - I'm running CDH 5.7.1 though.

 

If I try to just distribute then activate via adding the service, all the brokers fail to start:

 

Service did not start successfully; not all of the required roles started: only 0/7 roles started. Reasons : Service has only 0 Kafka Broker roles running instead of minimum required 1.

Any thoughts?

Cloudera Employee
Posts: 273
Registered: ‎01-09-2014

Re: Issue Activating Kafka

What version of Cloudera Manager are you running, is it also 5.7.1? Did you have a previous version of kafka installed? Do you have anything under /opt/cloudera/csd on your cluster nodes?

-pd
Explorer
Posts: 13
Registered: ‎03-25-2016

Re: Issue Activating Kafka

I am indeed running CDH 5.7.1 - and no, I've never installed Kafka on this cluster.

 

The only two directories under /opt/cloudera/ are parcel-cache and parcels.

Expert Contributor
Posts: 113
Registered: ‎02-15-2016

Re: Issue Activating Kafka

kafka integrates with Cloudera Manager using a Custom Service Descriptor (CSD).

you have to download the CSD (http://archive.cloudera.com/csds/kafka-1.2.0/KAFKA-1.2.0.jar) and put it in /opt/cloudera/csd/ and then restart service .

Cloudera Employee
Posts: 273
Registered: ‎01-09-2014

Re: Issue Activating Kafka

Can you confirm, are you running packages or parcels for your cluster?

 

If you are using the QuickStart VM please read this note that comes along https://www.cloudera.com/documentation/enterprise/latest/topics/cloudera_quickstart_vm.html:


The VM uses a package-based install. This allows you to work with or without Cloudera Manager. Parcels do not work with the VM unless you first migrate your CDH installation to use parcels. On your production systems, Cloudera recommends that you use parcels.


In order to use a Kafka parcel, the CDH installation must first exist as a parcel by itself. The error you face is telling you that no CDH parcel was detected, which likely means your current CDH is package-based.

Follow this guide to migrate from packages to parcels first for your CDH cluster software: https://www.cloudera.com/documentation/enterprise/latest/topics/cm_ig_migrating_packages_to_parcels...., and then you should be able to use your Kafka parcel.

Announcements
New solutions