Unable to get Kafka activated on my cluster. When I distribute the parcel and attempt to activate I get an error stating, "CDH (5.2 and higher) parcel required for KAFKA (2.0.1-18.104.22.168.p0.5) is not available." - I'm running CDH 5.7.1 though.
If I try to just distribute then activate via adding the service, all the brokers fail to start:
Service did not start successfully; not all of the required roles started: only 0/7 roles started. Reasons : Service has only 0 Kafka Broker roles running instead of minimum required 1.
I am indeed running CDH 5.7.1 - and no, I've never installed Kafka on this cluster.
The only two directories under /opt/cloudera/ are parcel-cache and parcels.
kafka integrates with Cloudera Manager using a Custom Service Descriptor (CSD).
you have to download the CSD (http://archive.cloudera.com/csds/kafka-1.2.0/KAFKA-1.2.0.jar) and put it in /opt/cloudera/csd/ and then restart service .
Can you confirm, are you running packages or parcels for your cluster?
If you are using the QuickStart VM please read this note that comes along https://www.cloudera.com/documentation/enterprise/latest/topics/cloudera_quickstart_vm.html:
The VM uses a package-based install. This allows you to work with or without Cloudera Manager. Parcels do not work with the VM unless you first migrate your CDH installation to use parcels. On your production systems, Cloudera recommends that you use parcels.
In order to use a Kafka parcel, the CDH installation must first exist as a parcel by itself. The error you face is telling you that no CDH parcel was detected, which likely means your current CDH is package-based.
Follow this guide to migrate from packages to parcels first for your CDH cluster software: https://www.cloudera.com/documentation/enterprise/latest/topics/cm_ig_migrating_packages_to_parcels...., and then you should be able to use your Kafka parcel.