Hi @Eric Lloyd, Is your Kafka broker listening on port 2181? It looks like a zookeeper port. As indicated in the properties description, ConsumeKafka processors are not using ZooKeeper to connect to the brokers as GetKafka is doing. If you provide a comma separated list of your brokers (with corresponding port), it should be OK. Hope this helps. ... View more

Hi @Adnan Alvee, Are you using spark-shell? if yes the spark context is already generated for you (as 'sc') and you don't need to create a new one, you should be able to directly go with: val ssc = new StreamingContext(sc, Seconds(1)) ... View more

Hi @Oliver Meyn, You are absolutely right on all points. Regarding HDFS, at the moment there is no option to keep the identities secure, but there are discussions going on to find a way to secure the keytabs. Regarding Kafka, this is due to a limitation on Kafka's side (https://issues.apache.org/jira/browse/KAFKA-4259). This has been recently fixed and I'm sure the Kafka processors in NiFi will be updated in the future to allow a similar option as in other processors. Hope this helps. ... View more

Hi @Nigel Jones, Ranger is available only once the cluster is installed. You start with the services you want. Then, once the installation is completed, you can add Ranger (add service, select Ranger) from Ambari. It is not available during a fresh install. Hope this helps. ... View more

Hi @adrian white, Yes you can, just draw the same relationship from the first processor to the two other processors. Example: ... View more