How to install kafka through ambari without HDFS?

[#1]

I want to install kafka on my cluster and use local storage for kafka instead of hdfs. Is this setup possible through ambari?

[#2 · Accepted solution]

@Sunile Manjee

I did not follow. I guess Kafka uses local storage anyway for log storage not hdfs.

Can you share more details?

[#3]

@Rahul Pathak My ? may not be applicable due to my mis-understanding kafka storing logs on HDFS as well as local. Do i understand you correctly that kafka only stores logs to local disk?

[#4]

Yes kafka store its log at local disk.

To push kafka logs to hdfs you need something like http://gobblin.readthedocs.io/en/latest/case-studies/Kafka-HDFS-Ingestion/

[#5]

@Rahul Pathak I was not aware that was the only option. I was under the impression kafka can use local or hdfs storage for log storage. So clearly my assumption was wrong.

[#6]

http://kafka.apache.org/documentation.html#configuration