Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Kafka | Source and Destination Path

Kafka | Source and Destination Path

Contributor

Dear experts,

How to identify Kafka source and destination (Hdfs,Hbase) path

2 REPLIES 2

Re: Kafka | Source and Destination Path

Rising Star

@Nilesh Some documentation for Kafka integration can be found at http://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.5.3/bk_storm-component-guide/content/storm-inges..., and included in that are details around using Kafka with various other components. Examples: to ingest data from HDFS - http://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.5.3/bk_storm-component-guide/content/storm-inges...; to write data to HBase - http://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.5.3/bk_storm-component-guide/content/storm-write.... These examples use Storm but similar patterns can be accomplished with NiFi. Additional Kafka documentation can be found at http://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.5.3/bk_kafka-component-guide/content/ch_introduc.... Hope this helps, and if not please provide more details in your question so that a better answer can be given.

Highlighted

Re: Kafka | Source and Destination Path

Contributor

@Mike Riggs

We have already having Kafka setup but no one knows flow of Kafka then in this case how do I identified from where Kafka taking the data and where it store in hadoop.