Created 03-27-2017 03:17 PM
Dear experts,
How to identify Kafka source and destination (Hdfs,Hbase) path
Created 03-27-2017 09:24 PM
@Nilesh Some documentation for Kafka integration can be found at http://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.5.3/bk_storm-component-guide/content/storm-inges..., and included in that are details around using Kafka with various other components. Examples: to ingest data from HDFS - http://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.5.3/bk_storm-component-guide/content/storm-inges...; to write data to HBase - http://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.5.3/bk_storm-component-guide/content/storm-write.... These examples use Storm but similar patterns can be accomplished with NiFi. Additional Kafka documentation can be found at http://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.5.3/bk_kafka-component-guide/content/ch_introduc.... Hope this helps, and if not please provide more details in your question so that a better answer can be given.
Created 03-29-2017 05:51 AM
@Mike Riggs
We have already having Kafka setup but no one knows flow of Kafka then in this case how do I identified from where Kafka taking the data and where it store in hadoop.