Created 05-15-2020 05:12 AM
I need a Help i have two question please
1-how I can transform the data from apache kafka to hdfs????
2-how I can transform the data from apache kafka to SparkStreming????
thank you
Created 05-18-2020 12:31 AM
You can use flume or nifi to publish data from kafka to nifi:
a. Using flume
Kafka Source -> Flume -> HDFS
b. Using Nifi:
Configure PublishKafka processor --> PutHdfs processor
And to integrate kafka for spark streaming you need to build spark streaming job, refer the below doc. for more details:
https://docs.cloudera.com/HDPDocuments/HDP2/HDP-2.6.5/bk_spark-component-guide/content/using-spark-s...
View solution in original post