You can use flume or nifi to publish data from kafka to nifi:   a. Using flume  Kafka Source -> Flume -> HDFS b. Using Nifi:   Configure PublishKafka processor --> PutHdfs processor    And to integrate kafka for spark streaming you need to build spark streaming job, refer the below doc. for  more details: https://docs.cloudera.com/HDPDocuments/HDP2/HDP-2.6.5/bk_spark-component-guide/content/using-spark-streaming.html ... View more