Support Questions

Find answers, ask questions, and share your expertise

input data into spark from kafka

avatar
Explorer

Hi Everyone, I collect the data with NiFi to inject in Kafka and then I want to send them to Spark for processing.The data arrive well in kafka but the problem is from kafka to spark. I ran zookeeper server and then kafka server. I need helpzookeeper_.pngScala_Stream.png

2 REPLIES 2

avatar
Expert Contributor

Hello 

 

Kafka is "pub and sub"

If you plan you to use Spark, you can use Spark to subscribe to the topics and get the message

 

Here is one example using Spark Streaming

https://docs.cloudera.com/runtime/7.2.8/developing-spark-applications/topics/spark-streaming-example...

avatar
New Contributor

Hello 

 

Kafka is "pub and sub"

If you plan you to use Spark, you can use Spark to subscribe to the topics and get the message

 

Here is one example using Spark Streaming

https://docs.cloudera.com/runtime/7.2.8/developing-spark-applications/topics/spark-streaming-example...