Support Questions

Find answers, ask questions, and share your expertise

input data into spark from kafka

Explorer

Hi Everyone, I collect the data with NiFi to inject in Kafka and then I want to send them to Spark for processing.The data arrive well in kafka but the problem is from kafka to spark. I ran zookeeper server and then kafka server. I need helpzookeeper_.pngScala_Stream.png

2 REPLIES 2

Expert Contributor

Hello 

 

Kafka is "pub and sub"

If you plan you to use Spark, you can use Spark to subscribe to the topics and get the message

 

Here is one example using Spark Streaming

https://docs.cloudera.com/runtime/7.2.8/developing-spark-applications/topics/spark-streaming-example...

New Contributor

Hello 

 

Kafka is "pub and sub"

If you plan you to use Spark, you can use Spark to subscribe to the topics and get the message

 

Here is one example using Spark Streaming

https://docs.cloudera.com/runtime/7.2.8/developing-spark-applications/topics/spark-streaming-example...

Take a Tour of the Community
Don't have an account?
Your experience may be limited. Sign in to explore more.