- Subscribe to RSS Feed
- Mark Question as New
- Mark Question as Read
- Float this Question for Current User
- Bookmark
- Subscribe
- Mute
- Printer Friendly Page
input data into spark from kafka
- Labels:
-
Apache Kafka
-
Apache NiFi
-
Apache Spark
Created ‎05-12-2021 01:18 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Hi Everyone, I collect the data with NiFi to inject in Kafka and then I want to send them to Spark for processing.The data arrive well in kafka but the problem is from kafka to spark. I ran zookeeper server and then kafka server. I need help
Created ‎05-13-2021 07:24 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Hello
Kafka is "pub and sub"
If you plan you to use Spark, you can use Spark to subscribe to the topics and get the message
Here is one example using Spark Streaming
Created ‎05-14-2021 12:42 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Hello
Kafka is "pub and sub"
If you plan you to use Spark, you can use Spark to subscribe to the topics and get the message
Here is one example using Spark Streaming
