Support Questions
Find answers, ask questions, and share your expertise
Announcements
Check out our newest addition to the community, the Cloudera Innovation Accelerator group hub.

druid: create and run Realtime node (streaming data with Kafka and Rabbitmq)

Explorer

Hi all,

Do you know how to create Realtime node in Druid? How to run Realtime node (streaming data with Kafka and Rabbitmq)?

Thank you so much,

2 REPLIES 2

Explorer

Hi Thuy Le,

Realtime nodes have been deprecated and are replaced by Realtime Index Tasks.

For ingesting data from kafka you can use kafka indexing service -

http://druid.io/docs/latest/development/extensions-core/kafka-ingestion.html

Here is a tutorial for the same -

http://druid.io/docs/latest/tutorials/tutorial-kafka.html

Explorer

Hi @Nishant Bangarwa,

Thank you so much for your answers, in the first link http://druid.io/docs/latest/development/extensions-core/kafka-ingestion.html

it is the way we can ingest data to druid data from kafka using supervisor (I done it with kafka). However, I dont think I can do similar with Rabbitmq or other streaming as Spark, Storm ... Therefore, I want to use realtime node to ingest data to druid and test more with Rabbitmq, Spark, Storm ...

Do you have any suggestion for me to create realtime node and run it?

Many thanks