Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

druid: create and run Realtime node (streaming data with Kafka and Rabbitmq)

druid: create and run Realtime node (streaming data with Kafka and Rabbitmq)

New Contributor

Hi all,

Do you know how to create Realtime node in Druid? How to run Realtime node (streaming data with Kafka and Rabbitmq)?

Thank you so much,

2 REPLIES 2
Highlighted

Re: druid: create and run Realtime node (streaming data with Kafka and Rabbitmq)

New Contributor

Hi Thuy Le,

Realtime nodes have been deprecated and are replaced by Realtime Index Tasks.

For ingesting data from kafka you can use kafka indexing service -

http://druid.io/docs/latest/development/extensions-core/kafka-ingestion.html

Here is a tutorial for the same -

http://druid.io/docs/latest/tutorials/tutorial-kafka.html

Re: druid: create and run Realtime node (streaming data with Kafka and Rabbitmq)

New Contributor

Hi @Nishant Bangarwa,

Thank you so much for your answers, in the first link http://druid.io/docs/latest/development/extensions-core/kafka-ingestion.html

it is the way we can ingest data to druid data from kafka using supervisor (I done it with kafka). However, I dont think I can do similar with Rabbitmq or other streaming as Spark, Storm ... Therefore, I want to use realtime node to ingest data to druid and test more with Rabbitmq, Spark, Storm ...

Do you have any suggestion for me to create realtime node and run it?

Many thanks