Support Questions

Find answers, ask questions, and share your expertise

kafka connecting to social media for real time data streaming ?

New Contributor

hello i am settingup apache kafka for real time data from social media, how should i connect my kafka with social media tools to get data ?



Hey @rishav1412,


Thanks for reaching out to the Cloudera community.


I don't think we have a single way/process/configuration in Kafka to stream data from all Social Media Platforms. Every social media platform have their own APIs/methods and policy on data streaming.


If you want to stream data from Twitter you can use any of the mentioned ways/processes/services to send data from Twitter to Kafka topics. 


  • Twitter >> Kafka Connect(Kafka Connect Twitter) >> Kafka Topics
  • Twitter >> Flume(org.apache.flume.source.twitter.TwitterSource) >> Kafka Topics
  • Twitter >> NiFi(GetTwitter Processor) >> Kafka Topics


Let me know if this helps.