Support Questions

Find answers, ask questions, and share your expertise
Check out our newest addition to the community, the Cloudera Data Analytics (CDA) group hub.

kafka connecting to social media for real time data streaming ?

New Contributor

hello i am settingup apache kafka for real time data from social media, how should i connect my kafka with social media tools to get data ?



Hey @rishav1412,


Thanks for reaching out to the Cloudera community.


I don't think we have a single way/process/configuration in Kafka to stream data from all Social Media Platforms. Every social media platform have their own APIs/methods and policy on data streaming.


If you want to stream data from Twitter you can use any of the mentioned ways/processes/services to send data from Twitter to Kafka topics. 


  • Twitter >> Kafka Connect(Kafka Connect Twitter) >> Kafka Topics
  • Twitter >> Flume(org.apache.flume.source.twitter.TwitterSource) >> Kafka Topics
  • Twitter >> NiFi(GetTwitter Processor) >> Kafka Topics


Let me know if this helps.

Take a Tour of the Community
Don't have an account?
Your experience may be limited. Sign in to explore more.