Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

kafka connecting to social media for real time data streaming ?

kafka connecting to social media for real time data streaming ?

New Contributor

hello i am settingup apache kafka for real time data from social media, how should i connect my kafka with social media tools to get data ?

1 REPLY 1
Highlighted

Re: kafka connecting to social media for real time data streaming ?

Contributor

Hey @rishav1412,

 

Thanks for reaching out to the Cloudera community.

 

I don't think we have a single way/process/configuration in Kafka to stream data from all Social Media Platforms. Every social media platform have their own APIs/methods and policy on data streaming.

 

If you want to stream data from Twitter you can use any of the mentioned ways/processes/services to send data from Twitter to Kafka topics. 

 

  • Twitter >> Kafka Connect(Kafka Connect Twitter) >> Kafka Topics
  • Twitter >> Flume(org.apache.flume.source.twitter.TwitterSource) >> Kafka Topics
  • Twitter >> NiFi(GetTwitter Processor) >> Kafka Topics

 

Let me know if this helps.

Don't have an account?
Coming from Hortonworks? Activate your account here