kafka connecting to social media for real time data streaming ?

[#1]

hello i am settingup apache kafka for real time data from social media, how should i connect my kafka with social media tools to get data ?

[#2]

Hey @rishav1412,

Thanks for reaching out to the Cloudera community.

I don't think we have a single way/process/configuration in Kafka to stream data from all Social Media Platforms. Every social media platform have their own APIs/methods and policy on data streaming.

If you want to stream data from Twitter you can use any of the mentioned ways/processes/services to send data from Twitter to Kafka topics. 

• Twitter >> Kafka Connect(Kafka Connect Twitter) >> Kafka Topics
• Twitter >> Flume(org.apache.flume.source.twitter.TwitterSource) >> Kafka Topics
• Twitter >> NiFi(GetTwitter Processor) >> Kafka Topics

Let me know if this helps.