Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

NIFI Twitter Enterprise GNIP Streaming

NIFI Twitter Enterprise GNIP Streaming

New Contributor

92607-twitterent.png

92608-twitterupdateatt.png

92609-twitterinvokehttp.png

Hi, has anyone managed to stream twitter data into NIFI using GNIP's API Endpoint. I managed to stream using keys (GetTwitter processor), but i'm having difficulty streaming using their enterprise endpoint e.g. https://gnip-stream.twitter.com/stream/powertrack/accounts/{account_name}/publishers/twitter/dev.jso...

The problem appears to be authentication. I attempted this using both an invokehttp and gethttp processor but both returned 401. The formatting matches the CURL request i'm sending, including encoding my credentials. I've instead resorted to producing to kafka, but interested to know if anyone managed to do this using InvokeHTTP.

Thanks,

Mike

curl --compressed -v -u{username}   "https://gnip-stream.twitter.com/stream/powertrack/accounts/{accountname}/publishers/twitter/dev.json"