Support Questions
Find answers, ask questions, and share your expertise

How to consume kinesis stream in nifi

I have a kinesis stream that I need to consume in to my nifi flow. Going through the processors I can find a PutKinesisStream processor but no such thing as GetKinesisStream.

2 REPLIES 2

There is an open JIRA to develop that functionality: https://issues.apache.org/jira/browse/NIFI-2892

Is there any possibility of this being implemented in near future?

Alternatively, I am currently using a python script to consume data from kinesis stream and dump it as small files on local file system. These files are then picked up by NiFi GetFile processor. Is there any better way to do this?

Thanks!

; ;