Member since
05-27-2019
4
Posts
0
Kudos Received
0
Solutions
03-24-2021
05:30 PM
@peadalmeidaI believe if can use this same solution for your case.
... View more
04-22-2020
09:22 AM
Admittedly I know very little about DynamoDB, but I don't think it provides a native method to pull the entire table. If this is a one-time task, I suppose you could export your table to S3, and then use the FetchS3 nifi processor to get it into your flow. If you're looking to process new records as they arrive, I suppose you could use lambda to push the new records into Kafka or Kinesis and use nifi to consume that queue. There is also a way (which I have not explored) to use HiveQL with EMR for querying DynamoDB tables. Assuming that works how I *think* it works, you could then use the SelectHiveQL processor to pull your DynamoDB table into your nifi flow. I've also never used EMR, but maybe it will be a fun experiment?
... View more
05-28-2019
07:48 PM
The above was originally posted in the Community Help Track. On Tue May 28 19:45 UTC 2019, a member of the HCC moderation staff moved it to the Data Ingestion & Streaming track. The Community Help Track is intended for questions about using the HCC site itself.
... View more