Support Questions
Find answers, ask questions, and share your expertise

I had to build a pipelinein NIFI and my source is teradata.. I had to incrementally update when there is a change in my source table and place it in S3 buckets.. CAn someone tell me how to do it ??

New Contributor
 
1 REPLY 1

Super Guru
@Krishna T

->For incremental data pull from NiFi use QueryDatabaseTable processor(configure max value column property) and the output flowfile format is in Avro

->So if you want to change the format of the data then use ConvertRecord processor.

-> Use PutS3Object processor to store data into S3.

By using these three processor you can incrementally pull and store the data into S3.