Support Questions
Find answers, ask questions, and share your expertise

Send filenames inside the flowfile to a flat file in NiFi

Send filenames inside the flowfile to a flat file in NiFi

New Contributor

Hi, I'm trying to create a custom log directory in Azure Storage for every blob files fetched from Azure and put in AWS Bucket. NiFi flow from ListAzureBlobStorage to PutS3Object works fine. I'm struggling in the step to append just the name of the file inside the flow file to a flat-file every time the flow runs. Basically, I want to have 1 flat-file (log file) per day for all the files transported to AWS with their name and timestamp.

 Eg Flat file name: LogFile1

Content:   a.json    2020-11-05-13-45

                 b.json    2020-11-05-14-45

                 c.jar       2020-11-05-15-45

 

The logfile would be stored in a container in Azure with a retention period of 3 days.