NIFI - save file with date of file tittle

jricogar — Thu, 27 Sep 2018 04:45:34 GMT

Hello,

I have a dataflow that give a files to ftp and save thats files into HDFS. The problem is the name of folders in HDFS is the date that the name file contains, for example:

test_20180926.txt --> HDFS: /2018/09/26/test_20180926.txt

Thanks

Re: NIFI - save file with date of file tittle

MattWho — Sun, 18 Aug 2019 06:42:14 GMT

@Pepelu Rico

The FTP processors (listFTP or GetFTP) create an attribute (filename) on the created NiFi FlowFiles they output. You can use the UpdateAttribute processor and NiFi Expression Language to manipulate the filename string to create a new FlowFile attribute with the desired path you want to they use in your PutHDFS processor.

Here you can see the configuration of the UpdateAttribute processor. I have added a "new property" and named it "hdfsPath". This property name will become the name of my new FlowFileAttribute. I then created a NiFi Expression Language statement that extracts the date string from the existing "filename" attribute and converts it in to a path format using:

${filename:substringAfterLast('_'):substringBeforeLast('.'):toDate('yyyyMMdd'):format('/yyy/MM/dd')}

The result of above is assigned to "hdfsPath".

I can then use that new attribute as my path in the PutHDFS processor for example:

Thank you,

Matt

If you found this answer addressed your question, please take a moment to login in and click the "ACCEPT" link.

Re: NIFI - save file with date of file tittle

jricogar — Thu, 27 Sep 2018 18:23:18 GMT

Thank you very much I have to solve it 🙂

question Re: NIFI - save file with date of file tittle in Archives of Support Questions (Read Only)

NIFI - save file with date of file tittle

Re: NIFI - save file with date of file tittle

Re: NIFI - save file with date of file tittle