Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Nifi date filename

Solved Go to solution
Highlighted

Nifi date filename

New Contributor

I'm constantly moving logs for storage and was looking for a way to change the filenames in a given nifi flow. for example, if i'm getting a load of files from say /var/log*, is there a way in my flow that i'm using to adjust the filename and add on to it so i have the date?So for example if i have webapp.log, i would like to move it and have the file name changed to webapp.log(todaysdate). Is there a processor in NiFi that will do this?

1 ACCEPTED SOLUTION

Accepted Solutions

Re: Nifi date filename

Contributor

@David Parkins

Your best option for doing this is going to be using the UpdateAttribute processor and then using a little NiFi Expression Language to append the date onto your file. From there you should be able to configure. I created a sample flow and used the following config and achieved the following results:

/var/log/log1.log

New filename: log1.log.2016-12-26 15:10:25.966Z

10810-updateattributedate.png

This is the config on the updateAttribute processor:

10822-processorconfig.png

This is just a sample, you could do a lot better using append/prepend with NiFi Expression Language. There is more info here: https://nifi.apache.org/docs/nifi-docs/html/expression-language-guide.html

View solution in original post

1 REPLY 1

Re: Nifi date filename

Contributor

@David Parkins

Your best option for doing this is going to be using the UpdateAttribute processor and then using a little NiFi Expression Language to append the date onto your file. From there you should be able to configure. I created a sample flow and used the following config and achieved the following results:

/var/log/log1.log

New filename: log1.log.2016-12-26 15:10:25.966Z

10810-updateattributedate.png

This is the config on the updateAttribute processor:

10822-processorconfig.png

This is just a sample, you could do a lot better using append/prepend with NiFi Expression Language. There is more info here: https://nifi.apache.org/docs/nifi-docs/html/expression-language-guide.html

View solution in original post

Don't have an account?
Coming from Hortonworks? Activate your account here