How to dynamically supply directory attribute value from a external file for GETFILE ?

[#1]

I have a need to supply directory path for GETFILE processor from a file, which would be maintained as property file based on environment.. like landing,staging etc., Please help me if it is achievable and how? Can we use distributedCache ?

Also, Please provide DistributedMapCache examples.

Thanks

[#2 · Accepted solution]

The Input Directory property of GetFile supports Expression Language so you can reference a system property like ${my.directory} and define my.directory in bootstrap.conf by adding another java arg like:

java.arg.15=-Dmy.directory=/foo

Then you can have different bootstrap files per environment.

[#3]

Thank you @Bryan Bende for quick reply!

In addition to the above question, how can we pass the file name if a template is created and needs to be used by different users and they want to pass their own path?

The idea here is to get file from local path and put it in HDFS. I have created a template, which should be used by different users based on their need by passing the required path for both GetFile, PutFile. As bootstrap is common config, how can we handle this scenario? Users might not be using the UI.. we will be supplying the RET call to start/stop the process group.

[#4]

Is each user importing the template into a separate NiFi instance? or is there one NiFi instance with multiple users who all import the same template and want to retrieve files from different directories?

[#5]

it is same NiFi instance with multiple users.

[#6]

In that scenario there is always going to be something you have to set that is specific to the user. I think the best approach might be to use the REST API to change the value of GetFile's directory after the user imported the template and set it to the user's input directory.