In response to the question is NiFi generating key itself when none is provided? Or do I have to generate key myself somehow? Answer is :  Raw Key (hexadecimal) property only used when given algorithm uses Keyed cipher for example : AES_CBC, it has to be provided by user , Not generated automatically, based on processor configuration screen shot , password is only needed in NIFI and , same password should be used while  decrypting with in NIFI by same processor with Mode:  Decrypt  or any other decrypting application. ... View more

Tailfile stores local/cluster state to check where it has to start tailing again  or till what time it has already tailed the log file  like List* processor, but state information can not be used by other processor in NiFI to make their own work like flow files attribute value. Best way I could think of you have you think about buffer time/ retention time for log files and with in that retention time tailfile should be able to taill log files and delete the log files after their retention time, something  like whenever    ExecuteStreamCommand  run for delete it will only delete the files which has last modified time older then X number of days, assuming file which are older then X days is successfully tailed by Tailfile.   Thank You.  ... View more

Assuming you are using File based default Authoriser in NIFI, and if you are managing policies  from Top right Hamburger menu, there you see default policy and do not get an option to create polices specific to Process Group or Processor level. So you need to use Operate tile "key" icon to configure  granular policies.    For example I have process group name test and when select this process group I get Operate controls of PG test and when user click on key icon    This is page where user  lands in were , user has an option to add/remove users for specific policies  by using Override option  in this example user : nifiadmin which earlier had view the component ,   removed from list and then we will see  how it looks like for user nifiadmin the PG test on UI.          Hope this helps.   Thank You. ... View more

By looking at request ,I assume flow design would be ListFTP--->FetchFTP , So after listing of file by  ListFTP -->flow files passed to FetchFTP to fetch from FTP, but file is deleted by retention policy before FetchFTP try to fetch is expected result " resulting processor throwing an error " The system cannot find the file specified" If error is expected and you just want to suppress those errors which is genuine one , I do not see this is a good idea so when if other issue encounter by FetchFTP , user won't be able to notified. Also I do not see this is possible.            ... View more

Have you tried passing header details under property "Authentication Header Charset" under JettyWebSocketClient ? ... View more

To connect from NIFI to HDFS , all the HDFS processors in NIFI require local/updated copy of hdfs-site.xml & core-site.xml on nifi host and those files needs to be called under processor config property " Hadoop Configuration Resources" , using these two files configs nifi *hdfs processors will understand hdfs cluster details, its security config and based on that further property will be used such as Kerberos authentication. ... View more