Do you see the same error string in nifi-app.log ? or there are any additional information in applogs ? if you see more details, please provide. Are you able to make any changes to flow design ? Can you please permissions and space is fine where flow.xml.gz is placed?   Thank You. ... View more

Few points when connecting to any DataBase from NiFi  NiFi has Generic controller service named DBCPConnectionPool which used to create connection pool to given database and processors such as ExecuteSQL or  PutSql will use this controller service to obtain connection and run the given queries.   What is needed as minimum prerequisite  to start with DBCPConnectionPool     1. Determine type of Database  2. Determine the JDBC URL syntax supported by Database  3. The Database client Driver which works outside of NiFi to connect to same Database needs to be placed on each NiFi nodes on given location which can be read user who is running NiFi as service    All above needs to be provided by user , if Ucanaccess 5.0.1 client Driver works outside of NiFi then it should work with DBCPConnectionPool as well, Where you are getting this message "Given file does not exist" ? Is client driver is present on NiFi hosts and configured Database Driver Location is correct ? permissions?    You mentioned There is a Cdata driver which works but that is a licensed product" , it works from where ? from NiFi:DBCPConnectionPool?   Thank You.  ... View more

Same Command Arguments are you able to run as user nifi (or the user who is responsible to run nifi service )against  path which is determine by fileslocation outside of nifi at command prompt ? ... View more

Not supported , as ListFTP or ListSFTP works on last modified timestamp to pick newly modified files since it ran before. So, if a file is added with older last modified timestamp than the one which Listftp already picked, then the file won't be picked with listftp logi, max or min file age property does not aline with current listing strategy.  ... View more

In response to your queries :   1,do you konw how to add "Minimum File Age" property in listftp processor ?  Ans : Not supported , as ListFTP or SFTP  works on last modified timestamp to pick newly modified files since it ran before. So, if a file is added with older last modified timestamp than the one which Listftp already picked, then the file won't be picked with listftp logic.  2.  listsftp can connect ftp server ?  i try ,but failed  Ans : Use ListFTP is FTP server is not secure. 3. What is the difference between listftp and listsftp?   We have two type of FTP servers, FTP and SFTP , SFTP uses a secure channel to transfer files while FTP doesn't, thus NiFi has FTP and SFTP processors.    To address your use case "file may be update anytime,  so i need the "Minimum File Age" property like listsftp processor get"   Ans : You need to change/update the logic on how files written at FTP server , If the same files getting updated/appended multiple time assuming write is not completed yet so try to rename the file with specific name pattern after append is completed  and only list/fetch the files which matches with rename pattern using File Filter Regex settings.          ... View more

Although 2 nodes showing connected , we should also see the time stamps under column started At and LastHearbeat . also I am expecting to see coordinator and primary under status column.   it is not clear from attached snap, as in from which node you are trying to access the UI ? if you open UI from each node 1,2, and 3 what you see? Is 3rd is showing as disconnected ?  have you checked the process id's  of nifi on 3rd node? How zookeeper is used ? External user or embedded zookeeper ?   ... View more

Can you please provide more details on this "delay" and why delay is needed ?  FYI: Processors can be configured to all the time 0 sec or after a certain interval example after every 60sec or at fix time with cron driven.    So if  there is chance when files may not be present on ftp to be able to Fetch by NiFI : List/Fetch/GetSFTP processors , you can schedule them specific time.   I can help you more once you provide more details on your use case.   Thank You.       ... View more

Thank You, If you found this response assisted with your query, please take a moment to login and click on "Accept as Solution" below this post.   Thank You. ... View more

Thanks for additional details , You can use QueryDatabaseTable or GenerateTableFetch with ExecuteSQL both will be fine, as said you need to limit number of records per flow file .   When you say "When I try to move table with more then 1 GB data, my nifi GUI crashes"does that mean 1 flow file size is 1GB ? in NiFi generate by QueryDatabaseTable ? Is this happening when loading into NiFi by QueryDatabaseTable or after SplitAvro ? or At PutDabaseRecord ?   Ideal way is to have small flow file size at the loading from DB by limiting setting in QueryDatabaseTable or GenerateTableFetch which ever you use so memory footprint will be less and records will be streamed into multiple flow files.   Thank You.     ... View more

In order to read parquet data from s3 bucket flow would look like : ListS3 -> FetchS3 -> ConvertRecord with parquet reader .   So you are facing issue with ListS3 ? Can you please provide more details , I mean if you have configured with all the required details and upon start processor is throwing any error ? Processor show invalid and need some additional  information? snapshot , error stack trace would help .   You can also open Support case at support   Thank You  ... View more