I have a mysql destination table with column type datetime. my nifi flow is like convertJsontoSQL -> putsql (into destination table) The action is delete for putsql. after conversion of jsontosql i am getting a value '2023-03-28 15:54:28' which is a valid timestamp. but the flow is failing with below error:   duetoThevalue of the sqlargs. 14.value is '2023-03-28 15:54:28', which cannot be converted to a timestamp; routing to failure: java.sql.SQLDataException: The value of the sql.args. 14.value is '2023-03-28 15:54:28', which cannot be converted to a timestamp - Caused by: java. text. ParseException: Unparseable date: "2023-03-28 15:54:28"   I can able to use the same "2023-03-28 15:54:28" for manually inserting into a sample datetime column. and can able to delete a record with where clause as this value. I could not understand why Nifi is still not able to convert it to timestamp.   Any suggestions are appreciated. ... View more

Hi All,   I am currently building a pipeline that fetches all changes from 2 mysql DBs into a final mysql warehouse.   I am using changecapturemysql processor to identify inserts,updates and deletes and then sending them to putdatabaserecord processor. All inserts work good. My source has a PK (primary key) column. My destination has the same column + another column as PK . I am able to replicate inserts. But when it comes to updates and deletes,  updates on non primary keys were getting captured, but if i update primary key column in source, it is unchanged in destination. same with deletes. a delete with where clause on PK, doesnot deleting the record in destination. As i read the documentation this is expected behaviour - "MPORTANT: If the Statement Type is UPDATE, then the incoming records must not alter the value(s) of the primary keys (or user-specified Update Keys). If such records are encountered, the UPDATE statement issued to the database may do nothing (if no existing records with the new primary key values are found), or could inadvertently corrupt the existing data (by changing records for which the new values of the primary keys exist)." as per nifi official documentation. Now my question is how can i acheive end-end replication into the destination DB table by using changepaturemysql processor ? is there any alternative that i can get the updates and deletes happen even though they are based on primary keys...? does putsql here helps here ? Please guide me. ... View more

Hello Supporters,   I am trying to use NIFI CLI toolkit so that I can load 100 parameters using parameter context. (doing it using UI is a tedious job and not appropriate for deployments as well)  I installed Nifi toolkit on remote server. I generally ssh into this server from local and run my commands. To see the UI, I use ssh tunnel.   There is only one user for this Nifi Instance (admin) and it don't have https certificates. (Single User Authentication)   When i start CLI prompt it works fine (below)   # sh cli.sh CLI v1.16.3 Type 'help' to see a list of available commands, use tab to auto-complete. Session loaded from /root/.nifi-cli.config #>     But when I use any Nifi commands, it throws below error:   #> nifi list-param-contexts -u http://localhost:8443/ ERROR: Error executing command 'list-param-contexts' : Unexpected end of file from server   if I use https ,  #> nifi list-param-contexts -u https://localhost:8443/ ERROR: Error executing command 'list-param-contexts' : truststore, truststoreType, and truststorePasswd are required when using an https url   But I don't use truststore or passwords for single admin user.       Also commands related to Registry working fine.   #> registry current-user -u http://localhost:18080 anonymous #> registry list-buckets -u http://localhost:18080 # Name Id Description - ------------ ------------------------------------ ----------- 1 First-bucket 8a3da253-f635-4b01-941f-bfb6437cead7 2 delete 4df052fd-fddc-4e7b-b4ea-bb3b8b691385     Is this something related to https/URI  ? I don't find much information online for this issue and I was struck from many days.. Please help me solve this.     @TimothySpann  @araujo Sincere request to help me find the problem.. ... View more

Hello Lovely community,   I am new to NiFi, I am able to connect to mysql dummy database from Nifi and everything works fine. But I want to understand how can we connect to databases that use SSH tunneling.. Because I have not seen any properties related to SSH in the database processors. My processors being used is "capturechangeMysql"   This source DB server is secured and I need SSH tunnel to make the connection. I have 100 such sources. Should I add my nifi server ssh keys in all the source servers ? and even then where can i give the SSH tunnel information? and the private key.. Because while using any SQL client we can use the tunnel along with main DB username and password as shown in attached screen, but for Nifi I am not able to see a way.. Please help me with your suggestions.. /\ SSH tunnel ... View more