question Re: How to use putSQL in nifi in Support Questions

How to use putSQL in nifi

Rikk — Wed, 06 Oct 2021 18:12:16 GMT

Hi all I am absolute beginner in apache nifi as well as in DWH field, I want to create replica of my database table, using nifi. I am taking Mysql table data using QueryDatabaseTableRecord processor. Now I want this data to be inserted into another mysql database table which I have created. I was trying using the putSQL processor but that didn't worked I got no record inside of my table.

I tried things which I could think of myself, but that was not enough. Please help me !!!

Here is the screenshot of my flow,

Re: How to use putSQL in nifi

SAMSAL — Wed, 06 Oct 2021 20:47:39 GMT

Hi,

You seem to be having the correct processors and sequence. Can you share screenshot with the configuration of the put SQL. Have you configured the PUTSQL with the correct DB connection? Also are you seeing data (FlowFiles) flowing into it from the above processors. It could be that you are not getting any data to begin with or your configuration in the putSQL is incorrect. By the way why are you connecting failuer,original, sql relationship from the ConvertJsonTOSQL to the PUT SQL? you will get an error this way, you need to just connect the sql releationship. Another thing , the SQL property in the PUTSQL needs to be empty so that it process the sql received from the convert processor, if you have anything in there it will not take the sql insert from the convert processor

Re: How to use putSQL in nifi

Rikk — Thu, 07 Oct 2021 04:52:31 GMT

Hi thanks for the reply, I have set the db connection pool, and both are working I believe. I am getting the data from the source database it is available in the queue,

the ss of my process -

MysqlPut configuration -

Where I did this wrong ?

Re: How to use putSQL in nifi

SAMSAL — Thu, 07 Oct 2021 16:32:01 GMT

I think I know what is the problem. Since you are not doing any fragmentation -like in using split processor- try setting the Support Fragmented Transaction to False in the PUTSQL. Also remove the original \ failure connection from the Convert processor. you can mute those relationship in the convert setting table by checking the box.