Hello there..
I am using replacetext processor where i am using the below query as my replacement value.
INSERT into log_hive.log_ozone_retention_jobs
(Table_Name,Process_Date, Process ,Status ,Source_Count ,Target_Count ,Start_Time ,End_Time ,Notes)
select 'Customer_Voip',${date_list}, 'Insert_Into_Ozone','Insert Successful',${source_count},null,'${start_time}',current_timestamp(),null;
date_list is an attribute value coming along with the incoming flowfile..
My downstream processor is PutHiveQL where it executes the insert query provided above.. I was successfully able to insert a single record for that day using the PutHiveQL processor.. However, today i found that PutHiveQL actually inserted 2 records for the same day as below... the incoming flowfile had date_list value as 20250401 for example and is expected to insert only 1 record but inserted 2 records with 2 different end time... this happened with all the dates that were meant to be loaded...
PutHiveQL processor configuration..
Interestingly, I have used the same processor in the next process group and doing the same insert but for other purpose and as per expectations it has inserted only 1 record per date_list/process_date.. and just to inform that i am using the similar logic atleast 8-10 times within the nifi flow and is running correctly without any duplicated records..
Can somebody please let me know what is the issue or am i missing something ?
Thank you!!
