I try this but file split into only one fiile which contain top 3 lines ... View more

@Mustafa Ali Qizilbash I tried with your UpdateRecord configs, not able to get your csv data(I used some sample data from your question screenshot) and the flow worked as expected. InputData: hw_3g_result_time,hw_3g_granularity_period,hw_3g_bsc_name,hw_3g_bsc_type,hw_3g_cell_name,hw_3g_cell_id,hw_3g_cell_index,hw_3g_reliability,VSRABAttEstabAMR,VSRABSuccEstabCSAMR 2018-04-26 0000,60,ULHR,BSC,UQRUR,48063,216,Reliable,33333,33 2018-04-26 0000,60,ULHR,BSC,UQRUR,48063,216,Reliable,77777,7 OutputData: hw_3g_result_time,hw_3g_granularity_period,hw_3g_bsc_name,hw_3g_bsc_type,hw_3g_cell_name,hw_3g_cell_id,hw_3g_cell_index,hw_3g_reliability,vsrabattestabamr,vsrabsuccestabcsamr 2018-04-26 0000,60,ULHR,BSC,UQRUR,48063,216,Reliable,33333,33 2018-04-26 0000,60,ULHR,BSC,UQRUR,48063,216,Reliable,77777,7 I attached the sample flow template that I have tried update-record-222899.xml .Use the attached flow xml as a reference and change per your case. ... View more

Many thanks, it worked. ... View more

@sandra Alvarez ExecuteInfluxDBQuery processor has been added in NiFi-1.7.0+ version, I think you are using <NiFi-1.7. You need to update the HDF/NiFi version to get these new processors (or) if you are having HortonWorks support then contact that team to get this processor to your NiFi version. ... View more

Tons of thanks Shu , I was struggling to find the solution for last 2 days doing all nonsense things like turning off \" in short escape sequencing and others but did not work at all. Thanks again ... View more

@shu: in incremental case: can we fetch updated rows on next schedule time. like i am adding 3 new rows and update provious row. so can we fetch updated rows also. through timestamp ... View more

@Mitthu Wagh You can use UpdateAttribute Processor by storing the state and incrementing the last state value then pass the attribute value to get HTTP response. Flow: As GetHTTP processor doesn't accept any incoming connections use InvokeHTTP processor instead of GetHTTP processor. UpdateAttribute Configs: In this processor i'm using getStateValue function to get the value for the variable and adding one to it so output flowfile from UpdateAttribute will have seq attribute with 1 as value in your first run. Then use the attribute in your InvokeHTTP processor to increment the page number. Refer to this link if you want to reset the state once the number reaches to limit. - If the Answer helped to resolve your issue, Click on Accept button below to accept the answer, That would be great help to Community users to find solution quickly for these kind of issues. ... View more

Thank you Shu for your quick response. I followed your instructions regarding the PutMongoRecord processor. That helped simplify my flow a bit. If the RunMongoAggregation is working as I think it is, then as a FlowFile runs through the processor, it will "trigger" the processor and then route onto original, while the aggregation works on the database and output into "results" (see image below). Is that your thought process? Also -- I probably have to clear out the database I'm aggregating on between data-sets to prevent duplicates, do I not? @Shu ... View more

@Shu Ok, I will try that Shu. Hope it will load this time. ... View more

@Ron Labau if you are using QueryDatabaseTable processor then it is regular sql function on db. if you are using convertRecord processor then we are doing in NiFi. ... View more