Member since
06-08-2017
1049
Posts
514
Kudos Received
312
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
8290 | 04-15-2020 05:01 PM | |
4855 | 10-15-2019 08:12 PM | |
1840 | 10-12-2019 08:29 PM | |
8074 | 09-21-2019 10:04 AM | |
2781 | 09-19-2019 07:11 AM |
10-23-2018
05:31 AM
@shu: in incremental case: can we fetch updated rows on next schedule time. like i am adding 3 new rows and update provious row. so can we fetch updated rows also. through timestamp
... View more
08-30-2018
12:27 PM
1 Kudo
@Mitthu Wagh You can use UpdateAttribute Processor by storing the state and incrementing the last state value then pass the attribute value to get HTTP response. Flow: As GetHTTP processor doesn't accept any incoming connections use InvokeHTTP processor instead of GetHTTP processor. UpdateAttribute Configs: In this processor i'm using getStateValue function to get the value for the variable and adding one to it so output flowfile from UpdateAttribute will have seq attribute with 1 as value in your first run. Then use the attribute in your InvokeHTTP processor to increment the page number. Refer to this link if you want to reset the state once the number reaches to limit. - If the Answer helped to resolve your issue, Click on Accept button below to accept the answer, That would be great help to Community users to find solution quickly for these kind of issues.
... View more
08-28-2018
03:17 PM
Thank you Shu for your quick response. I followed your instructions regarding the PutMongoRecord processor. That helped simplify my flow a bit. If the RunMongoAggregation is working as I think it is, then as a FlowFile runs through the processor, it will "trigger" the processor and then route onto original, while the aggregation works on the database and output into "results" (see image below). Is that your thought process? Also -- I probably have to clear out the database I'm aggregating on between data-sets to prevent duplicates, do I not? @Shu
... View more
09-20-2018
01:13 AM
@Shu Ok, I will try that Shu. Hope it will load this time.
... View more
08-24-2018
06:57 PM
@Ron Labau if you are using QueryDatabaseTable processor then it is regular sql function on db. if you are using convertRecord processor then we are doing in NiFi.
... View more
08-20-2018
01:53 PM
1 Kudo
@CHEH YIH
LIM
I think you are using extract text processor to extract the content and keep as attribute to the flowfile if yes then change Maximum Buffer Size 1 MB Specifies the maximum amount of data to buffer (per file) in order to apply the regular expressions. Files larger than the specified maximum will not be fully evaluated. Maximum Capture Group Length 1024 Specifies the maximum number of characters a given capture group value can have. Any characters beyond the max will be truncated. These two property values as per your flowfile size. - If the Answer helped to resolve your issue, Click on Accept button below to accept the answer, That would be great help to Community users to find solution quickly for these kind of issues.
... View more
08-20-2018
04:15 PM
3 Kudos
hive.merge.cardinality.check=false is a bad idea. The logic controlled by this property checks if the ON clause of your Merge statement is such that more than 1 row from source side matches the same row from target side (which only happens in WHEN MATCHED clause). Logically what this means is that the query is asking the system to update 1 existing row in target in 2 (or more) different ways. This check is actually part of SQL standard definition of how Merge should work. You either need examine your data or the ON clause but disabling this check, when it throws a cardinality_violation error, may lead to data corruption later.
... View more
08-18-2018
11:40 PM
Thanks very much @Shu for your solution . I managed to find a way which is almost similar to yours.
... View more
08-15-2018
04:05 AM
@Shu Please find attached the list queue after GetFile. As soon as i start my UpdateRecord the List queue become blank. attaching the listqueue after UpdateRecord processor Expected output is to concatenate the row 9th value (FEBetaPack01) and 23rd row value (FE_ChargerSim_CurrentRipple)under column 'filename ' as (FEBetaPack01-FE_ChargerSim_CurrentRipple). Please help. Thanks
... View more