Member since
06-08-2017
1049
Posts
518
Kudos Received
312
Solutions
My Accepted Solutions
| Title | Views | Posted |
|---|---|---|
| 11240 | 04-15-2020 05:01 PM | |
| 7145 | 10-15-2019 08:12 PM | |
| 3126 | 10-12-2019 08:29 PM | |
| 11541 | 09-21-2019 10:04 AM | |
| 4356 | 09-19-2019 07:11 AM |
09-15-2018
12:50 PM
@Mustafa Ali Qizilbash I tried with your UpdateRecord configs, not able to get your csv data(I used some sample data from your question screenshot) and the flow worked as expected. InputData: hw_3g_result_time,hw_3g_granularity_period,hw_3g_bsc_name,hw_3g_bsc_type,hw_3g_cell_name,hw_3g_cell_id,hw_3g_cell_index,hw_3g_reliability,VSRABAttEstabAMR,VSRABSuccEstabCSAMR
2018-04-26 0000,60,ULHR,BSC,UQRUR,48063,216,Reliable,33333,33
2018-04-26 0000,60,ULHR,BSC,UQRUR,48063,216,Reliable,77777,7 OutputData: hw_3g_result_time,hw_3g_granularity_period,hw_3g_bsc_name,hw_3g_bsc_type,hw_3g_cell_name,hw_3g_cell_id,hw_3g_cell_index,hw_3g_reliability,vsrabattestabamr,vsrabsuccestabcsamr
2018-04-26 0000,60,ULHR,BSC,UQRUR,48063,216,Reliable,33333,33
2018-04-26 0000,60,ULHR,BSC,UQRUR,48063,216,Reliable,77777,7 I attached the sample flow template that I have tried update-record-222899.xml .Use the attached flow xml as a reference and change per your case.
... View more
09-15-2018
11:54 AM
@Anurag Mishra Probably the session is initializing when you are inserting the data for the first time. After first insert(session is already initialized), did u tried to insert more values into the same table and check does those inserts also taking 5 mins or not.
... View more
09-15-2018
11:49 AM
@Mustafa Ali Qizilbash Add change the added dynamic properties in update record processor as shown below: /vsrabsuccestabcsamr
/VSRABSuccEstabCSAMR
/vsrabattestabamr
/VSRABAttEstabAMR As we swapping the data to lower case, so keep the lowercase field names as property name and upper lower mix filed name as property value. Then processor will add the field value to the newly added field names.
... View more
09-14-2018
09:11 PM
@Josh Nicholson You can use NiFi RestAPI to get cluster summary i.e how many nodes are connected, total node count..etc info Curl Command: curl -k https://<nifi-host>:<port>/nifi-api/flow/cluster/summary {"clusterSummary":{"connectedNodes":"n / n","connectedNodeCount":n,"totalNodeCount":n,"connectedToCluster":true,"clustered":true}} As you we are going to get response as above json then you can parse the json using EvaluateJsonPath processor (or) ExtractText Processor to extract the values using regex then make a decision using RouteOnAttribute processor is totalNodeCount not equals to ConnectedNodeCount then trigger an email. Flow: 1.InvokeHTTP 2.EvaluateJsonPath 3.RouteOnAttribute
4.PutEmail
... View more
09-14-2018
06:45 PM
@Mustafa Ali Qizilbash In your CSVSetWriter controller service configure as in Schema Text Property define new schema i.e. avro schema with lowercase field names. Let us know if you are having any issues..
... View more
09-14-2018
01:27 PM
@Mustafa Ali Qizilbash
We can achieve this case in two ways using UpdateRecord Processor ,QueryRecord processor Using UpdateRecord processor: As your data having Header so use Csv reader use Then use UpdateRecord processor with Replacement Value Strategy Record Path Value Then swap the record path value, add new property as /lowercase_filed_name /upper_lowercase_field_name Refer to this link for more details regards to UpdateRecord processor. Configure the Record Writer avro schema registry matching with your new filed names(i.e lowercase filed names). Then processor will swap the values from the record path and keep them to your new lowercase field names. 2.Using QueryRecord processor: Add new property in QueryRecord processor and keep the query as select col1,col2,col3.. from FLOWFILE Then configure the Record Writer controller service avro schema matching with the select statement column names(case sensitive), Then processor will write the flowfile with new filed names. For more details regards to convert record processor refer to this link. You can use either of these methods choose which is better fit for your case. I tried some simple flow using both processors, Use the attached flow xml as a reference and change per your case 222899-updaterecord-queryrecord.xml
... View more
09-14-2018
01:34 AM
2 Kudos
@ANKIT PATEL Use SplitText processor with below configs: We are keeping header line count as 1 i.e first line treated as header and this header is added to each split and we are splitting 3 lines as one split. InputFlowFile: fieldname value
id 1
name ankit
address ____
id 2
name john
address ______ Use Splits relationship from Splittext processor OutputFlowfiles: ff1: fieldname value
id 1
name ankit
address ____ ff2: fieldname value
id 2
name john
address ______ For more details refer to this link for more details regards to SplitText processor. - If the Answer helped to resolve your issue, Click on Accept button below to accept the answer, That would be great help to Community users to find solution quickly for these kind of issues.
... View more
09-13-2018
11:15 PM
@Mustafa Ali Qizilbash Could you add more details regards to Avro is not accepting Upper case column name means? Some sample data will be useful to understand root cause of the issue..
... View more
09-13-2018
09:36 PM
@Mustafa Ali Qizilbash
I think issue is with Order Attribute as this property doesn't accept expression language so use attribute name without expression language. Make sure you are having enforce order configs as Change the Wait Timeout property value in EnforceOrder processor as pre your requirement.
... View more
09-13-2018
09:01 PM
@Mustafa Ali Qizilbash For this case using EnforceOrder processor we can achieve your required file. FLow: In this flow EnforceOrder processor enforce to get header flowfile first then actual data flowfile and using MergeContent processor we are merging them into one. Change the Wait Timeout property value in EnforceOrder processor as pre your requirement. I have attached the template xml in this thread,you can keep as reference for your flow. enforce-order.xml
... View more