Member since
06-08-2017
1049
Posts
518
Kudos Received
312
Solutions
My Accepted Solutions
| Title | Views | Posted |
|---|---|---|
| 11240 | 04-15-2020 05:01 PM | |
| 7144 | 10-15-2019 08:12 PM | |
| 3126 | 10-12-2019 08:29 PM | |
| 11536 | 09-21-2019 10:04 AM | |
| 4354 | 09-19-2019 07:11 AM |
09-20-2018
11:53 PM
1 Kudo
@Krishna Sreenivas As of now there is no built in processor in NiFi that could extract Json attribute dynamically because if we add significant number of attributes dynamically to the flow file, As attributes are hold in memory this will cause performance issues. We need to add all the json keys/attributes and matching json path as value in EvaluateJsonPath processor and change the destination property to flowfile-attribute to keep them as a flow file attributes. Please refer to This link for more details regarding dynamic attribute extract processor. Refer to this link regards to similar kind of usecase and end of this thread there is script which you can leverage to extract key/values. - If the Answer helped to resolve your issue, Click on Accept button below to accept the answer, That would be great help to Community users to find solution quickly for these kind of issues.
... View more
09-20-2018
11:36 PM
@satyadevi jagata change the below property value in EvaluateXQuery processor to Destination
flowfile-attribute Then try to re run the processor. If the above property value set to flowfile-content then Processor doesn't allow more than one query to be added. If the issue still doesn't resolved, please open a new question for more visibility to the community and Add all the details what you have tried so far and sample data to reproduce the same issue.
... View more
09-19-2018
02:39 PM
@Mitthu Wagh Use getDelimitedField function and use UpdateAttribute processor and add new properties like. a ${fileName::getDelimitedField(1,'_')} b ${fileName::getDelimitedField(2,'_')} By using getDelimitedField function we are going to add all the attributes you needed. - If the Answer helped to resolve your issue, Click on Accept button below to accept the answer, That would be great help to Community users to find solution quickly for these kind of issues.
... View more
09-19-2018
01:01 AM
5 Kudos
@yazeed salem Method1:Using UpdateAttribute+RouteOnAttribute Processors it would be easier if you introduce new update attribute processor before RouteOnAttribute and prepare two new attributes in UpdateAttribute processor. Configs: Then in RouteOnAttribute processor use or function to Configs: Now processor will route the flowfile to ROUTE1 relationship. (or) Method2: By using RouteOnAttribute processor: Use the below expression in ROUTE1 property value ROUTE1 ${literal(${text.tag.type:equals('XXX'):and(${txt:contains('YES')})}):or(${text.tag.type:equals('YYY'):and(${txt:contains('NO')})})} Both Methods will result the flowfile into ROUTE1 relationship, Choose the method which best for your case. - If the Answer helped to resolve your issue, Click on Accept button below to accept the answer, That would be great help to Community users to find solution quickly for these kind of issues.
... View more
09-18-2018
09:09 PM
@Raj ji Yes you can use it.. PutHBaseJson processor:- 1. expects json individual messages(not an array) 2. You need to extract the values for ServerName,ServerNo from the content using EvaluateJsonPath processor then use Row Identifier
${ServerName},${ServerNo} (or) PutHBaseRecord processor: Using Record processor we don't need to split the array of json messages if you are using this processor but we need to prepare the row_id by using Update Record processor by using concat(/ServerName,',',/ServerNo) function. Refer to this link for more details regards to UpdateRecord processor concat function usage.
... View more
09-18-2018
03:09 PM
1 Kudo
@Mark I tried your case By using UpdateAttribute's Store the state feature. flow: 1.Two GenerateFlowfiles //to get 2 flowfiles2.SplitText //split the flowfile into 1 line 3.ExtractText //extract the first value of the from the content 4.RouteOnAttribute //check the extracted value from the flowfile attribute 5.UpdateAttribute //add one to the seq attribute and reset the seq attribute value when it reaches to 10(advance d usage of update attribute processor) 6.RouteOnAttribute //check seq attribute value and send to putemail if seq = 10 7.PutEmail //send mail I have attached flow template, reuse it and change as per your requirements. 222030-support-update-reset.xml
... View more
09-18-2018
01:29 PM
@Hamza Rashid Change the below property value to Offset Reset
earliest //automatically reset the offset to earliest And if you are already consumed from the Group then change the Group ID nifi-cosumers-1 Run the processor again. - If the Answer helped to resolve your issue, Click on Accept button below to accept the answer, That would be great help to Community users to find solution quickly for these kind of issues.
... View more
09-18-2018
12:54 PM
@Raj ji For this use case you have to use Wait-Notify processors to finish inserting records first then Update the records and last for deleting the records. Refer to this and this articles for configuring and usage of Wait/Notify processors.
... View more
09-17-2018
05:32 PM
@Mark We need more details to provide correct solution for this case 1.Could you please provide some sample data for this case? 2.Do you want to count user_name in particular flowfile i.e if flowfile content having 10 times user_name then sent out email? (or) Count 10 flowfiles that have user_name and send out mail once the count reaches out 10? 3.Do you know the schema for the flowfile?
... View more
09-17-2018
12:58 PM
@Josh Nicholson To monitor health/status of the cluster the REST API is the way to go, Alternative way is by using TailFile processor and tail nifi-app.log and send alerts if you find any disconnected node from the cluster. this and this links walk you through configuring/usage of TailFile processor. Refer to this link for more details regards to all kinds of monitoring in that NiFi offers.
... View more