Member since
07-25-2016
55
Posts
28
Kudos Received
1
Solution
My Accepted Solutions
Title | Views | Posted |
---|---|---|
5674 | 07-26-2016 12:31 AM |
09-02-2016
01:42 AM
Hi, I want to perform provenance search through REST (to retrieve data and utilize it for monitoring etc). - Currently I dont know what is the correct format for calling /provenance endpoint (essentially doing search, not sure how to specify the search query itself). I tried following on browser, but see a blank page: http://localhost:8080/nifi-api/provenance?uuid=c94ea102-ff9d-4985-a548-fa6611d50e8a - Following api end point works: http://localhost:8080/nifi-api/provenance/search-options Any help in resolving this would be highly appreciated. Thanks Obaid
... View more
Labels:
- Labels:
-
Apache NiFi
08-15-2016
10:58 PM
I have LDAP setup and working for me. However whenever I go to /nifi/login page, it throws an exception in User logs. Though it works just fine i.e I can login and logout etc. Just wondering if you have seen this exception (is this by-design?) [Already reported this issue] 2016-08-15 15:43:00,046 ERROR [NiFi Web Server-94] o.a.n.w.s.NiFiAuthenticationFilter Unable to authorize: An Authentication object was not found in the SecurityContext
... View more
08-14-2016
10:38 PM
Hi, Do we need to stop all work-flows before adding a new node? Can we add new Nifi slaves to an existing cluster? Actually I had issues adding a new Slave to an existing cluster (cluster had few workflows running). Thanks
... View more
Labels:
- Labels:
-
Apache NiFi
08-09-2016
11:46 PM
Very exciting, Regarding Nifi 1.0, do you know when will it be released (like approximation etc). Cannot wait to try it our, is it stable enough to run workflows?
... View more
08-09-2016
08:01 PM
Hello to this awesome community, While playing with Apache Nifi (cluster with 5 slaves and 6GB RAM/slave) we managed to crash the cluster a bunch of times by making human errors. Example: We loaded a compressed file (100MB) in Nifi (GetFTP) and uncompressed it (500MB). Splitting this file (SplitText) caused the cluster to crash, since there were 1-2 million lines which translated to 1-2 million FlowFiles. Setting back pressure in such cases didn't help since SplitText will still generate 2million+ FlowFiles regardless. So in production, you wouldn't want your cluster to chock/crash if such kind of mistakes are made. 1. Nifi gives this awesome flexibility to write these workflows, however are there any guidelines that we could follow to safeguard against human-errors, and enable Nifi for a general purpose use (like share a Nifi cluster among teams) Thanks
... View more
Labels:
- Labels:
-
Apache NiFi
08-09-2016
06:52 PM
Awesome, So by saying 'reset on restart' you mean restarting the Workflow (Process Groupe/Processor) or restarting the Nifi Instance? - Regarding usage, do you guys use it for windowing operations, like count x every minute? - If I am counting an attribute X in a cluster, will it show me aggregated results on the Counter dashboard (like showing aggregated value of X for the whole cluster, or show value of X for each slave) Thanks
... View more
08-09-2016
06:10 PM
1 Kudo
Hi, I noticed 'Counter' button on top right of Nifi UI (Counters button is right next to Summary button on Admin options). I tried to search for any documentation however could find it. Could you guys share any link/documentations (or comments) on how to use this feature, purpose of this feature etc? Seems like an option to maintain counts, however not sure how to use it. Thanks
... View more
Labels:
- Labels:
-
Apache NiFi
08-02-2016
03:13 PM
2 Kudos
Awesome, I solved it by using the append('\n') for attribute: ${m1:append('\n')}${m2:append('\n')}${m3} Thanks a lot,
... View more
08-02-2016
02:57 PM
1 Kudo
Hi, I have a scenario where My GetHTTP processor gets a JSON of system health metrics. I extract the attributes from the Json to essentially extract the desired metrics that I want to display on a Graph. Input: Suppose following attributes I extracted from Json using EvaluateJSONPath processor: metric1='<myconmapy>.<metric1> <value> <timestamp>' metric2='<myconmapy>.<metric2> <value> <timestamp>' metric3='<myconmapy>.<metric3> <value> <timestamp>' Output: I want to convert all the above mentioned attributes/metrics as lines of FlowFile content, such that one FlowFile content will look like following (each line contains an attribute value): <myconmapy>.<metric1> <value> <timestamp> <myconmapy>.<metric2> <value> <timestamp> <myconmapy>.<metric3> <value> <timestamp> Is there a way to achieve the above mentioned Output using Nifi processors? Thanks
... View more
Labels:
- Labels:
-
Apache NiFi
07-26-2016
12:31 AM
1 Kudo
Thanks mqureshi, As I understand from your comments, Nifi dosent have a built-in fault-tolerant mechanism. Meaning if one node goes down then there has to be a manual intervention to prevent data loss/redirect flow etc? To put it another way, if you dont have a special RAID 10 setup then you will loose data if a node goes down? Thanks for the links, I will certainly go through them. Thanks
... View more
- « Previous
- Next »