Member since
10-27-2016
81
Posts
10
Kudos Received
0
Solutions
10-31-2024
06:17 AM
1 Kudo
That's perfect !
... View more
03-22-2018
09:07 AM
@nallen thank you very much for the quick response. I was able to figure out the issue of adding profile to result and implemented!
... View more
01-30-2018
01:53 PM
1 Kudo
@Anil Reddy In addition to Matt's answer if you want to know all supported Functions in Expression Language for your version of NiFi then click on Right Up Corner GlobalMenu Button And click on Help 3.Then Click on Expression Language Guide on Right Side will shows up all the functions that are supported in your version of NiFi. If you want to implement ${closed_epoch:format("yyyy", "GMT")} this expression even though it is not supported in your version of NiFi then as a work around you can use plus,minus functions. Assuming your closed_epoch attribute value is 1453843201123 ${closed_epoch:minus(86400000)} //this expression will minus 86,400,000 Milliseconds(i.e 24 hrs) from closed_epoch value. New value for closed_epoch will be 1453756801123. *if you are having DayLightSaving time then you need to change the milliseconds value in minus(or) plus function.
... View more
01-25-2018
09:10 AM
1 Kudo
It works, Thanks alot @Shu
... View more
08-24-2017
03:44 PM
@Geoffrey Shelton Okot Yes, that makes sense. But I am unable to figureout where can I configure those parameters in ConsumeKafka_0_10 processors
... View more
05-29-2017
08:45 AM
@Pierre Leroy when you are referring to download content from the URL, in general GET method is supported to get content from the webservice. I am not sure if you are configuring the POST request wrongly. "HTTP error 405 method not allowed" means URL exists with webservice but you are not authorized to access/perform that action. Please check if you need to specify any authorization headers to perform the action. I would suggest to get more details about the URL like uri, http method, is it ssl encrypted, any authorization fields required to access the URL etc and configure the Nifi processor to fulfill the same!
... View more
05-25-2017
07:23 PM
As Matt pointed out, in order to make use of 100 concurrent tasks on a processor, you will need to increase Maximum Timer Driver Thread Count over 100. Also, as Matt pointed out, this would mean on each node you have this many threads available. As far as general performance... the performance of a single request/response with Jetty depends on what is being done in the request/response. We can't just say "Jetty can process thousands of records in seconds" unless we know what is being done with those records in Jetty. If you deployed a WAR with a servlet that immediately returned 200, that performance would be a lot different than a servlet that had to take the incoming request and write it to a database, an external system, or disk. With HandleHttpRequest/Response, each request becomes a flow file which means updates to the flow file repository and content repository, which means disk I/O, and then transferring those flow files to the next processor which reads them which means more disk I/O. I'm not saying this can't be fast, but there is more happening there than just a servlet that returns 200 immediately. What I was getting with the last question was that if you have 100 concurrent tasks on HandleHttpRequest and 1 concurrent task on HandleHttpResponse, eventually the response part will become the bottle neck.
... View more
06-06-2017
09:02 PM
@Alvin Jin My suggestion would be use something like: https://regex101.com/ You can enter your regex and sample test you want to run it against. Matt
... View more
11-01-2016
02:00 PM
Never mind to accept the answer. I should appreciate your efforts. You are correct, services are going down due to heavy load on the CPU. we are seeing CPU spike when the app is running and seeing the CPU usage in the range of 90 - 100%. We are working to bring the CPU usage down and your suggestion to stop using metrics, falcon and flume services helps. Thanks.
... View more
10-31-2016
06:54 PM
I resolved this problem.
I create a new VM hortonworks, and do not install nifi, after this, download the new version (https://www.apache.org/dyn/closer.lua?path=/nifi/1.0.0/nifi-1.0.0-bin.zip) and use sudo sh /opt/nifi-1.0.0/bin/nifi.sh start .The problem has been resolved and nifi update has concluded.
... View more