Member since
08-11-2017
136
Posts
1
Kudos Received
0
Solutions
11-13-2018
09:47 AM
Hi @Matt Clarke thank you for your answer, by the way do you know where should i add this trustore or jks? I have used keytool for generating jks file here is a link https://docs.oracle.com/cd/E19798-01/821-1751/ghlgv/index.html but wheni run this code in cmd ( i use windows os) i got this error: Access denied FileNotFoundException. what should i change to make this process properly?
... View more
11-12-2018
10:23 AM
I want to invoke remote rest service from my nifi flow, but when i try to make this operation i got this error: here is my nifi flow:ex1.xml what should i change to get rid of this error? (P.S i have changed connection timeout time but nothing has changed) 2018-11-12 14:15:25,387 ERROR [Timer-Driven Process Thread-7] o.a.nifi.processors.standard.InvokeHTTP InvokeHTTP[id=0ba0b02b-bc72-492d-657f-372061ab1dce] Routing to Failure due to exception: java.net.ConnectException: Failed to connect to reqres.in/104.28.29.206:443: java.net.ConnectException: Failed to connect to reqres.in/104.28.29.206:443
java.net.ConnectException: Failed to connect to reqres.in/104.28.29.206:443
at okhttp3.internal.connection.RealConnection.connectSocket(RealConnection.java:225)
at okhttp3.internal.connection.RealConnection.connect(RealConnection.java:149)
at okhttp3.internal.connection.StreamAllocation.findConnection(StreamAllocation.java:195)
at okhttp3.internal.connection.StreamAllocation.findHealthyConnection(StreamAllocation.java:121)
at okhttp3.internal.connection.StreamAllocation.newStream(StreamAllocation.java:100)
at okhttp3.internal.connection.ConnectInterceptor.intercept(ConnectInterceptor.java:42)
at okhttp3.internal.http.RealInterceptorChain.proceed(RealInterceptorChain.java:92)
at okhttp3.internal.http.RealInterceptorChain.proceed(RealInterceptorChain.java:67)
at okhttp3.internal.cache.CacheInterceptor.intercept(CacheInterceptor.java:93)
at okhttp3.internal.http.RealInterceptorChain.proceed(RealInterceptorChain.java:92)
at okhttp3.internal.http.RealInterceptorChain.proceed(RealInterceptorChain.java:67)
at okhttp3.internal.http.BridgeInterceptor.intercept(BridgeInterceptor.java:93)
at okhttp3.internal.http.RealInterceptorChain.proceed(RealInterceptorChain.java:92)
at okhttp3.internal.http.RetryAndFollowUpInterceptor.intercept(RetryAndFollowUpInterceptor.java:120)
at okhttp3.internal.http.RealInterceptorChain.proceed(RealInterceptorChain.java:92)
at okhttp3.internal.http.RealInterceptorChain.proceed(RealInterceptorChain.java:67)
at okhttp3.RealCall.getResponseWithInterceptorChain(RealCall.java:185)
at okhttp3.RealCall.execute(RealCall.java:69)
at org.apache.nifi.processors.standard.InvokeHTTP.onTrigger(InvokeHTTP.java:791)
at org.apache.nifi.processor.AbstractProcessor.onTrigger(AbstractProcessor.java:27)
at org.apache.nifi.controller.StandardProcessorNode.onTrigger(StandardProcessorNode.java:1165)
at org.apache.nifi.controller.tasks.ConnectableTask.invoke(ConnectableTask.java:203)
at org.apache.nifi.controller.scheduling.TimerDrivenSchedulingAgent$1.run(TimerDrivenSchedulingAgent.java:117)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: java.net.ConnectException: Connection timed out: connect
at java.net.TwoStacksPlainSocketImpl.socketConnect(Native Method)
at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350)
at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206)
at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188)
at java.net.PlainSocketImpl.connect(PlainSocketImpl.java:172)
at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392)
at java.net.Socket.connect(Socket.java:589)
at okhttp3.internal.platform.Platform.connectSocket(Platform.java:124)
at okhttp3.internal.connection.RealConnection.connectSocket(RealConnection.java:223)
... 29 common frames omitted
... View more
Labels:
- Labels:
-
Apache NiFi
12-21-2017
10:59 AM
I have 1400 flowFile with same name and i want to enroll them into one file, i have read that i can use mergeContent processor for this purpose but when the amount of flowfile is more than 10000 it can't combine them in one file, what should i change to make this processor work properly? here is my configuration image example:
... View more
Labels:
- Labels:
-
Apache NiFi
11-22-2017
11:19 AM
I have more than 2000 flowFile with same name how can i configure mergeContent so that it could covert all this data in one file?
... View more
Labels:
- Labels:
-
Apache NiFi
11-09-2017
12:24 PM
I want to add xml tag ${filename} to xml response which i got from service how should i do it i mean i have made replace, end even delet operations in replaceText processor but how can i add something?
Should i use Replace Text processor i should do it with groovy code?(p.s i should add this tag inside details tag) here is my xml content: <?xml version="1.0" encoding="UTF-8"?>
<service>
<Person>
<details>
<start>2017-10-22</start>
<id>*******</id>
<makeVersion>1</makeVersion>
<patch>patch</patch>
<parameter>1</parameter>
</details>
</Person>
</service>
... View more
Labels:
- Labels:
-
Apache NiFi
10-30-2017
04:24 PM
thank you
... View more
10-30-2017
04:19 PM
At first thank you for your answer 😄 ,In this case how can i find amount of flowfile which contains "2011.*"? i need to find this value and check weather it is equal to my count attribute ( main problem is that i can't get exact number of flowfiles which match this regex "2011.*'
... View more
10-30-2017
12:02 PM
Can i use fetchHdfs without listhdfs( in front of it) or there are some logic implemented in fetchHdfs which make this process impossible in case we doesn't have list of filenames?
... View more
Labels:
- Labels:
-
Apache NiFi
10-30-2017
08:06 AM
I want to fetch files from hadoop directory based on their filename,logically it looks like this ${filename}.* (because i have several files with similar name they look like this 2011-01-01.1 , 2011-01-01.2 etc.) i tried to use listhdfs+fetchhdfs but they can't match my logic
Can you give me any batter idea how can i do it inside nifi environment? is it possible to make this task by groovy code inside ExecuteScript processor ? how can i connect hdfs directory by groovy code ? after getting this files i should put them in a flowfile list and can't transfer flowfiles untill flowfile list size hasn't matched the value of count attribute( placed in flowfile)
... View more
Labels:
- Labels:
-
Apache Hadoop
-
Apache NiFi