Member since
03-14-2017
20
Posts
1
Kudos Received
0
Solutions
07-05-2017
12:21 PM
2017-07-04 13:10:15,329 ERROR [StandardProcessScheduler Thread-1] o.a.n.controller.StandardProcessorNode Failed to invoke @OnScheduled method due to java.lang.RuntimeException: Failed while executing one of processor's OnScheduled task.
java.lang.RuntimeException: Failed while executing one of processor's OnScheduled task.
at org.apache.nifi.controller.StandardProcessorNode.invokeTaskAsCancelableFuture(StandardProcessorNode.java:1482)
at org.apache.nifi.controller.StandardProcessorNode.access$000(StandardProcessorNode.java:102)
at org.apache.nifi.controller.StandardProcessorNode$1.run(StandardProcessorNode.java:1303)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException
at java.util.concurrent.FutureTask.report(FutureTask.java:122)
at java.util.concurrent.FutureTask.get(FutureTask.java:206)
at org.apache.nifi.controller.StandardProcessorNode.invokeTaskAsCancelableFuture(StandardProcessorNode.java:1465)
... 9 common frames omitted
Caused by: java.lang.reflect.InvocationTargetException: null
at sun.reflect.GeneratedMethodAccessor498.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.apache.nifi.util.ReflectionUtils.invokeMethodsWithAnnotations(ReflectionUtils.java:137)
at org.apache.nifi.util.ReflectionUtils.invokeMethodsWithAnnotations(ReflectionUtils.java:125)
at org.apache.nifi.util.ReflectionUtils.invokeMethodsWithAnnotations(ReflectionUtils.java:70)
at org.apache.nifi.util.ReflectionUtils.invokeMethodsWithAnnotation(ReflectionUtils.java:47)
at org.apache.nifi.controller.StandardProcessorNode$1$1.call(StandardProcessorNode.java:1307)
at org.apache.nifi.controller.StandardProcessorNode$1$1.call(StandardProcessorNode.java:1303)
... 6 common frames omitted
Caused by: java.io.IOException: Failed to properly migrate state to State Manager
at org.apache.nifi.processor.util.list.AbstractListProcessor.updateState(AbstractListProcessor.java:206)
... 15 common frames omitted
Caused by: java.net.ConnectException: Connection refused
at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:717)
at sun.nio.ch.SocketAdaptor.connect(SocketAdaptor.java:111)
at org.apache.nifi.distributed.cache.client.StandardCommsSession.<init>(StandardCommsSession.java:52)
at org.apache.nifi.distributed.cache.client.DistributedMapCacheClientService.createCommsSession(DistributedMapCacheClientService.java:306)
at org.apache.nifi.distributed.cache.client.DistributedMapCacheClientService.leaseCommsSession(DistributedMapCacheClientService.java:321)
at org.apache.nifi.distributed.cache.client.DistributedMapCacheClientService.withCommsSession(DistributedMapCacheClientService.java:376)
at org.apache.nifi.distributed.cache.client.DistributedMapCacheClientService.get(DistributedMapCacheClientService.java:190)
at sun.reflect.GeneratedMethodAccessor499.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.apache.nifi.controller.service.StandardControllerServiceInvocationHandler.invoke(StandardControllerServiceInvocationHandler.java:89)
at com.sun.proxy.$Proxy114.get(Unknown Source)
at org.apache.nifi.processor.util.list.AbstractListProcessor.migrateState(AbstractListProcessor.java:239)
at org.apache.nifi.processor.util.list.AbstractListProcessor.updateState(AbstractListProcessor.java:204)
... 15 common frames omitted
... View more
Labels:
- Labels:
-
Apache NiFi
06-14-2017
07:27 AM
Also I can't stop processor... "do you see a number (usually 1 or 2) at the right top corner of the processor keeps being shown?" - yes, I see number)
... View more
06-14-2017
07:24 AM
ListFTP-processor gives us list of files from remote srver and then FetchFTP returns "Read timed out" error
... View more
06-14-2017
07:22 AM
Nifi node can access to FTP server port. Telnet, ftp-command line..... all ok....
... View more
06-13-2017
08:19 AM
Hi, bootstrap.txt and screen are in attach bootstrap.txt Also I have new errors 2017-06-13 11:24:20,604 ERROR [Timer-Driven Process Thread-34] o.a.nifi.processors.standard.FetchFTP
FetchFTP[id=0b272963-015c-1000-b879-09a07fe75263] Failed to fetch content for StandardFlowFileRecord[uuid=f24fe72d-496b-4f07-9f6e-88368c9b59de,claim=StandardContentClaim
[resourceClaim=StandardResourceClaim[id=1497338630546-1,
container=default, section=1], offset=0, length=1022734],offset=0,name=TIAGPRSVMPT063246,size=1022734] from filename /edb4tel/data/DMP/TIAGPRSVMPT063246 on remote host
172.30.129.1:21 due to java.net.SocketTimeoutException: Read timed out; routing to failure: java.net.SocketTimeoutException: Read timed out
2017-06-13 11:24:20,605 ERROR [Timer-Driven Process Thread-34] o.a.nifi.processors.standard.FetchFTP
java.net.SocketTimeoutException: Read timed out
at java.net.SocketInputStream.socketRead0(Native Method) ~[na:1.8.0_77]
at
java.net.SocketInputStream.socketRead(SocketInputStream.java:116)
~[na:1.8.0_77]
at java.net.SocketInputStream.read(SocketInputStream.java:170)
~[na:1.8.0_77]
at java.net.SocketInputStream.read(SocketInputStream.java:141)
~[na:1.8.0_77]
at sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284)
~[na:1.8.0_77]
at sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326)
~[na:1.8.0_77]
at sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178)
~[na:1.8.0_77]
at java.io.InputStreamReader.read(InputStreamReader.java:184)
~[na:1.8.0_77]
at java.io.BufferedReader.fill(BufferedReader.java:161)
~[na:1.8.0_77]
at java.io.BufferedReader.read(BufferedReader.java:182)
~[na:1.8.0_77]
at
org.apache.commons.net.io.CRLFLineReader.readLine(CRLFLineReader.java:58)
~[commons-net-3.3.jar:3.3]
at org.apache.commons.net.ftp.FTP.__getReply(FTP.java:314)
~[commons-net-3.3.jar:3.3]
at org.apache.commons.net.ftp.FTP.__getReply(FTP.java:294)
~[commons-net-3.3.jar:3.3]
at org.apache.commons.net.ftp.FTP.sendCommand(FTP.java:483)
~[commons-net-3.3.jar:3.3]
at org.apache.commons.net.ftp.FTP.sendCommand(FTP.java:608)
~[commons-net-3.3.jar:3.3]
at org.apache.commons.net.ftp.FTP.cwd(FTP.java:828)
~[commons-net-3.3.jar:3.3]
at
org.apache.commons.net.ftp.FTPClient.changeWorkingDirectory(FTPClient.java:1128)
~[commons-net-3.3.jar:3.3]
at
org.apache.nifi.processors.standard.util.FTPTransfer.resetWorkingDirectory(FTPTransfer.java:360)
~[nifi-standard-processors-1.1.0.2.1.2.0-10.jar:1.1.0.2.1.2.0-10]
at
org.apache.nifi.processors.standard.util.FTPTransfer.getClient(FTPTransfer.java:494)
~[nifi-standard-processors-1.1.0.2.1.2.0-10.jar:1.1.0.2.1.2.0-10]
at
org.apache.nifi.processors.standard.util.FTPTransfer.flush(FTPTransfer.java:292)
~[nifi-standard-processors-1.1.0.2.1.2.0-10.jar:1.1.0.2.1.2.0-10]
at
org.apache.nifi.processors.standard.FetchFileTransfer.onTrigger(FetchFileTransfer.java:244)
~[nifi-standard-processors-1.1.0.2.1.2.0-10.jar:1.1.0.2.1.2.0-10]
at
org.apache.nifi.processor.AbstractProcessor.onTrigger(AbstractProcessor.java:27)
[nifi-api-1.1.0.2.1.2.0-10.jar:1.1.0.2.1.2.0-10]
at
org.apache.nifi.controller.StandardProcessorNode.onTrigger(StandardProcessorNode.java:1099)
[nifi-framework-core-1.1.0.2.1.2.0-10.jar:1.1.0.2.1.2.0-10]
at
org.apache.nifi.controller.tasks.ContinuallyRunProcessorTask.call(ContinuallyRunProcessorTask.java:136)
[nifi-framework-core-1.1.0.2.1.2.0-10.jar:1.1.0.2.1.2.0-10]
at
org.apache.nifi.controller.tasks.ContinuallyRunProcessorTask.call(ContinuallyRunProcessorTask.java:47)
[nifi-framework-core-1.1.0.2.1.2.0-10.jar:1.1.0.2.1.2.0-10]
at
org.apache.nifi.controller.scheduling.TimerDrivenSchedulingAgent$1.run(TimerDrivenSchedulingAgent.java:132)
[nifi-framework-core-1.1.0.2.1.2.0-10.jar:1.1.0.2.1.2.0-10]
at
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
[na:1.8.0_77]
at
java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)
[na:1.8.0_77]
at
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
[na:1.8.0_77]
at
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
[na:1.8.0_77]
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
[na:1.8.0_77]
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
[na:1.8.0_77]
at java.lang.Thread.run(Thread.java:745) [na:1.8.0_77]
2017-06-13 11:24:20,646 ERROR [Timer-Driven Process Thread-5] o.a.nifi.processors.standard.FetchFTP
FetchFTP[id=0b272963-015c-1000-b879-09a07fe75263] Failed to fetch content for StandardFlowFileRecord[uuid=eeb860a8-b3fb-4c9c-804c-a4560aed1d4e,claim=StandardContentClaim
[resourceClaim=StandardResourceClaim[id=1497338630570-3,
container=default, section=3], offset=0, length=2097717],offset=0,name=TIAGPRSVMPT063245,size=2097717] from filename /edb4tel/data/DMP/TIAGPRSVMPT063245 on remote host
172.30.129.1:21 due to java.net.SocketTimeoutException: Read timed out; routing to failure: java.net.SocketTimeoutException: Read timed out
2017-06-13 11:24:20,647 ERROR
... View more
06-12-2017
12:57 PM
2017-06-12 16:53:25,034 WARN [main]
org.apache.hadoop.util.NativeCodeLoader Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
2017-06-12 16:53:33,172 WARN [StandardProcessScheduler Thread-1] org.apache.hadoop.util.NativeCodeLoader Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
... View more
06-12-2017
11:38 AM
ftp/sftp processors don't work.... also i can't stop them without restrarting NIFI app. thats what i see in app.log 2017-06-12 13:37:42,892 INFO [StandardProcessScheduler Thread-7] o.a.n.c.s.TimerDrivenSchedulingAgent Scheduled ListFTP[id=0b26dd50-015c-1000-ab83-c3df49136530] to run with 1 threads 2017-06-12 13:47:20,337 INFO [NiFi Web Server-18214] o.a.n.controller.StandardProcessorNode Stopping processor: class org.apache.nifi.processors.standard.ListFTP 2017-06-12 13:47:20,337 INFO [StandardProcessScheduler Thread-6] o.a.n.c.s.TimerDrivenSchedulingAgent Stopped scheduling ListFTP[id=0b26dd50-015c-1000-ab83-c3df49136530] to run 2017-06-12 13:50:46,761 WARN [StandardProcessScheduler Thread-3] o.a.n.controller.StandardProcessorNode Failed while shutting down processor ListFTP[id=0b26dd50-015c-1000-ab83-c3df49136530] 2017-06-12 13:50:46,762 WARN [StandardProcessScheduler Thread-4] o.a.n.controller.StandardProcessorNode Failed while shutting down processor ListSFTP[id=196c3fff-9d59-1fed-9902-5daf3757977f] 2017-06-12 13:50:46,762 WARN [StandardProcessScheduler Thread-8] o.a.n.controller.StandardProcessorNode Failed while shutting down processor ListFTP[id=0b26dd50-015c-1000-0000-000003bb95df] 2017-06-12 13:50:46,762 WARN [StandardProcessScheduler Thread-2] o.a.n.controller.StandardProcessorNode Failed while shutting down processor ListSFTP[id=196c3fff-9d59-1fed-8d2d-adbbcbd1c699] 2017-06-12 13:50:46,803 ERROR [Timer-Driven Process Thread-17] o.a.nifi.processors.standard.ListFTP ListFTP[id=0b26dd50-015c-1000-ab83-c3df49136530] ListFTP[id=0b26dd50-015c-1000-ab83-c3df49136530] failed to process due to java.lang.IllegalStateException: Partition is closed; rolling back session: java.lang.IllegalStateException: Partition is closed 2017-06-12 13:50:46,812 ERROR [Timer-Driven Process Thread-17] o.a.nifi.processors.standard.ListFTP 2017-06-12 13:50:46,813 ERROR [Timer-Driven Process Thread-17] o.a.nifi.processors.standard.ListFTP ListFTP[id=0b26dd50-015c-1000-ab83-c3df49136530] ListFTP[id=0b26dd50-015c-1000-ab83-c3df49136530] failed to process session due to java.lang.IllegalStateException: Partition is closed: java.lang.IllegalStateException: Partition is closed 2017-06-12 13:50:46,814 ERROR [Timer-Driven Process Thread-17] o.a.nifi.processors.standard.ListFTP 2017-06-12 13:50:46,814 WARN [Timer-Driven Process Thread-17] o.a.nifi.processors.standard.ListFTP ListFTP[id=0b26dd50-015c-1000-ab83-c3df49136530] Processor Administratively Yielded for 1 sec due to processing failure 2017-06-12 13:50:46,814 WARN [Timer-Driven Process Thread-17] o.a.n.c.t.ContinuallyRunProcessorTask Administratively Yielding ListFTP[id=0b26dd50-015c-1000-ab83-c3df49136530] due to uncaught Exception: java.lang.IllegalStateException: Partition is closed org.apache.nifi.processors.standard.GetSFTP || org.apache.nifi.nar.NarClassLoader[/nifi/work/nar/extensions/nifi-standard-nar-1.1.0.2.1.2.0-10.nar-unpacked] org.apache.nifi.processors.standard.FetchFTP || org.apache.nifi.nar.NarClassLoader[/nifi/work/nar/extensions/nifi-standard-nar-1.1.0.2.1.2.0-10.nar-unpacked] org.apache.nifi.processors.standard.PutFTP || org.apache.nifi.nar.NarClassLoader[/nifi/work/nar/extensions/nifi-standard-nar-1.1.0.2.1.2.0-10.nar-unpacked] org.apache.nifi.processors.standard.PutSFTP || org.apache.nifi.nar.NarClassLoader[/nifi/work/nar/extensions/nifi-standard-nar-1.1.0.2.1.2.0-10.nar-unpacked] org.apache.nifi.processors.standard.ListFTP || org.apache.nifi.nar.NarClassLoader[/nifi/work/nar/extensions/nifi-standard-nar-1.1.0.2.1.2.0-10.nar-unpacked] org.apache.nifi.processors.standard.FetchSFTP || org.apache.nifi.nar.NarClassLoader[/nifi/work/nar/extensions/nifi-standard-nar-1.1.0.2.1.2.0-10.nar-unpacked] org.apache.nifi.processors.standard.GetFTP || org.apache.nifi.nar.NarClassLoader[/nifi/work/nar/extensions/nifi-standard-nar-1.1.0.2.1.2.0-10.nar-unpacked] org.apache.nifi.processors.standard.ListSFTP || org.apache.nifi.nar.NarClassLoader[/nifi/work/nar/extensions/nifi-standard-nar-1.1.0.2.1.2.0-10.nar-unpacked] 2017-06-12 13:53:46,940 INFO [StandardProcessScheduler Thread-8] o.a.n.c.s.TimerDrivenSchedulingAgent Scheduled ListFTP[id=0b26dd50-015c-1000-ab83-c3df49136530] to run with 1 threads 2017-06-12 13:53:51,155 INFO [NiFi Web Server-50] o.a.n.controller.StandardProcessorNode Stopping processor: class org.apache.nifi.processors.standard.ListFTP 2017-06-12 13:53:51,158 INFO [StandardProcessScheduler Thread-2] o.a.n.c.s.TimerDrivenSchedulingAgent Stopped scheduling ListFTP[id=0b26dd50-015c-1000-ab83-c3df49136530] to run
... View more
Labels:
- Labels:
-
Apache NiFi
06-02-2017
09:12 AM
Any other ERROR or WARN log messages? - No ---------- Is this a standalone NiFi installation or a multi-node NiFi cluster? - Cluster - If cluster, are all these FlowFiles queued on just one node? - if i try to do "list queue" i get : "The queue has no FlowFiles." So i don't know from wich node ar those flow files..... ----- http
... View more
06-01-2017
12:27 PM
there is no Out Of Memory (OOM) errors. also we don't see any problems with disk space....
... View more