Member since
05-24-2016
52
Posts
3
Kudos Received
0
Solutions
11-15-2016
07:27 AM
Hi All, How to create Users in NIFI by default it has Administrator. Thanks Iyappan
... View more
Labels:
- Labels:
-
Apache NiFi
08-08-2016
04:43 AM
Thanks @hduraiswamy I made mistake on download itself now its working fine......Thanks once again...
... View more
08-06-2016
09:52 AM
Hi @hduraiswamy Thanks for your replay My issue is how to start 0.7 nifi. I'm having HDF 0.6.0.1.2.0.1-1 version and downloaded from Hortonworks. If i need to start my Nifi is \bin\run-nifi.bat Here(0.7) not having same file structure of 0.6.0.1.2.0.1-1 Please explain briefly Thanks Iyappan
... View more
08-05-2016
07:28 AM
1 Kudo
HI @hduraiswamy, i need to know the steps involved in upgrading the HDF nifi(version 0.6.0.1.2.0.1-1) to to 0.7 version. My current version doesn't have 'SelectHiveQL' and 'PutHiveQL' processors. Pls share...it helps lot
... View more
07-22-2016
05:16 AM
Thanks @Pierre Villard This works....
... View more
07-21-2016
12:35 PM
Thanks @Pierre Villard How can i upgrade with existing version 0.6.0
... View more
07-21-2016
11:42 AM
I have some Json files got from facebook and loaded into HDFS but i need to load it into hive tables. still i didn't find any processor to load hive tables if any please guide me Thanks in advance!
... View more
Labels:
- Labels:
-
Apache NiFi
06-20-2016
10:45 AM
I can able to receive the twitter files as Json format from my twitter account but i need to filter these files based on #tags (Ex, #fourseasondallas) stored in a separate directory Thanks
... View more
Labels:
- Labels:
-
Apache NiFi
06-08-2016
06:44 AM
now working... Thanks Iyappan
... View more
06-07-2016
12:27 PM
Hi@Pierre Villard This (^.*\.(?!xls$|xlsx$)[^.]+$) operators is not working for me..it doesn't list any files. in my directory having two excel files and 1 .txt file and .xml file but it not list any....
... View more
06-07-2016
10:54 AM
Thanks@ Pierre Villard I'm using Windows Nifi how to list files using time stamp... in File filter we the default as [^\.].* . we can change * as which ever file format but suppose i don't want .xls file. how can i apply not in [^\.].xls.
... View more
06-07-2016
09:16 AM
Please explain how to get files based on time stamp? How to list a set of files not as (.xls and xlsx) files ie.other than .xls and .xlsx fiiles
... View more
Labels:
- Labels:
-
Apache NiFi
06-02-2016
11:37 AM
@Jitendra Yadav I am newer in scripting can u explain more about load data into Hive tables... Thanks once again..
... View more
06-02-2016
11:05 AM
In my oozie scheduler having some configuration issue. i tried to solve the issue but still struggling. is there any alternate for oozie or another solution Thanks in advance!
... View more
Labels:
- Labels:
-
Apache Hive
-
Apache Oozie
06-02-2016
10:40 AM
I have flow like get files from FTP to HDFS. 1.In Each process i need to store failure as log and store in a particular location 2.In Each process i need to store failure as log and mail to admin(mail id) Thanks In Advance
... View more
Labels:
- Labels:
-
Apache NiFi
05-31-2016
09:31 AM
its ipv4 and tried to put net.netfilter.nf_conntrack_tcp_timeout_time_wait = 30 and receive same "is an unknown key"
... View more
05-31-2016
09:12 AM
i tried to change core-site.xml and hdfs-site.xml files sandbox.hortonworks.com:8020 to 192.168.1.158:8020 its working fine
... View more
05-31-2016
07:19 AM
As you said earlier i download files core-site.xml,hdfs-site.xml from ambari placed in the windows machine and placed the path in "Hadoop Configuration Resources" and directory as "/tmp/dest/". it shows error like this
... View more
05-31-2016
06:53 AM
2016-05-31 12:23:02,353 ERROR [StandardProcessScheduler Thread-1] o.a.n.controller.StandardProcessorNode Failed to invoke @OnScheduled method due to java.lang.RuntimeException: Failed while executing one of processor's OnScheduled task.
java.lang.RuntimeException: Failed while executing one of processor's OnScheduled task.
at org.apache.nifi.controller.StandardProcessorNode.invokeTaskAsCancelableFuture(StandardProcessorNode.java:1405) ~[na:na]
at org.apache.nifi.controller.StandardProcessorNode.access$100(StandardProcessorNode.java:89) ~[na:na]
at org.apache.nifi.controller.StandardProcessorNode$1.run(StandardProcessorNode.java:1243) ~[na:na]
at java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) [na:1.8.0_91]
at java.util.concurrent.FutureTask.run(Unknown Source) [na:1.8.0_91]
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(Unknown Source) [na:1.8.0_91]
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) [na:1.8.0_91]
at java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) [na:1.8.0_91]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) [na:1.8.0_91]
at java.lang.Thread.run(Unknown Source) [na:1.8.0_91]
Caused by: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException
at java.util.concurrent.FutureTask.report(Unknown Source) [na:1.8.0_91]
at java.util.concurrent.FutureTask.get(Unknown Source) [na:1.8.0_91]
at org.apache.nifi.controller.StandardProcessorNode.invokeTaskAsCancelableFuture(StandardProcessorNode.java:1388) ~[na:na]
... 9 common frames omitted
Caused by: java.lang.reflect.InvocationTargetException: null
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[na:1.8.0_91]
at sun.reflect.NativeMethodAccessorImpl.invoke(Unknown Source) ~[na:1.8.0_91]
at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) ~[na:1.8.0_91]
at java.lang.reflect.Method.invoke(Unknown Source) ~[na:1.8.0_91]
at org.apache.nifi.util.ReflectionUtils.invokeMethodsWithAnnotations(ReflectionUtils.java:137) ~[na:na]
at org.apache.nifi.util.ReflectionUtils.invokeMethodsWithAnnotations(ReflectionUtils.java:125) ~[na:na]
at org.apache.nifi.util.ReflectionUtils.invokeMethodsWithAnnotations(ReflectionUtils.java:70) ~[na:na]
at org.apache.nifi.controller.StandardProcessorNode$1$1.call(StandardProcessorNode.java:1247) ~[na:na]
at org.apache.nifi.controller.StandardProcessorNode$1$1.call(StandardProcessorNode.java:1243) ~[na:na]
... 6 common frames omitted
Caused by: java.nio.channels.UnresolvedAddressException: null
at sun.nio.ch.Net.checkAddress(Unknown Source) ~[na:1.8.0_91]
at sun.nio.ch.SocketChannelImpl.connect(Unknown Source) ~[na:1.8.0_91]
at org.apache.hadoop.net.SocketIOWithTimeout.connect(SocketIOWithTimeout.java:192) ~[na:na]
at org.apache.hadoop.net.NetUtils.connect(NetUtils.java:530) ~[na:na]
at org.apache.hadoop.net.NetUtils.connect(NetUtils.java:494) ~[na:na]
at org.apache.nifi.processors.hadoop.AbstractHadoopProcessor.checkHdfsUriForTimeout(AbstractHadoopProcessor.java:328) ~[na:na]
at org.apache.nifi.processors.hadoop.AbstractHadoopProcessor.resetHDFSResources(AbstractHadoopProcessor.java:253) ~[na:na]
at org.apache.nifi.processors.hadoop.AbstractHadoopProcessor.abstractOnScheduled(AbstractHadoopProcessor.java:196) ~[na:na]
at org.apache.nifi.processors.hadoop.PutHDFS.onScheduled(PutHDFS.java:177) ~[na:na]
... 15 common frames omitted
... View more
05-31-2016
04:24 AM
I have enclosed a copy of the flow, which shows the error. Can anyone help me out for this.
... View more
05-31-2016
04:04 AM
i try to move files from FTP directory to HDFS but shows error in image issue. i'm using windows nifi so in core-sit.xml and hdfs-site.xml are stored in to the local windows machine and directly give target directory as /tmp/target in HDFS The files are queued from FTP and shows error in HDFS Thanks in advance
... View more
Labels:
- Labels:
-
Apache NiFi
05-28-2016
01:22 PM
I have done all but except Set how long sockets stay in a TIMED_WAIT state when closed Because it shows Error: error: "net.ipv4.netfilter.ip_conntrack_tcp_timeout_time_wait" is an unknown key
... View more
05-28-2016
12:04 PM
Yes, disabled - SELinux is fully disabled.
SELINUX=disabled it fully disabled
... View more
05-28-2016
11:58 AM
Thanks@Jitendra Yadav Selinux is already disabled but i got the error still
Jitendra Yadadisabled - SELinux is fully disabled.
SELINUX=disabled
... View more
05-28-2016
11:51 AM
Thanks @Geff i tried but Still facing same issue
I tried but still facing same issue
... View more
05-28-2016
11:28 AM
And Again i rerun it shows: 2016-05-28 11:23:57,677 INFO [main] org.apache.nifi.bootstrap.Command Apache NiFi is currently running, listening to Bootstrap on port 39794, PID=22080 But still i am facing issue like "Unable to connect" or "Unable to connect" please help me to solve
... View more