Member since
05-24-2016
52
Posts
3
Kudos Received
0
Solutions
11-15-2016
07:27 AM
Hi All, How to create Users in NIFI by default it has Administrator. Thanks Iyappan
... View more
Labels:
08-08-2016
04:43 AM
Thanks @hduraiswamy I made mistake on download itself now its working fine......Thanks once again...
... View more
08-06-2016
09:52 AM
Hi @hduraiswamy Thanks for your replay My issue is how to start 0.7 nifi. I'm having HDF 0.6.0.1.2.0.1-1 version and downloaded from Hortonworks. If i need to start my Nifi is \bin\run-nifi.bat Here(0.7) not having same file structure of 0.6.0.1.2.0.1-1 Please explain briefly Thanks Iyappan
... View more
08-05-2016
07:28 AM
1 Kudo
HI @hduraiswamy, i need to know the steps involved in upgrading the HDF nifi(version 0.6.0.1.2.0.1-1) to to 0.7 version. My current version doesn't have 'SelectHiveQL' and 'PutHiveQL' processors. Pls share...it helps lot
... View more
08-02-2016
09:37 AM
Thanks @Pierre Villard Still not able to receive next pages and can see some failure logs. can i share my template
... View more
08-02-2016
07:18 AM
Thanks @Pierre Villard i changed 'next' as 'target' and connect to
UpdateAttribute but not able to assign because already having target as direct
Url. how to assign "EvaluateJsonPath" value "target' into UpdateAttribute .
... View more
08-02-2016
05:36 AM
Hi @Pierre Villard I tried as u mentioned and able to get next page link but not able to give url of next page link into Update attribute i shared my flow image Update Attribute image Invoke Http properties EvaluateJsonPath properties
my problem is how to connect this next page url into UpdateAttribute and make loop to get next all pages because i gave direct Url in UpdateAttribute property. i tried to change property name next as target and connect to UpdateAttribute but not able to assign because already having direct Url. Please Help me to solve this issue
... View more
07-22-2016
05:31 AM
1 Kudo
Dear All, I'm able to receive feeds from facebook using faceebook grap API on NiFi but the issue is need to get entire feeds in one shot like (next all pages ) it getting only one page . In facebook Grap Api itself having Next and Previous link at last few lines while clicking it goes next pages paging.png please help me to solve this Thanks in advance
... View more
Labels:
07-22-2016
05:16 AM
Thanks @Pierre Villard This works....
... View more
07-21-2016
12:35 PM
Thanks @Pierre Villard How can i upgrade with existing version 0.6.0
... View more
07-21-2016
11:42 AM
I have some Json files got from facebook and loaded into HDFS but i need to load it into hive tables. still i didn't find any processor to load hive tables if any please guide me Thanks in advance!
... View more
Labels:
06-20-2016
10:45 AM
I can able to receive the twitter files as Json format from my twitter account but i need to filter these files based on #tags (Ex, #fourseasondallas) stored in a separate directory Thanks
... View more
Labels:
06-08-2016
06:44 AM
now working... Thanks Iyappan
... View more
06-07-2016
12:27 PM
Hi@Pierre Villard This (^.*\.(?!xls$|xlsx$)[^.]+$) operators is not working for me..it doesn't list any files. in my directory having two excel files and 1 .txt file and .xml file but it not list any....
... View more
06-07-2016
10:54 AM
Thanks@ Pierre Villard I'm using Windows Nifi how to list files using time stamp... in File filter we the default as [^\.].* . we can change * as which ever file format but suppose i don't want .xls file. how can i apply not in [^\.].xls.
... View more
06-07-2016
09:16 AM
Please explain how to get files based on time stamp? How to list a set of files not as (.xls and xlsx) files ie.other than .xls and .xlsx fiiles
... View more
Labels:
06-02-2016
11:37 AM
@Jitendra Yadav I am newer in scripting can u explain more about load data into Hive tables... Thanks once again..
... View more
06-02-2016
11:05 AM
In my oozie scheduler having some configuration issue. i tried to solve the issue but still struggling. is there any alternate for oozie or another solution Thanks in advance!
... View more
Labels:
06-02-2016
10:40 AM
I have flow like get files from FTP to HDFS. 1.In Each process i need to store failure as log and store in a particular location 2.In Each process i need to store failure as log and mail to admin(mail id) Thanks In Advance
... View more
Labels:
06-01-2016
03:40 AM
When i am running the oozie with hive, it automatically suspended and shows the following error "JA006: Call From sandbox.hortonworks.com//ip-10-0-0-51to sandbox.hortonworks.com:10020 failed on connection exception: java.net.ConnectException: Connection refused; For more details see: http://wiki.apache.org/hadoop/ConnectionRefused" please help me to resolve this error.
... View more
05-31-2016
01:36 PM
In have some problem in my server, so i am not able to get the log files. I will share u soon.
... View more
05-31-2016
01:15 PM
I have created the external table in hive and created the script.hql file to load the data from hdfs to hive "LOAD DATA
INPATH '/tmp/hive-input/test/nmg.csv' OVERWRITE INTO TABLE nmg;" Then created the workflow.xml file I have created the job.properties file in root like this nameNode=hdfs://sandbox.hortonworks.com:8020
jobTracker=http://ip-10-0-0-51:8050
queueName=default
exampleRoot=example
oozie.use.system.libpath=true
oozie.libpath=/user/oozie/share/lib
oozie.wf.application.path=${nameNode}/tmp/oozie-hive
inputPath=${nameNode}/tmp/hive-input/test/* The file which i am loading to hive is store the following HDFS folder(/tmp/hive-input/test/nmg.csv) Then i am running the hive with oozie, oozie job -oozie http://ip-10-0-0-51:11000/oozie -config job.properties -run but i got error, please help me to resolve this error.
... View more
Labels:
05-31-2016
09:31 AM
its ipv4 and tried to put net.netfilter.nf_conntrack_tcp_timeout_time_wait = 30 and receive same "is an unknown key"
... View more
05-31-2016
09:12 AM
i tried to change core-site.xml and hdfs-site.xml files sandbox.hortonworks.com:8020 to 192.168.1.158:8020 its working fine
... View more
05-31-2016
07:19 AM
As you said earlier i download files core-site.xml,hdfs-site.xml from ambari placed in the windows machine and placed the path in "Hadoop Configuration Resources" and directory as "/tmp/dest/". it shows error like this
... View more
05-31-2016
06:53 AM
2016-05-31 12:23:02,353 ERROR [StandardProcessScheduler Thread-1] o.a.n.controller.StandardProcessorNode Failed to invoke @OnScheduled method due to java.lang.RuntimeException: Failed while executing one of processor's OnScheduled task.
java.lang.RuntimeException: Failed while executing one of processor's OnScheduled task.
at org.apache.nifi.controller.StandardProcessorNode.invokeTaskAsCancelableFuture(StandardProcessorNode.java:1405) ~[na:na]
at org.apache.nifi.controller.StandardProcessorNode.access$100(StandardProcessorNode.java:89) ~[na:na]
at org.apache.nifi.controller.StandardProcessorNode$1.run(StandardProcessorNode.java:1243) ~[na:na]
at java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) [na:1.8.0_91]
at java.util.concurrent.FutureTask.run(Unknown Source) [na:1.8.0_91]
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(Unknown Source) [na:1.8.0_91]
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) [na:1.8.0_91]
at java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) [na:1.8.0_91]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) [na:1.8.0_91]
at java.lang.Thread.run(Unknown Source) [na:1.8.0_91]
Caused by: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException
at java.util.concurrent.FutureTask.report(Unknown Source) [na:1.8.0_91]
at java.util.concurrent.FutureTask.get(Unknown Source) [na:1.8.0_91]
at org.apache.nifi.controller.StandardProcessorNode.invokeTaskAsCancelableFuture(StandardProcessorNode.java:1388) ~[na:na]
... 9 common frames omitted
Caused by: java.lang.reflect.InvocationTargetException: null
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[na:1.8.0_91]
at sun.reflect.NativeMethodAccessorImpl.invoke(Unknown Source) ~[na:1.8.0_91]
at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) ~[na:1.8.0_91]
at java.lang.reflect.Method.invoke(Unknown Source) ~[na:1.8.0_91]
at org.apache.nifi.util.ReflectionUtils.invokeMethodsWithAnnotations(ReflectionUtils.java:137) ~[na:na]
at org.apache.nifi.util.ReflectionUtils.invokeMethodsWithAnnotations(ReflectionUtils.java:125) ~[na:na]
at org.apache.nifi.util.ReflectionUtils.invokeMethodsWithAnnotations(ReflectionUtils.java:70) ~[na:na]
at org.apache.nifi.controller.StandardProcessorNode$1$1.call(StandardProcessorNode.java:1247) ~[na:na]
at org.apache.nifi.controller.StandardProcessorNode$1$1.call(StandardProcessorNode.java:1243) ~[na:na]
... 6 common frames omitted
Caused by: java.nio.channels.UnresolvedAddressException: null
at sun.nio.ch.Net.checkAddress(Unknown Source) ~[na:1.8.0_91]
at sun.nio.ch.SocketChannelImpl.connect(Unknown Source) ~[na:1.8.0_91]
at org.apache.hadoop.net.SocketIOWithTimeout.connect(SocketIOWithTimeout.java:192) ~[na:na]
at org.apache.hadoop.net.NetUtils.connect(NetUtils.java:530) ~[na:na]
at org.apache.hadoop.net.NetUtils.connect(NetUtils.java:494) ~[na:na]
at org.apache.nifi.processors.hadoop.AbstractHadoopProcessor.checkHdfsUriForTimeout(AbstractHadoopProcessor.java:328) ~[na:na]
at org.apache.nifi.processors.hadoop.AbstractHadoopProcessor.resetHDFSResources(AbstractHadoopProcessor.java:253) ~[na:na]
at org.apache.nifi.processors.hadoop.AbstractHadoopProcessor.abstractOnScheduled(AbstractHadoopProcessor.java:196) ~[na:na]
at org.apache.nifi.processors.hadoop.PutHDFS.onScheduled(PutHDFS.java:177) ~[na:na]
... 15 common frames omitted
... View more