About iyappan

iyappan · ‎11-15-2016

Thanks @Rajkumar Singh Can you explain more on creating user

iyappan · ‎11-15-2016

Hi All, How to create Users in NIFI by default it has Administrator. Thanks Iyappan

iyappan · ‎08-08-2016

Thanks @hduraiswamy I made mistake on download itself now its working fine......Thanks once again...

iyappan · ‎08-06-2016

Hi @hduraiswamy Thanks for your replay My issue is how to start 0.7 nifi. I'm having HDF 0.6.0.1.2.0.1-1 version and downloaded from Hortonworks. If i need to start my Nifi is \bin\run-nifi.bat Here(0.7) not having same file structure of 0.6.0.1.2.0.1-1 Please explain briefly Thanks Iyappan

iyappan · ‎08-05-2016

HI @hduraiswamy, i need to know the steps involved in upgrading the HDF nifi(version 0.6.0.1.2.0.1-1) to to 0.7 version. My current version doesn't have 'SelectHiveQL' and 'PutHiveQL' processors. Pls share...it helps lot

iyappan · ‎08-02-2016

Thanks @Pierre Villard Still not able to receive next pages and can see some failure logs. can i share my template

iyappan · ‎08-02-2016

Thanks @Pierre Villard i changed 'next' as 'target' and connect to UpdateAttribute but not able to assign because already having target as direct Url. how to assign "EvaluateJsonPath" value "target' into UpdateAttribute .

iyappan · ‎08-02-2016

Hi @Pierre Villard I tried as u mentioned and able to get next page link but not able to give url of next page link into Update attribute i shared my flow image Update Attribute image Invoke Http properties EvaluateJsonPath properties my problem is how to connect this next page url into UpdateAttribute and make loop to get next all pages because i gave direct Url in UpdateAttribute property. i tried to change property name next as target and connect to UpdateAttribute but not able to assign because already having direct Url. Please Help me to solve this issue

iyappan · ‎07-22-2016

Dear All, I'm able to receive feeds from facebook using faceebook grap API on NiFi but the issue is need to get entire feeds in one shot like (next all pages ) it getting only one page . In facebook Grap Api itself having Next and Previous link at last few lines while clicking it goes next pages paging.png please help me to solve this Thanks in advance

iyappan · ‎07-22-2016

Thanks @Pierre Villard This works....

iyappan · ‎07-21-2016

Thanks @Pierre Villard How can i upgrade with existing version 0.6.0

iyappan · ‎07-21-2016

I have some Json files got from facebook and loaded into HDFS but i need to load it into hive tables. still i didn't find any processor to load hive tables if any please guide me Thanks in advance!

iyappan · ‎06-20-2016

I can able to receive the twitter files as Json format from my twitter account but i need to filter these files based on #tags (Ex, #fourseasondallas) stored in a separate directory Thanks

iyappan · ‎06-08-2016

now working... Thanks Iyappan

iyappan · ‎06-07-2016

Hi@Pierre Villard This (^.*\.(?!xls$|xlsx$)[^.]+$) operators is not working for me..it doesn't list any files. in my directory having two excel files and 1 .txt file and .xml file but it not list any....

iyappan · ‎06-07-2016

Thanks@ Pierre Villard I'm using Windows Nifi how to list files using time stamp... in File filter we the default as [^\.].* . we can change * as which ever file format but suppose i don't want .xls file. how can i apply not in [^\.].xls.

iyappan · ‎06-07-2016

Please explain how to get files based on time stamp? How to list a set of files not as (.xls and xlsx) files ie.other than .xls and .xlsx fiiles

iyappan · ‎06-02-2016

@Jitendra Yadav I am newer in scripting can u explain more about load data into Hive tables... Thanks once again..

iyappan · ‎06-02-2016

In my oozie scheduler having some configuration issue. i tried to solve the issue but still struggling. is there any alternate for oozie or another solution Thanks in advance!

iyappan · ‎06-02-2016

I have flow like get files from FTP to HDFS. 1.In Each process i need to store failure as log and store in a particular location 2.In Each process i need to store failure as log and mail to admin(mail id) Thanks In Advance

iyappan · ‎06-01-2016

When i am running the oozie with hive, it automatically suspended and shows the following error "JA006: Call From sandbox.hortonworks.com//ip-10-0-0-51to sandbox.hortonworks.com:10020 failed on connection exception: java.net.ConnectException: Connection refused; For more details see: http://wiki.apache.org/hadoop/ConnectionRefused" please help me to resolve this error.

iyappan · ‎05-31-2016

In have some problem in my server, so i am not able to get the log files. I will share u soon.

iyappan · ‎05-31-2016

I have created the external table in hive and created the script.hql file to load the data from hdfs to hive "LOAD DATA INPATH '/tmp/hive-input/test/nmg.csv' OVERWRITE INTO TABLE nmg;" Then created the workflow.xml file I have created the job.properties file in root like this nameNode=hdfs://sandbox.hortonworks.com:8020 jobTracker=http://ip-10-0-0-51:8050 queueName=default exampleRoot=example oozie.use.system.libpath=true oozie.libpath=/user/oozie/share/lib oozie.wf.application.path=${nameNode}/tmp/oozie-hive inputPath=${nameNode}/tmp/hive-input/test/* The file which i am loading to hive is store the following HDFS folder(/tmp/hive-input/test/nmg.csv) Then i am running the hive with oozie, oozie job -oozie http://ip-10-0-0-51:11000/oozie -config job.properties -run but i got error, please help me to resolve this error.

iyappan · ‎05-31-2016

its ipv4 and tried to put net.netfilter.nf_conntrack_tcp_timeout_time_wait = 30 and receive same "is an unknown key"

iyappan · ‎05-31-2016

i check firewall also but issue continuous remains same...

iyappan · ‎05-31-2016

it's http...

iyappan · ‎05-31-2016

i tried to change core-site.xml and hdfs-site.xml files sandbox.hortonworks.com:8020 to 192.168.1.158:8020 its working fine

iyappan · ‎05-31-2016

As you said earlier i download files core-site.xml,hdfs-site.xml from ambari placed in the windows machine and placed the path in "Hadoop Configuration Resources" and directory as "/tmp/dest/". it shows error like this

iyappan · ‎05-31-2016

how to check this?

iyappan · ‎05-31-2016

2016-05-31 12:23:02,353 ERROR [StandardProcessScheduler Thread-1] o.a.n.controller.StandardProcessorNode Failed to invoke @OnScheduled method due to java.lang.RuntimeException: Failed while executing one of processor's OnScheduled task. java.lang.RuntimeException: Failed while executing one of processor's OnScheduled task. at org.apache.nifi.controller.StandardProcessorNode.invokeTaskAsCancelableFuture(StandardProcessorNode.java:1405) ~[na:na] at org.apache.nifi.controller.StandardProcessorNode.access$100(StandardProcessorNode.java:89) ~[na:na] at org.apache.nifi.controller.StandardProcessorNode$1.run(StandardProcessorNode.java:1243) ~[na:na] at java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) [na:1.8.0_91] at java.util.concurrent.FutureTask.run(Unknown Source) [na:1.8.0_91] at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(Unknown Source) [na:1.8.0_91] at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) [na:1.8.0_91] at java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) [na:1.8.0_91] at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) [na:1.8.0_91] at java.lang.Thread.run(Unknown Source) [na:1.8.0_91] Caused by: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException at java.util.concurrent.FutureTask.report(Unknown Source) [na:1.8.0_91] at java.util.concurrent.FutureTask.get(Unknown Source) [na:1.8.0_91] at org.apache.nifi.controller.StandardProcessorNode.invokeTaskAsCancelableFuture(StandardProcessorNode.java:1388) ~[na:na] ... 9 common frames omitted Caused by: java.lang.reflect.InvocationTargetException: null at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[na:1.8.0_91] at sun.reflect.NativeMethodAccessorImpl.invoke(Unknown Source) ~[na:1.8.0_91] at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) ~[na:1.8.0_91] at java.lang.reflect.Method.invoke(Unknown Source) ~[na:1.8.0_91] at org.apache.nifi.util.ReflectionUtils.invokeMethodsWithAnnotations(ReflectionUtils.java:137) ~[na:na] at org.apache.nifi.util.ReflectionUtils.invokeMethodsWithAnnotations(ReflectionUtils.java:125) ~[na:na] at org.apache.nifi.util.ReflectionUtils.invokeMethodsWithAnnotations(ReflectionUtils.java:70) ~[na:na] at org.apache.nifi.controller.StandardProcessorNode$1$1.call(StandardProcessorNode.java:1247) ~[na:na] at org.apache.nifi.controller.StandardProcessorNode$1$1.call(StandardProcessorNode.java:1243) ~[na:na] ... 6 common frames omitted Caused by: java.nio.channels.UnresolvedAddressException: null at sun.nio.ch.Net.checkAddress(Unknown Source) ~[na:1.8.0_91] at sun.nio.ch.SocketChannelImpl.connect(Unknown Source) ~[na:1.8.0_91] at org.apache.hadoop.net.SocketIOWithTimeout.connect(SocketIOWithTimeout.java:192) ~[na:na] at org.apache.hadoop.net.NetUtils.connect(NetUtils.java:530) ~[na:na] at org.apache.hadoop.net.NetUtils.connect(NetUtils.java:494) ~[na:na] at org.apache.nifi.processors.hadoop.AbstractHadoopProcessor.checkHdfsUriForTimeout(AbstractHadoopProcessor.java:328) ~[na:na] at org.apache.nifi.processors.hadoop.AbstractHadoopProcessor.resetHDFSResources(AbstractHadoopProcessor.java:253) ~[na:na] at org.apache.nifi.processors.hadoop.AbstractHadoopProcessor.abstractOnScheduled(AbstractHadoopProcessor.java:196) ~[na:na] at org.apache.nifi.processors.hadoop.PutHDFS.onScheduled(PutHDFS.java:177) ~[na:na] ... 15 common frames omitted

Online	Offline
Last Visited	‎02-25-2017 07:21 PM

Date Registered	‎05-24-2016 06:24 AM
Last Visited	‎02-25-2017 07:21 PM
Total Messages Posted	52
Total Kudos Received	3

Re: Add user in NIFI 0.70

Add user in NIFI 0.70

Re: Unable to fetch data from hive table using Apa...

Re: Unable to fetch data from hive table using Apa...

Re: Unable to fetch data from hive table using Apa...

Re: How to get entire facebook feed on particular ...

Re: How to get entire facebook feed on particular ...

Re: How to get entire facebook feed on particular ...

How to get entire facebook feed on particular #tag...

Re: can we load data from hdfs to hive using NiFi?

Re: can we load data from hdfs to hive using NiFi?

can we load data from hdfs to hive using NiFi?

How to segericate the twitter json file based on #...

Re: how to get files based on the time stamp in Ni...

Re: how to get files based on the time stamp in Ni...

Re: how to get files based on the time stamp in Ni...

how to get files based on the time stamp in Nifi?

Re: Can we move csv file into hive tables with sch...

Can we move csv file into hive tables with schedul...

how to store failure as logs in a particular direc...

Re: Oozie Execution Error

Re: Oozie Execution Error

Oozie Execution Error

Re: Not able to access NiFi web UI

Re: Not able to access NiFi web UI

Re: Not able to access NiFi web UI

Re: problem with getFTP to putHDFS?

Re: problem with getFTP to putHDFS?

Re: problem with getFTP to putHDFS?

Re: problem with getFTP to putHDFS?