Cloudera Community
khanil
user rank
Explorer

Re: Is it possible to use S3 for Falcon feeds?

by Explorer in Support Questions
‎11-28-2017 09:19 AM
‎11-28-2017 09:19 AM
Hi Team / @Sowmya Ramesh, I am trying to use falcon to replicate HDFS to S3. I have tried above steps and I see the HDFStoS3 replication Job status KILLED after running the workflow. After launching Oozie, I can see the workflow changing status from RUNNING to KILLED. Is there a way to troubleshoot. I can run hadoop fs -ls commands on my s3 bucket so definitely got access. I suspect its the s3 URL. I tried downloading the xml changing the URL without the s3.region.amazonaws.com and uploading with no luck. Any other suggestions. Appreciate all your help/support in advance. Regards Anil ... View more

Re: Falcon Mirroring: HDFS To S3 AWS Credentials

by Explorer in Support Questions
‎11-28-2017 09:10 AM
‎11-28-2017 09:10 AM
Hi Team, I have tried above and I see the Job status KILLED after running the workflow. After launching Oozie, I can see the workflow changing status from RUNNING to KILLED. Is there a way to troubleshoot. I can run hadoop fs -ls commands on my s3 bucket so definitely got access. I suspect its the s3 URL. I tried downloading the xml changing the URL and uploading with no luck. Any other suggestions. Appreciate all your help/support in advance. Regards Anil ... View more

Re: How to resolve SSL error upon host registratio...

by Explorer in Support Questions
‎09-26-2017 03:29 AM
‎09-26-2017 03:29 AM
Hi, We have similar issue. After security update were applied, started getting nio:720 - javax.net.ssl.SSLException: Any solution? Appreciate any help/support in advance ... View more

Re: Pig install and configuration

by Explorer in Support Questions
‎08-08-2016 02:29 AM
‎08-08-2016 02:29 AM
Hi Sunile/SBandaru, I checked with pig -x local and got the grunt shell to LOAD, DUMP and all pig scripts work fine. I tried running pig today (without -x local) to connect to hdfs using hadoop conf, it throws following exception ERROR 2999: Unexpected internal error. Failed to create DataStorage and Server IPC version 9 cannot communicate with client version 4 Appreciate all your help/support in advance. Regards Anil Khiani ... View more

Re: Pig install and configuration

by Explorer in Support Questions
‎08-04-2016 11:54 AM
‎08-04-2016 11:54 AM
Thanks Sunile. It was indeed pig version. I installed Apache Pig version 0.9.2 (r1232772) and it got resolved. Cheers - Anil ... View more

Pig install and configuration

by Explorer in Support Questions
‎08-04-2016 02:32 AM
‎08-04-2016 02:32 AM
Hi Team, When I try to run pig to get to grunt shell, error I am getting is as follows: 16/08/04 02:33:40 INFO pig.ExecTypeProvider: Trying ExecType : LOCAL 16/08/04 02:33:40 INFO pig.ExecTypeProvider: Trying ExecType : MAPREDUCE 16/08/04 02:33:40 INFO pig.ExecTypeProvider: Picked MAPREDUCE as the ExecType 2016-08-04 02:33:40,231 [main] INFO org.apache.pig.Main - Apache Pig version 0.16.0 (r1746530) compiled Jun 01 2016, 23:10:49 2016-08-04 02:33:40,232 [main] INFO org.apache.pig.Main - Logging error messages to: /usr/local/hadoop/etc/hadoop/pig_1470278020218.log 2016-08-04 02:33:40,313 [main] INFO org.apache.pig.impl.util.Utils - Default bootup file /home/hadoop/.pigbootup not found 2016-08-04 02:33:40,829 [main] INFO org.apache.pig.backend.hadoop.executionengine.HExecutionEngine - Connecting to hadoop file system at: hdfs://172.31.24.167:8020 2016-08-04 02:33:41,072 [main] INFO org.apache.pig.Main - Pig script completed in 1 second and 283 milliseconds (1283 ms) Exception in thread "main" java.lang.IncompatibleClassChangeError: Implementing class at java.lang.ClassLoader.defineClass1(Native Method) at java.lang.ClassLoader.defineClass(ClassLoader.java:803) at java.security.SecureClassLoader.defineClass(SecureClassLoader.java:142) at java.net.URLClassLoader.defineClass(URLClassLoader.java:449) at java.net.URLClassLoader.access$100(URLClassLoader.java:71) at java.net.URLClassLoader$1.run(URLClassLoader.java:361) at java.net.URLClassLoader$1.run(URLClassLoader.java:355) at java.security.AccessController.doPrivileged(Native Method) at java.net.URLClassLoader.findClass(URLClassLoader.java:354) at java.lang.ClassLoader.loadClass(ClassLoader.java:425) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:308) at java.lang.ClassLoader.loadClass(ClassLoader.java:358) at org.apache.pig.tools.pigstats.PigStatsUtil.<clinit>(PigStatsUtil.java:73) at org.apache.pig.Main.run(Main.java:665) at org.apache.pig.Main.main(Main.java:176) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at org.apache.hadoop.util.RunJar.main(RunJar.java:156) My bashrc is as follows: export PIG_HOME=/usr/local/hadoop/pig export PATH=$PATH:$PIG_HOME/bin export PIG_CLASSPATH=/usr/local/hadoop/etc/Hadoop Environment: Ubuntu 14.04 pig-0.16.0 jps shows 3404 DataNode 5114 Jps 4569 ResourceManager 4719 NodeManager 3247 NameNode 3634 SecondaryNameNode Appreciate any pointers I am missing. Regards Anil Khiani ... View more
Labels:
Contact Me
Online
Offline
Last Visited
‎07-03-2018 08:15 AM
Community Statistics
Member Since ‎07-26-2016 08:12 AM
Last Visited ‎07-03-2018 08:15 AM
Posts 11