Announcements
Check out our newest addition to the community, the Cloudera Data Analytics (CDA) group hub.
shashang_sheth
Explorer
My Accepted Solutions
Show All

Re: Issue with Sqoop metastore

by Explorer in Support Questions
‎02-23-2017 03:55 PM
‎02-23-2017 03:55 PM
We decided to go with HSsqldb as our vendor wouldn't support sqoop metastore + mysql. Thanks, Sindhu for providing your inputs. ... View more

Re: Issue with Sqoop metastore

by Explorer in Support Questions
‎02-15-2017 06:58 PM
‎02-15-2017 06:58 PM
@Sindhu, After removing sqoop-site.xml, the oozie job is now complaining on the contrary: 2017-02-15 12:51:05,420 WARN ActionStartXCommand:523 - SERVER[tlccmrhdd01.r1-core.r1.aig.net] USER[u1453711] GROUP[-] TOKEN[] APP[MDMRDM-RDM-tables] JOB[0000000-170215081728307-oozie-oozi-W] ACTION[0000000-170215081728307-oozie-oozi-W@Sqoop-exec-rdm-jobs] Error starting action [Sqoop-exec-rdm-jobs]. ErrorType [ERROR], ErrorCode [JA008], Message [JA008: File does not exist: hdfs://sandbox-gfat/user/oozie/share/lib/lib_20170119183643/sqoop/sqoop-site.xml#sqoop-site.xml] org.apache.oozie.action.ActionExecutorException: JA008: File does not exist: hdfs://sandbox-gfat/user/oozie/share/lib/lib_20170119183643/sqoop/sqoop-site.xml#sqoop-site.xml at org.apache.oozie.action.ActionExecutor.convertExceptionHelper(ActionExecutor.java:457) at org.apache.oozie.action.ActionExecutor.convertException(ActionExecutor.java:441) at org.apache.oozie.action.hadoop.JavaActionExecutor.submitLauncher(JavaActionExecutor.java:1202) at org.apache.oozie.action.hadoop.JavaActionExecutor.start(JavaActionExecutor.java:1373) at org.apache.oozie.command.wf.ActionStartXCommand.execute(ActionStartXCommand.java:232) at org.apache.oozie.command.wf.ActionStartXCommand.execute(ActionStartXCommand.java:63) at org.apache.oozie.command.XCommand.call(XCommand.java:287) at org.apache.oozie.service.CallableQueueService$CompositeCallable.call(CallableQueueService.java:331) at org.apache.oozie.service.CallableQueueService$CompositeCallable.call(CallableQueueService.java:260) at java.util.concurrent.FutureTask.run(FutureTask.java:262) at org.apache.oozie.service.CallableQueueService$CallableWrapper.run(CallableQueueService.java:178) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:744) ... View more

Issue with Sqoop metastore

by Explorer in Support Questions
‎02-15-2017 06:24 PM
‎02-15-2017 06:24 PM
Hello All, I have enabled Sqoop Metastore using MYSQL as the backend database using the instructions in this link. However, my oozie job is running into below error: Failing Oozie Launcher, Main class [org.apache.oozie.action.hadoop.SqoopMain], main() threw exception, sqoop-site.xml (Permission denied) java.io.FileNotFoundException: sqoop-site.xml (Permission denied) at java.io.FileOutputStream.open(Native Method) at java.io.FileOutputStream.<init>(FileOutputStream.java:221) at java.io.FileOutputStream.<init>(FileOutputStream.java:110) at org.apache.oozie.action.hadoop.SqoopMain.setUpSqoopSite(SqoopMain.java:86) at org.apache.oozie.action.hadoop.SqoopMain.run(SqoopMain.java:160) at org.apache.oozie.action.hadoop.LauncherMain.run(LauncherMain.java:51) at org.apache.oozie.action.hadoop.SqoopMain.main(SqoopMain.java:48) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at org.apache.oozie.action.hadoop.LauncherMapper.map(LauncherMapper.java:242) at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:54) at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:453) at org.apache.hadoop.mapred.MapTask.run(MapTask.java:343) at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:168) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:415) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1724) at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:162) I have uploaded sqoop-site.xml in hdfs location - /user/oozie/share/lib/lib_20170119183643/sqoop/sqoop-site.xml and also restarted oozie server. Find the oozie job log and sqoop-site.xml attached. Please help me to understand what location is it trying to look for sqoop-site.xml. Thanks in advance. Shashang Sheth ooziejoblog.txt sqoop-site.xml ... View more
Labels:

Re: changing metastore in sqoop

by Explorer in Support Questions
‎02-13-2017 07:37 PM
‎02-13-2017 07:37 PM
@ Simran Kaur, Can you re post the link to setting MYSQL as metastore for Sqoop. The above link is broken. ... View more

Re: Table not found in Hive Action

by Explorer in Support Questions
‎01-09-2017 06:23 AM
‎01-09-2017 06:23 AM
@Sonny Heer When I do hive -e 'describe formatted ocods_temp.umoney_provision_allocation_details_xpose', it returns me the attached error. But if I do hive -e "use ocods_temp; describe formatted umoney_provision_allocation_details_xpose" , the command provides the required information. This concludes that there is not issue with the table as such.hive-error.txt ... View more

Re: Table not found in Hive Action

by Explorer in Support Questions
‎01-06-2017 05:46 PM
‎01-06-2017 05:46 PM
@mbalakrishnan, Can you explain why does your solution work? I had run into a similar problem and the above solution worked with my issue so I am curious to know the reason behind the same. Regards, Shashang Sheth ... View more

Re: Kafka producer giving error when running from ...

by Explorer in Support Questions
‎06-20-2016 06:07 PM
‎06-20-2016 06:07 PM
Issue resolved. The kafka broker service was running on internal ip address of the server whereas the systems initiating the producer process was trying to connect to the external ip address of the Kafka Broker server. Restarted Kafka Broker service after modifying the "listener" property with the correct ip address. ... View more

Re: Kafka producer giving error when running from ...

by Explorer in Support Questions
‎06-20-2016 10:12 AM
‎06-20-2016 10:12 AM
@Kuldeep, I wasn't able to find this property in Ambari. Can you tell me where can I find it? ... View more
Contact Me
Online
Offline
Last Visited
‎09-26-2018 12:31 PM
Public Statistics
Date Registered ‎01-27-2016 07:07 AM
Last Visited ‎09-26-2018 12:31 PM
Total Messages Posted 16