Member since
01-27-2016
16
Posts
0
Kudos Received
1
Solution
My Accepted Solutions
Title | Views | Posted |
---|---|---|
4894 | 06-20-2016 06:07 PM |
02-23-2017
03:55 PM
We decided to go with HSsqldb as our vendor wouldn't support sqoop metastore + mysql.
Thanks, Sindhu for providing your inputs.
... View more
02-15-2017
06:58 PM
@Sindhu, After removing sqoop-site.xml, the oozie job is now complaining on the contrary:
2017-02-15 12:51:05,420 WARN ActionStartXCommand:523 - SERVER[tlccmrhdd01.r1-core.r1.aig.net] USER[u1453711] GROUP[-] TOKEN[] APP[MDMRDM-RDM-tables] JOB[0000000-170215081728307-oozie-oozi-W] ACTION[0000000-170215081728307-oozie-oozi-W@Sqoop-exec-rdm-jobs] Error starting action [Sqoop-exec-rdm-jobs]. ErrorType [ERROR], ErrorCode [JA008], Message [JA008: File does not exist: hdfs://sandbox-gfat/user/oozie/share/lib/lib_20170119183643/sqoop/sqoop-site.xml#sqoop-site.xml]
org.apache.oozie.action.ActionExecutorException: JA008: File does not exist: hdfs://sandbox-gfat/user/oozie/share/lib/lib_20170119183643/sqoop/sqoop-site.xml#sqoop-site.xml
at org.apache.oozie.action.ActionExecutor.convertExceptionHelper(ActionExecutor.java:457)
at org.apache.oozie.action.ActionExecutor.convertException(ActionExecutor.java:441)
at org.apache.oozie.action.hadoop.JavaActionExecutor.submitLauncher(JavaActionExecutor.java:1202)
at org.apache.oozie.action.hadoop.JavaActionExecutor.start(JavaActionExecutor.java:1373)
at org.apache.oozie.command.wf.ActionStartXCommand.execute(ActionStartXCommand.java:232)
at org.apache.oozie.command.wf.ActionStartXCommand.execute(ActionStartXCommand.java:63)
at org.apache.oozie.command.XCommand.call(XCommand.java:287)
at org.apache.oozie.service.CallableQueueService$CompositeCallable.call(CallableQueueService.java:331)
at org.apache.oozie.service.CallableQueueService$CompositeCallable.call(CallableQueueService.java:260)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at org.apache.oozie.service.CallableQueueService$CallableWrapper.run(CallableQueueService.java:178)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:744)
... View more
02-15-2017
06:24 PM
Hello All, I have enabled Sqoop Metastore using MYSQL as the backend database using the instructions in this link. However, my oozie job is running into below error: Failing Oozie Launcher, Main class [org.apache.oozie.action.hadoop.SqoopMain], main() threw exception, sqoop-site.xml (Permission denied)
java.io.FileNotFoundException: sqoop-site.xml (Permission denied)
at java.io.FileOutputStream.open(Native Method)
at java.io.FileOutputStream.<init>(FileOutputStream.java:221)
at java.io.FileOutputStream.<init>(FileOutputStream.java:110)
at org.apache.oozie.action.hadoop.SqoopMain.setUpSqoopSite(SqoopMain.java:86)
at org.apache.oozie.action.hadoop.SqoopMain.run(SqoopMain.java:160)
at org.apache.oozie.action.hadoop.LauncherMain.run(LauncherMain.java:51)
at org.apache.oozie.action.hadoop.SqoopMain.main(SqoopMain.java:48)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at org.apache.oozie.action.hadoop.LauncherMapper.map(LauncherMapper.java:242)
at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:54)
at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:453)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:343)
at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:168)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:415)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1724)
at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:162) I have uploaded sqoop-site.xml in hdfs location - /user/oozie/share/lib/lib_20170119183643/sqoop/sqoop-site.xml and also restarted oozie server. Find the oozie job log and sqoop-site.xml attached. Please help me to understand what location is it trying to look for sqoop-site.xml. Thanks in advance. Shashang Sheth ooziejoblog.txt sqoop-site.xml
... View more
Labels:
- Labels:
-
Apache Oozie
-
Apache Sqoop
02-13-2017
07:37 PM
@ Simran Kaur, Can you re post the link to setting MYSQL as metastore for Sqoop. The above link is broken.
... View more
01-09-2017
06:23 AM
@Sonny Heer When I do hive -e 'describe formatted ocods_temp.umoney_provision_allocation_details_xpose', it returns me the attached error. But if I do hive
-e "use ocods_temp; describe formatted
umoney_provision_allocation_details_xpose" , the command provides the required information. This concludes that there is not issue with the table as such.hive-error.txt
... View more
01-06-2017
05:46 PM
@mbalakrishnan, Can you explain why does your solution work? I had run into a similar problem and the above solution worked with my issue so I am curious to know the reason behind the same. Regards, Shashang Sheth
... View more
06-20-2016
06:07 PM
Issue resolved. The kafka broker service was running on internal ip address of the server whereas the systems initiating the producer process was trying to connect to the external ip address of the Kafka Broker server. Restarted Kafka Broker service after modifying the "listener" property with the correct ip address.
... View more
06-20-2016
10:12 AM
@Kuldeep, I wasn't able to find this property in Ambari. Can you tell me where can I find it?
... View more