Support Questions

Find answers, ask questions, and share your expertise
Announcements
Celebrating as our community reaches 100,000 members! Thank you!

JARS are missing, can you please let me know which jars are missing in Sqoop? SQOOP import issue

avatar
Explorer
jars.txt

I have attached all the jars text copy also for your reference. Could you please let me know what jars are missing and need to update to execute the job?

1 ACCEPTED SOLUTION

avatar
Super Guru

@fnu rasool

You are missing "hadoop-yarn-api.jar" jar file, below is the location where you can find the jar.

/usr/hdp/<version>/hadoop-yarn//hadoop-yarn-api-<version>.jar

View solution in original post

12 REPLIES 12

avatar
Explorer

Hi Jitendra,

I am expecting the same error, after following these commands. Can you please review once.

The actuall error I am getting is Could not find or load main org.apache.sqoop.sqoop I ran this as adminstrator runas /user:administrator mklink C:\hadoop\hdp\hadoop-2.7.1.2.4.0.0-169\share\hadoop\yarn\hadoop-yarn-api-2.7.1.2.4.0.0-169.jar C:\hadoop\hdp\sqoop-1.4.6.2.4.0.0-169\lib\hadoop-yarn-api-2.7.1.2.4.0.0-169.jar C:\hadoop\hdp\sqoop-1.4.6.2.4.0.0-169\lib Set Yarn path (Attched the jpg) set sqoop path (attached the jpg) Executed the sqoop command after checking the classpath but getting the same error Could not find or load main org.apache.sqoop.sqooploadmainsqoopfail.pdf

avatar

@fnu rasool Are you running HDP on Windows? Make sure all your paths are set in the PATH environment variable. See here for details. http://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.4.0-Win/bk_HDP_Install_Win/content/ch07s03.html

avatar
Explorer

Hi,

I checked all the paths and all set. But its giving this exception. not sure what jar is missing?

Exception in thread "main" java.lang.NoClassDefFoundError: org/apache/hadoop/yarn/exceptions/YarnException at org.apache.hadoop.mapred.YarnClientProtocolProvider.create(YarnClientProtocolProvider.java:34) at org.apache.hadoop.mapreduce.Cluster.initialize(Cluster.java:95) at org.apache.hadoop.mapreduce.Cluster.<init>(Cluster.java:82) at org.apache.hadoop.mapreduce.Cluster.<init>(Cluster.java:75) at org.apache.hadoop.mapreduce.Job$9.run(Job.java:1260) at org.apache.hadoop.mapreduce.Job$9.run(Job.java:1256) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:415) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657) at org.apache.hadoop.mapreduce.Job.connect(Job.java:1255) at org.apache.hadoop.mapreduce.Job.submit(Job.java:1284) at org.apache.hadoop.mapreduce.Job.waitForCompletion(Job.java:1308) at org.apache.sqoop.mapreduce.ImportJobBase.doSubmitJob(ImportJobBase.java:196) at org.apache.sqoop.mapreduce.ImportJobBase.runJob(ImportJobBase.java:169) at org.apache.sqoop.mapreduce.ImportJobBase.runImport(ImportJobBase.java:266) at org.apache.sqoop.manager.SqlManager.importTable(SqlManager.java:673) at org.apache.sqoop.manager.OracleManager.importTable(OracleManager.java:444) at org.apache.sqoop.tool.ImportTool.importTable(ImportTool.java:497) at org.apache.sqoop.tool.ImportTool.run(ImportTool.java:605) at org.apache.sqoop.Sqoop.run(Sqoop.java:148) at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:76) at org.apache.sqoop.Sqoop.runSqoop(Sqoop.java:184) at org.apache.sqoop.Sqoop.runTool(Sqoop.java:226) at org.apache.sqoop.Sqoop.runTool(Sqoop.java:235) at org.apache.sqoop.Sqoop.main(Sqoop.java:244) Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.yarn.exceptions.YarnException at java.net.URLClassLoader$1.run(URLClassLoader.java:366) at java.net.URLClassLoader$1.run(URLClassLoader.java:355) at java.security.AccessController.doPrivileged(Native Method) at java.net.URLClassLoader.findClass(URLClassLoader.java:354)