question Re: JARS are missing, can you please let me know which jars are missing in Sqoop? SQOOP import issue in Archives of Support Questions (Read Only)

JARS are missing, can you please let me know which jars are missing in Sqoop? SQOOP import issue

fnu_rasool — Tue, 26 Apr 2016 01:29:55 GMT

I have attached all the jars text copy also for your reference. Could you please let me know what jars are missing and need to update to execute the job?

Re: JARS are missing, can you please let me know which jars are missing in Sqoop? SQOOP import issue

mjohansson — Tue, 26 Apr 2016 01:49:22 GMT

Looks like hadoop-yarn-common-x.x.x.jar is missing.

Re: JARS are missing, can you please let me know which jars are missing in Sqoop? SQOOP import issue

jyadav — Tue, 26 Apr 2016 01:56:37 GMT

@fnu rasool

You are missing "hadoop-yarn-api.jar" jar file, below is the location where you can find the jar.

/usr/hdp/<version>/hadoop-yarn//hadoop-yarn-api-<version>.jar

Re: JARS are missing, can you please let me know which jars are missing in Sqoop? SQOOP import issue

fnu_rasool — Tue, 26 Apr 2016 02:01:28 GMT

I checked the jars and its available.

Please review the attached copy. -thanks,hadoopyarncommonjars.jpg

Re: JARS are missing, can you please let me know which jars are missing in Sqoop? SQOOP import issue

SQLShaw — Tue, 26 Apr 2016 02:02:16 GMT

@fnu rasool Are you running HDP on Windows? Make sure all your paths are set in the PATH environment variable. See here for details. http://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.4.0-Win/bk_HDP_Install_Win/content/ch07s03.html

Re: JARS are missing, can you please let me know which jars are missing in Sqoop? SQOOP import issue

fnu_rasool — Tue, 26 Apr 2016 02:07:37 GMT

Yadav,

The first jar is hadoop-yarn-api-2.7.1.2.4.0.0-169

Can you please review the jpg. Thank you.

Re: JARS are missing, can you please let me know which jars are missing in Sqoop? SQOOP import issue

fnu_rasool — Tue, 26 Apr 2016 02:15:24 GMT

Hi,

I checked all the paths and all set. But its giving this exception. not sure what jar is missing?

Exception in thread "main" java.lang.NoClassDefFoundError: org/apache/hadoop/yarn/exceptions/YarnException at org.apache.hadoop.mapred.YarnClientProtocolProvider.create(YarnClientProtocolProvider.java:34) at org.apache.hadoop.mapreduce.Cluster.initialize(Cluster.java:95) at org.apache.hadoop.mapreduce.Cluster.<init>(Cluster.java:82) at org.apache.hadoop.mapreduce.Cluster.<init>(Cluster.java:75) at org.apache.hadoop.mapreduce.Job$9.run(Job.java:1260) at org.apache.hadoop.mapreduce.Job$9.run(Job.java:1256) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:415) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657) at org.apache.hadoop.mapreduce.Job.connect(Job.java:1255) at org.apache.hadoop.mapreduce.Job.submit(Job.java:1284) at org.apache.hadoop.mapreduce.Job.waitForCompletion(Job.java:1308) at org.apache.sqoop.mapreduce.ImportJobBase.doSubmitJob(ImportJobBase.java:196) at org.apache.sqoop.mapreduce.ImportJobBase.runJob(ImportJobBase.java:169) at org.apache.sqoop.mapreduce.ImportJobBase.runImport(ImportJobBase.java:266) at org.apache.sqoop.manager.SqlManager.importTable(SqlManager.java:673) at org.apache.sqoop.manager.OracleManager.importTable(OracleManager.java:444) at org.apache.sqoop.tool.ImportTool.importTable(ImportTool.java:497) at org.apache.sqoop.tool.ImportTool.run(ImportTool.java:605) at org.apache.sqoop.Sqoop.run(Sqoop.java:148) at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:76) at org.apache.sqoop.Sqoop.runSqoop(Sqoop.java:184) at org.apache.sqoop.Sqoop.runTool(Sqoop.java:226) at org.apache.sqoop.Sqoop.runTool(Sqoop.java:235) at org.apache.sqoop.Sqoop.main(Sqoop.java:244) Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.yarn.exceptions.YarnException at java.net.URLClassLoader$1.run(URLClassLoader.java:366) at java.net.URLClassLoader$1.run(URLClassLoader.java:355) at java.security.AccessController.doPrivileged(Native Method) at java.net.URLClassLoader.findClass(URLClassLoader.java:354)

Re: JARS are missing, can you please let me know which jars are missing in Sqoop? SQOOP import issue

fnu_rasool — Tue, 26 Apr 2016 02:17:43 GMT

Both jars are not same? Do I need to copy the second jar?

hadoop-yarn-api-2.7.1.2.4.0.0-169 / hadoop-yarn-api.jar

Re: JARS are missing, can you please let me know which jars are missing in Sqoop? SQOOP import issue

jyadav — Tue, 26 Apr 2016 02:26:30 GMT

@fnu rasool

That's true but these jars are not accessible by sqoop due to class path issue, can you please try setting below env variable just before running sqoop command?

SQOOP_HOME=c:\hdp

Re: JARS are missing, can you please let me know which jars are missing in Sqoop? SQOOP import issue

fnu_rasool — Tue, 26 Apr 2016 02:40:39 GMT

Yes.

Its was SQOOP_HOME=C:\hdp\sqoop-1.4.6.2.4.0.0-169

I changed to SQOOP_HOME=C:\hdp but no luck.

Re: JARS are missing, can you please let me know which jars are missing in Sqoop? SQOOP import issue

jyadav — Tue, 26 Apr 2016 03:12:04 GMT

@fnu rasool

Ok then lets try to set CLASSPATH manually.

set CLASSPATH=%CLASSPATH%;<\directory location where jar file exist>

Re: JARS are missing, can you please let me know which jars are missing in Sqoop? SQOOP import issue

fnu_rasool — Tue, 26 Apr 2016 03:22:50 GMT

Jithedra is it able to contact me? I am able to share the details. Please let me know.

fnu.rasool@gmail.com

Thanks,

Rasool.

Re: JARS are missing, can you please let me know which jars are missing in Sqoop? SQOOP import issue

fnu_rasool — Tue, 26 Apr 2016 22:07:50 GMT

Hi Jitendra,

I am expecting the same error, after following these commands. Can you please review once.

The actuall error I am getting is Could not find or load main org.apache.sqoop.sqoop I ran this as adminstrator runas /user:administrator mklink C:\hadoop\hdp\hadoop-2.7.1.2.4.0.0-169\share\hadoop\yarn\hadoop-yarn-api-2.7.1.2.4.0.0-169.jar C:\hadoop\hdp\sqoop-1.4.6.2.4.0.0-169\lib\hadoop-yarn-api-2.7.1.2.4.0.0-169.jar C:\hadoop\hdp\sqoop-1.4.6.2.4.0.0-169\lib Set Yarn path (Attched the jpg) set sqoop path (attached the jpg) Executed the sqoop command after checking the classpath but getting the same error Could not find or load main org.apache.sqoop.sqooploadmainsqoopfail.pdf