Created 06-25-2019 01:26 PM
I'm getting this error please help me
ERROR tool.ImportTool: Import failed: java.io.FileNotFoundException: File does not exist: hdfs://localhost:54310/usr/local/sqoop/lib/parquet-hadoop-1.6.0.jar
Created 06-25-2019 02:23 PM
You will need to copy that file from /usr/hdp/current/sqoop-server/lib/* to /usr/local/sqoop/lib/ but the best option will be to create a symbolic link so that all the dependencies maybe other jars are available to sqoop
Symbolic or soft link (files or directories, more flexible and self-documenting)
# Source Link
ln -s /usr/hdp/current/sqoop-server/lib /usr/local/sqoop/lib
Which should make the parquet-hadoop-1.6.0.jar available now if you run your sqoop comamnd it should succeed
Created on 06-26-2019 06:26 AM - edited 08-17-2019 02:50 PM
Is this method correct and thanks for kindly reply Geoffrey Shelton Okot
Created 06-26-2019 06:48 AM
As the Error is pointing to HDFS path (not the local file system)
File does not exist: hdfs://localhost:54310/usr/local/sqoop/lib/parquet-hadoop-1.6.0.jar
.
So can you please check if your HDFS has that JAR or the required jars? Can you try to put the required JARs there?
# su - hdfs -c "hdfs dfs -ls /usr/local/sqoop/lib/" (OR) # su - hdfs -c "hdfs dfs -ls hdfs://localhost:54310/usr/local/sqoop" # su - hdfs -c "hdfs dfs -ls /usr/local" # su - hdfs -c "hdfs dfs -ls hdfs://localhost:54310/usr/"
Also can yu please share the exact Sqoop command that you are executing ?
Other option will be to create same directory on HDFS and the put the jars there:
# hdfs dfs -put /LOCAL/PATH/TO/parquet-hadoop-1.6.0.jar hdfs://localhost:54310/usr/local/sqoop/lib/parquet-hadoop-1.6.0.jar
.
And set the permissions of that JAR and directory properly like sqoop:hadoop so that it can be read properly.
Created on 06-26-2019 09:18 AM - edited 08-17-2019 02:49 PM
I have created a directory and added all sqoop jar to hdfs://localhost:54310/usr/local/sqoop/lib/
and Sqoop 1.4.7 jar to it at last it worked
But getting this error can you help
thanks for your kindly reply
Created 06-26-2019 09:26 AM
Yes that looks okay now you should be able to launch your sqoop job.
Please revert
Created 06-26-2019 09:29 AM
No same jar problem exits when i run sqoop job.
Created 06-26-2019 01:26 PM
Your current issue seems to be more specific to your custom classes "tblpaytype".
Can you please open a separate HCC thread and the provide detailed information about that "ClassNotFountError: tblpaytype" ..
That way we can isolate different issues as part of different HCC threads .. It becomes more helpful to other HCC users to quickly find the solutions.
It will be great if you can mark the most helpful answer if this HCC thread as :"Answered" by clicking the "Accept" link on that answer.