I'm getting this error please help me
ERROR tool.ImportTool: Import failed: java.io.FileNotFoundException: File does not exist: hdfs://localhost:54310/usr/local/sqoop/lib/parquet-hadoop-1.6.0.jar
You will need to copy that file from /usr/hdp/current/sqoop-server/lib/* to /usr/local/sqoop/lib/ but the best option will be to create a symbolic link so that all the dependencies maybe other jars are available to sqoop
Symbolic or soft link (files or directories, more flexible and self-documenting)
# Source Link
ln -s /usr/hdp/current/sqoop-server/lib /usr/local/sqoop/lib
Which should make the parquet-hadoop-1.6.0.jar available now if you run your sqoop comamnd it should succeed
As the Error is pointing to HDFS path (not the local file system)
File does not exist: hdfs://localhost:54310/usr/local/sqoop/lib/parquet-hadoop-1.6.0.jar
So can you please check if your HDFS has that JAR or the required jars? Can you try to put the required JARs there?
# su - hdfs -c "hdfs dfs -ls /usr/local/sqoop/lib/" (OR) # su - hdfs -c "hdfs dfs -ls hdfs://localhost:54310/usr/local/sqoop" # su - hdfs -c "hdfs dfs -ls /usr/local" # su - hdfs -c "hdfs dfs -ls hdfs://localhost:54310/usr/"
Also can yu please share the exact Sqoop command that you are executing ?
Other option will be to create same directory on HDFS and the put the jars there:
# hdfs dfs -put /LOCAL/PATH/TO/parquet-hadoop-1.6.0.jar hdfs://localhost:54310/usr/local/sqoop/lib/parquet-hadoop-1.6.0.jar
And set the permissions of that JAR and directory properly like sqoop:hadoop so that it can be read properly.
I have created a directory and added all sqoop jar to hdfs://localhost:54310/usr/local/sqoop/lib/
and Sqoop 1.4.7 jar to it at last it worked
But getting this error can you help
thanks for your kindly reply
Your current issue seems to be more specific to your custom classes "tblpaytype".
Can you please open a separate HCC thread and the provide detailed information about that "ClassNotFountError: tblpaytype" ..
That way we can isolate different issues as part of different HCC threads .. It becomes more helpful to other HCC users to quickly find the solutions.
It will be great if you can mark the most helpful answer if this HCC thread as :"Answered" by clicking the "Accept" link on that answer.