Support Questions

Find answers, ask questions, and share your expertise

Unable to use sqoop on cloudera CDH5

avatar
Rising Star

Hi team,

 

I am getting below error while trying to use sqoop syntax. Unable to use sqoop on cloudera CDH5

 

root@blrrndtipamo02:/opt/cloudera/parcels/CDH/lib/sqoop/bin# sqoop version
Error: /usr/lib/sqoop/../hadoop does not exist!
Please set $HADOOP_COMMON_HOME to the root of your Hadoop installation.

 

 

root@blrrndtipamo02:/opt/cloudera/parcels/CDH/lib/sqoop/bin# sqoop help
Error: /usr/lib/sqoop/../hadoop does not exist!
Please set $HADOOP_COMMON_HOME to the root of your Hadoop installation.

 

Please suggest

1 ACCEPTED SOLUTION

avatar
Rising Star

Issue fixed with below steps I performed.

 

  1. Download derby derby client from db-derby-10.11.1.1-bin.zip
  2. Extract and copy derby.jar and derbyclient.jar from zip file to /var/lib/sqoop2
  3. Copy derby.jar to /opt/cloudera/parcels/CDH-<version>/jars/ as well
  4. Delete /opt/cloudera/parcels/CDH-<version>/lib/sqoop2/webapps/sqoop/WEB-INF/lib/derby​-<version>.jar soft link.
  5. Make /opt/cloudera/parcels/CDH-<version>/l​ib/sqoop2/webapps/sqoop/WEB-INF/lib/derby.jar to /opt/cloudera/parcels/CDH-<version>/jars/derby.jar

Command for soft link:

ln -s /opt/cloudera/parcels/CDH-5.4.0-1.cdh5.4.0.p0.27/lib/sqoop2/webapps/sqoop/WEB-INF/lib/derby.jar /opt/cloudera/parcels/CDH-5.4.0-1.cdh5.4.0.p0.27/jars/derby.jar

View solution in original post

11 REPLIES 11

avatar
Rising Star

Yes, permission all fine. 

 

Checked jar file is placed in /var/lib/sqoop path.

 

I am using Debain Wheezy build with CDH5.3.3 parcels version.  I do not see only sqoop as it shows sqoop 2 alone as in screen shoft below. However, it is doesn't work.

 

Cluster 1.png

avatar
Rising Star

Issue fixed with below steps I performed.

 

  1. Download derby derby client from db-derby-10.11.1.1-bin.zip
  2. Extract and copy derby.jar and derbyclient.jar from zip file to /var/lib/sqoop2
  3. Copy derby.jar to /opt/cloudera/parcels/CDH-<version>/jars/ as well
  4. Delete /opt/cloudera/parcels/CDH-<version>/lib/sqoop2/webapps/sqoop/WEB-INF/lib/derby​-<version>.jar soft link.
  5. Make /opt/cloudera/parcels/CDH-<version>/l​ib/sqoop2/webapps/sqoop/WEB-INF/lib/derby.jar to /opt/cloudera/parcels/CDH-<version>/jars/derby.jar

Command for soft link:

ln -s /opt/cloudera/parcels/CDH-5.4.0-1.cdh5.4.0.p0.27/lib/sqoop2/webapps/sqoop/WEB-INF/lib/derby.jar /opt/cloudera/parcels/CDH-5.4.0-1.cdh5.4.0.p0.27/jars/derby.jar