Not exactly same but I had similar installation issue with Sqoop2. In my case I had to reinstall the OS and get past the issue. It was the most time saving solution for me after spending good amount of time trying to analyze the problem. ... View more

In my case removing the non CDH HSQDLDB Jar files was acceptable to me. But in general I suppose this could be corrected so that CDH does not use the Jar files that are elsewhere. Perhaps you could make this a suggestion in appropriate forum / ticket system at Cloudera. ... View more

With CDH 5.3 reinstalled on a fresh Ubuntu 14.04 installation without any errors. But the Sqoop scripts/commands that worked with CDH 5.1 now do not work. The logged output indicates the SqlServer JDBC driver is not chosen by Sqoop. Sqoop incorrectly chooses Hsql driver even though the JDBC URL specifies sqlserver.  I have placed a copy of the SqlServer JDBC driver in /var/lib/sqoop, /var/lib/sqoop2 as well as in /opt/cloudera/parcels/CDH-5.3.0-1.cdh5.3.0.p0.30/jars.   As an experiment I also tried to using Sqoop2 also. But add link fails. I have posted the output at the end of this post.   What do I need to do to make this work?     The command is as below: sqoop import \     --driver com.microsoft.sqlserver.jdbc.SQLServerDriver \     --connect jdbc:sqlserver://sqlserver:1433\;databaseName=dbname \     --username sa --password thepasswd \     --direct \     --num-mappers 1 \     --hive-import \     --table person\     --map-column-hive row_timestamp=timestamp \     --verbose   The output of the command is below: Warning: /opt/cloudera/parcels/CDH-5.3.0-1.cdh5.3.0.p0.30/bin/../lib/sqoop/../accumulo does not exist! Accumulo imports will fail. Please set $ACCUMULO_HOME to the root of your Accumulo installation. 15/01/27 10:56:53 INFO sqoop.Sqoop: Running Sqoop version: 1.4.5-cdh5.3.0 15/01/27 10:56:53 DEBUG tool.BaseSqoopTool: Enabled debug logging. 15/01/27 10:56:53 WARN tool.BaseSqoopTool: Setting your password on the command-line is insecure. Consider using -P instead. 15/01/27 10:56:53 INFO tool.BaseSqoopTool: Using Hive-specific delimiters for output. You can override 15/01/27 10:56:53 INFO tool.BaseSqoopTool: delimiters with --fields-terminated-by, etc. 15/01/27 10:56:53 DEBUG sqoop.ConnFactory: Loaded manager factory: org.apache.sqoop.manager.oracle.OraOopManagerFactory 15/01/27 10:56:53 DEBUG sqoop.ConnFactory: Loaded manager factory: com.cloudera.sqoop.manager.DefaultManagerFactory 15/01/27 10:56:53 WARN sqoop.ConnFactory: Parameter --driver is set to an explicit driver however appropriate connection manager is not being set (via --connection-manager). Sqoop is going to fall back to org.apache.sqoop.manager.GenericJdbcManager. Please specify explicitly which connection manager should be used next time. 15/01/27 10:56:53 INFO manager.SqlManager: Using default fetchSize of 1000 15/01/27 10:56:53 INFO tool.CodeGenTool: Beginning code generation 15/01/27 10:56:53 DEBUG manager.SqlManager: Execute getColumnInfoRawQuery : SELECT t.* FROM person AS t WHERE 1=0 15/01/27 10:56:53 DEBUG manager.SqlManager: No connection paramenters specified. Using regular API for making connection. Exception in thread "main" java.lang.NoSuchMethodError: org.hsqldb.DatabaseURL.parseURL(Ljava/lang/String;ZZ)Lorg/hsqldb/persist/HsqlProperties;         at org.hsqldb.jdbc.JDBCDriver.getConnection(Unknown Source)         at org.hsqldb.jdbc.JDBCDriver.connect(Unknown Source)         at java.sql.DriverManager.getConnection(DriverManager.java:571)         at java.sql.DriverManager.getConnection(DriverManager.java:215)         at org.apache.sqoop.manager.SqlManager.makeConnection(SqlManager.java:877)         at org.apache.sqoop.manager.GenericJdbcManager.getConnection(GenericJdbcManager.java:52)         at org.apache.sqoop.manager.SqlManager.execute(SqlManager.java:736)         at org.apache.sqoop.manager.SqlManager.execute(SqlManager.java:759)         at org.apache.sqoop.manager.SqlManager.getColumnInfoForRawQuery(SqlManager.java:269)         at org.apache.sqoop.manager.SqlManager.getColumnTypesForRawQuery(SqlManager.java:240)         at org.apache.sqoop.manager.SqlManager.getColumnTypes(SqlManager.java:226)         at org.apache.sqoop.manager.ConnManager.getColumnTypes(ConnManager.java:295)         at org.apache.sqoop.orm.ClassWriter.getColumnTypes(ClassWriter.java:1833)         at org.apache.sqoop.orm.ClassWriter.generate(ClassWriter.java:1645)         at org.apache.sqoop.tool.CodeGenTool.generateORM(CodeGenTool.java:96)         at org.apache.sqoop.tool.ImportTool.importTable(ImportTool.java:478)         at org.apache.sqoop.tool.ImportTool.run(ImportTool.java:605)         at org.apache.sqoop.Sqoop.run(Sqoop.java:143)         at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)         at org.apache.sqoop.Sqoop.runSqoop(Sqoop.java:179)         at org.apache.sqoop.Sqoop.runTool(Sqoop.java:218)         at org.apache.sqoop.Sqoop.runTool(Sqoop.java:227)         at org.apache.sqoop.Sqoop.main(Sqoop.java:236)     Output of Sqoop2 add link: sqoop:000> set server --host localhost --port 12000 --webapp sqoop Server is set successfully sqoop:000> create link --cid 2 Creating link for connector with id 2 Please fill following values to create new link object Name: ngreportdb Link configuration JDBC Driver Class: com.microsoft.sqlserver.jdbc.SQLServerDriver JDBC Connection String: jdbc:sqlserver://sqlserver:1433;databaseName=dbname Username: sa Password: ************* JDBC Connection Properties: There are currently 0 values in the map: entry#  There are issues with entered data, please revise your input: ... View more

Thanks for your response.   The Sqoop2 client errors, I suspect, are the consequence of a problem somewhere else. Comparing with two setups where I attempted the same I do not find core-default.xml file anywhere on any of the file systems. Isn't the successful install of Sqoop2 service be a pre-requisite for the client to function?   At this time I am inclined to reinstall the base OS and install CDH on it. So the following is only to provide info that may help analyze and  improve debuggability of CDH in this aspect of installation, that the reported info does not seem to help identify the cause of the problem.   Following is reported by the installer when it installs Sqoop2 service.   Service did not start successfully; not all of the required roles started: Service has only 0 Sqoop 2 Server roles running instead of minimum required 1. Supervisor returned FATAL. Please check the role log file, stderr, or stdout. Program: sqoop/sqoop.sh [] Recent Log Entries Links to full logs: Stderr Stdout Role Log Details Role Log File Stderr Stdout 2015-01-22 08:08:25,483 INFO org.apache.sqoop.connector.ConnectorHandler: Connector [org.apache.sqoop.connector.hdfs.HdfsConnector] initialized. 2015-01-22 08:08:25,511 INFO org.apache.sqoop.connector.ConnectorHandler: Connector [org.apache.sqoop.connector.jdbc.GenericJdbcConnector] initialized. 2015-01-22 08:08:25,679 INFO org.apache.sqoop.repository.JdbcRepositoryTransaction: Attempting transaction commit 2015-01-22 08:08:25,680 INFO org.apache.sqoop.connector.ConnectorManager: Connectors loaded: {hdfs-connector={hdfs-connector:org.apache.sqoop.connector.hdfs.HdfsConnector:jar:file:/var/lib/sqoop2/tomcat-deployment/webapps/sqoop/WEB-INF/lib/sqoop-connector-hdfs-1.99.4-cdh5.3.0.jar!/sqoopconnector.properties}, generic-jdbc-connector={generic-jdbc-connector:org.apache.sqoop.connector.jdbc.GenericJdbcConnector:jar:file:/var/lib/sqoop2/tomcat-deployment/webapps/sqoop/WEB-INF/lib/sqoop-connector-generic-jdbc-1.99.4-cdh5.3.0.jar!/sqoopconnector.properties}} 2015-01-22 08:08:25,680 INFO org.apache.sqoop.tools.tool.UpgradeTool: Initializing the Driver with upgrade option turned on. 2015-01-22 08:08:25,694 INFO org.apache.sqoop.repository.JdbcRepositoryTransaction: Attempting transaction commit 2015-01-22 08:08:25,695 INFO org.apache.sqoop.driver.Driver: Driver initialized: OK 2015-01-22 08:08:25,695 INFO org.apache.sqoop.tools.tool.UpgradeTool: Upgrade completed successfully. 2015-01-22 08:08:25,695 INFO org.apache.sqoop.tools.tool.UpgradeTool: Tearing all managers down. 2015-01-22 08:08:25,750 INFO org.apache.sqoop.repository.derby.DerbyRepositoryHandler: Embedded Derby shutdown raised SQL STATE 45000 as expected. 2015-01-22 08:08:25,750 INFO org.apache.sqoop.repository.JdbcRepositoryProvider: Deregistering JDBC driver 2015-01-22 08:08:25,751 INFO org.apache.sqoop.core.PropertiesConfigurationProvider: Shutting down configuration poller thread   Thu Jan 22 08:08:28 EST 2015 + source_parcel_environment + '[' '!' -z /opt/cloudera/parcels/CDH-5.3.0-1.cdh5.3.0.p0.30/meta/cdh_env.sh ']' + OLD_IFS=' ' + IFS=: + SCRIPT_ARRAY=($SCM_DEFINES_SCRIPTS) + DIRNAME_ARRAY=($PARCEL_DIRNAMES) + IFS=' ' + COUNT=1 ++ seq 1 1 + for i in '`seq 1 $COUNT`' + SCRIPT=/opt/cloudera/parcels/CDH-5.3.0-1.cdh5.3.0.p0.30/meta/cdh_env.sh + PARCEL_DIRNAME=CDH-5.3.0-1.cdh5.3.0.p0.30 + . /opt/cloudera/parcels/CDH-5.3.0-1.cdh5.3.0.p0.30/meta/cdh_env.sh ++ CDH_DIRNAME=CDH-5.3.0-1.cdh5.3.0.p0.30 ++ export CDH_HADOOP_HOME=/opt/cloudera/parcels/CDH-5.3.0-1.cdh5.3.0.p0.30/lib/hadoop ++ CDH_HADOOP_HOME=/opt/cloudera/parcels/CDH-5.3.0-1.cdh5.3.0.p0.30/lib/hadoop ++ export CDH_MR1_HOME=/opt/cloudera/parcels/CDH-5.3.0-1.cdh5.3.0.p0.30/lib/hadoop-0.20-mapreduce ++ CDH_MR1_HOME=/opt/cloudera/parcels/CDH-5.3.0-1.cdh5.3.0.p0.30/lib/hadoop-0.20-mapreduce ++ export CDH_HDFS_HOME=/opt/cloudera/parcels/CDH-5.3.0-1.cdh5.3.0.p0.30/lib/hadoop-hdfs ++ CDH_HDFS_HOME=/opt/cloudera/parcels/CDH-5.3.0-1.cdh5.3.0.p0.30/lib/hadoop-hdfs ++ export CDH_HTTPFS_HOME=/opt/cloudera/parcels/CDH-5.3.0-1.cdh5.3.0.p0.30/lib/hadoop-httpfs ++ CDH_HTTPFS_HOME=/opt/cloudera/parcels/CDH-5.3.0-1.cdh5.3.0.p0.30/lib/hadoop-httpfs ++ export CDH_MR2_HOME=/opt/cloudera/parcels/CDH-5.3.0-1.cdh5.3.0.p0.30/lib/hadoop-mapreduce ++ CDH_MR2_HOME=/opt/cloudera/parcels/CDH-5.3.0-1.cdh5.3.0.p0.30/lib/hadoop-mapreduce ++ export CDH_YARN_HOME=/opt/cloudera/parcels/CDH-5.3.0-1.cdh5.3.0.p0.30/lib/hadoop-yarn ++ CDH_YARN_HOME=/opt/cloudera/parcels/CDH-5.3.0-1.cdh5.3.0.p0.30/lib/hadoop-yarn ++ export CDH_HBASE_HOME=/opt/cloudera/parcels/CDH-5.3.0-1.cdh5.3.0.p0.30/lib/hbase ++ CDH_HBASE_HOME=/opt/cloudera/parcels/CDH-5.3.0-1.cdh5.3.0.p0.30/lib/hbase ++ export CDH_ZOOKEEPER_HOME=/opt/cloudera/parcels/CDH-5.3.0-1.cdh5.3.0.p0.30/lib/zookeeper ++ CDH_ZOOKEEPER_HOME=/opt/cloudera/parcels/CDH-5.3.0-1.cdh5.3.0.p0.30/lib/zookeeper ++ export CDH_HIVE_HOME=/opt/cloudera/parcels/CDH-5.3.0-1.cdh5.3.0.p0.30/lib/hive ++ CDH_HIVE_HOME=/opt/cloudera/parcels/CDH-5.3.0-1.cdh5.3.0.p0.30/lib/hive ++ export CDH_HUE_HOME=/opt/cloudera/parcels/CDH-5.3.0-1.cdh5.3.0.p0.30/lib/hue ++ CDH_HUE_HOME=/opt/cloudera/parcels/CDH-5.3.0-1.cdh5.3.0.p0.30/lib/hue ++ export CDH_OOZIE_HOME=/opt/cloudera/parcels/CDH-5.3.0-1.cdh5.3.0.p0.30/lib/oozie ++ CDH_OOZIE_HOME=/opt/cloudera/parcels/CDH-5.3.0-1.cdh5.3.0.p0.30/lib/oozie ++ export CDH_HUE_PLUGINS_HOME=/opt/cloudera/parcels/CDH-5.3.0-1.cdh5.3.0.p0.30/lib/hadoop ++ CDH_HUE_PLUGINS_HOME=/opt/cloudera/parcels/CDH-5.3.0-1.cdh5.3.0.p0.30/lib/hadoop ++ export CDH_FLUME_HOME=/opt/cloudera/parcels/CDH-5.3.0-1.cdh5.3.0.p0.30/lib/flume-ng ++ CDH_FLUME_HOME=/opt/cloudera/parcels/CDH-5.3.0-1.cdh5.3.0.p0.30/lib/flume-ng ++ export CDH_PIG_HOME=/opt/cloudera/parcels/CDH-5.3.0-1.cdh5.3.0.p0.30/lib/pig ++ CDH_PIG_HOME=/opt/cloudera/parcels/CDH-5.3.0-1.cdh5.3.0.p0.30/lib/pig ++ export CDH_HCAT_HOME=/opt/cloudera/parcels/CDH-5.3.0-1.cdh5.3.0.p0.30/lib/hive-hcatalog ++ CDH_HCAT_HOME=/opt/cloudera/parcels/CDH-5.3.0-1.cdh5.3.0.p0.30/lib/hive-hcatalog ++ export CDH_SQOOP2_HOME=/opt/cloudera/parcels/CDH-5.3.0-1.cdh5.3.0.p0.30/lib/sqoop2 ++ CDH_SQOOP2_HOME=/opt/cloudera/parcels/CDH-5.3.0-1.cdh5.3.0.p0.30/lib/sqoop2 ++ export CDH_LLAMA_HOME=/opt/cloudera/parcels/CDH-5.3.0-1.cdh5.3.0.p0.30/lib/llama ++ CDH_LLAMA_HOME=/opt/cloudera/parcels/CDH-5.3.0-1.cdh5.3.0.p0.30/lib/llama ++ export CDH_SENTRY_HOME=/opt/cloudera/parcels/CDH-5.3.0-1.cdh5.3.0.p0.30/lib/sentry ++ CDH_SENTRY_HOME=/opt/cloudera/parcels/CDH-5.3.0-1.cdh5.3.0.p0.30/lib/sentry ++ export TOMCAT_HOME=/opt/cloudera/parcels/CDH-5.3.0-1.cdh5.3.0.p0.30/lib/bigtop-tomcat ++ TOMCAT_HOME=/opt/cloudera/parcels/CDH-5.3.0-1.cdh5.3.0.p0.30/lib/bigtop-tomcat ++ export JSVC_HOME=/opt/cloudera/parcels/CDH-5.3.0-1.cdh5.3.0.p0.30/lib/bigtop-utils ++ JSVC_HOME=/opt/cloudera/parcels/CDH-5.3.0-1.cdh5.3.0.p0.30/lib/bigtop-utils ++ export CDH_HADOOP_BIN=/opt/cloudera/parcels/CDH-5.3.0-1.cdh5.3.0.p0.30/lib/hadoop/bin/hadoop ++ CDH_HADOOP_BIN=/opt/cloudera/parcels/CDH-5.3.0-1.cdh5.3.0.p0.30/lib/hadoop/bin/hadoop ++ export CDH_IMPALA_HOME=/opt/cloudera/parcels/CDH-5.3.0-1.cdh5.3.0.p0.30/lib/impala ++ CDH_IMPALA_HOME=/opt/cloudera/parcels/CDH-5.3.0-1.cdh5.3.0.p0.30/lib/impala ++ export CDH_SOLR_HOME=/opt/cloudera/parcels/CDH-5.3.0-1.cdh5.3.0.p0.30/lib/solr ++ CDH_SOLR_HOME=/opt/cloudera/parcels/CDH-5.3.0-1.cdh5.3.0.p0.30/lib/solr ++ export CDH_HBASE_INDEXER_HOME=/opt/cloudera/parcels/CDH-5.3.0-1.cdh5.3.0.p0.30/lib/hbase-solr ++ CDH_HBASE_INDEXER_HOME=/opt/cloudera/parcels/CDH-5.3.0-1.cdh5.3.0.p0.30/lib/hbase-solr ++ export SEARCH_HOME=/opt/cloudera/parcels/CDH-5.3.0-1.cdh5.3.0.p0.30/lib/search ++ SEARCH_HOME=/opt/cloudera/parcels/CDH-5.3.0-1.cdh5.3.0.p0.30/lib/search ++ export CDH_SPARK_HOME=/opt/cloudera/parcels/CDH-5.3.0-1.cdh5.3.0.p0.30/lib/spark ++ CDH_SPARK_HOME=/opt/cloudera/parcels/CDH-5.3.0-1.cdh5.3.0.p0.30/lib/spark ++ export WEBHCAT_DEFAULT_XML=/opt/cloudera/parcels/CDH-5.3.0-1.cdh5.3.0.p0.30/etc/hive-webhcat/conf.dist/webhcat-default.xml ++ WEBHCAT_DEFAULT_XML=/opt/cloudera/parcels/CDH-5.3.0-1.cdh5.3.0.p0.30/etc/hive-webhcat/conf.dist/webhcat-default.xml ++ export CDH_KMS_HOME=/opt/cloudera/parcels/CDH-5.3.0-1.cdh5.3.0.p0.30/lib/hadoop-kms ++ CDH_KMS_HOME=/opt/cloudera/parcels/CDH-5.3.0-1.cdh5.3.0.p0.30/lib/hadoop-kms + locate_cdh_java_home + '[' -z '' ']' + '[' -z /opt/cloudera/parcels/CDH-5.3.0-1.cdh5.3.0.p0.30/lib/bigtop-utils ']' + local BIGTOP_DETECT_JAVAHOME= + for candidate in '"${JSVC_HOME}"' '"${JSVC_HOME}/.."' '"/usr/lib/bigtop-utils"' '"/usr/libexec"' + '[' -e /opt/cloudera/parcels/CDH-5.3.0-1.cdh5.3.0.p0.30/lib/bigtop-utils/bigtop-detect-javahome ']' + BIGTOP_DETECT_JAVAHOME=/opt/cloudera/parcels/CDH-5.3.0-1.cdh5.3.0.p0.30/lib/bigtop-utils/bigtop-detect-javahome + break + '[' -z /opt/cloudera/parcels/CDH-5.3.0-1.cdh5.3.0.p0.30/lib/bigtop-utils/bigtop-detect-javahome ']' + . /opt/cloudera/parcels/CDH-5.3.0-1.cdh5.3.0.p0.30/lib/bigtop-utils/bigtop-detect-javahome ++ BIGTOP_DEFAULTS_DIR=/etc/default ++ '[' -n /etc/default -a -r /etc/default/bigtop-utils ']' ++ JAVA6_HOME_CANDIDATES='\ /usr/lib/j2sdk1.6-sun \ /usr/lib/jvm/java-6-sun \ /usr/lib/jvm/java-1.6.0-sun-1.6.0.* \ /usr/lib/jvm/java-1.6.0-sun-1.6.0.*/jre/ \ /usr/lib/jvm/j2sdk1.6-oracle \ /usr/lib/jvm/j2sdk1.6-oracle/jre \ /usr/java/jdk1.6* \ /usr/java/jre1.6*' ++ OPENJAVA6_HOME_CANDIDATES='\ /usr/lib/jvm/java-1.6.0-openjdk \ /usr/lib/jvm/java-1.6.0-openjdk-* \ /usr/lib/jvm/jre-1.6.0-openjdk*' ++ JAVA7_HOME_CANDIDATES='\ /usr/java/jdk1.7* \ /usr/java/jre1.7* \ /usr/lib/jvm/j2sdk1.7-oracle \ /usr/lib/jvm/j2sdk1.7-oracle/jre \ /usr/lib/jvm/java-7-oracle*' ++ OPENJAVA7_HOME_CANDIDATES='\ /usr/lib/jvm/java-1.7.0-openjdk* \ /usr/lib/jvm/java-7-openjdk*' ++ JAVA8_HOME_CANDIDATES='\ /usr/java/jdk1.8* \ /usr/java/jre1.8* \ /usr/lib/jvm/j2sdk1.8-oracle \ /usr/lib/jvm/j2sdk1.8-oracle/jre \ /usr/lib/jvm/java-8-oracle*' ++ OPENJAVA8_HOME_CANDIDATES='\ /usr/lib/jvm/java-1.8.0-openjdk* \ /usr/lib/jvm/java-8-openjdk*' ++ MISCJAVA_HOME_CANDIDATES='\ /Library/Java/Home \ /usr/java/default \ /usr/lib/jvm/default-java \ /usr/lib/jvm/java-openjdk \ /usr/lib/jvm/jre-openjdk' ++ case $BIGTOP_JAVA_MAJOR in ++ JAVA_HOME_CANDIDATES='\ /usr/java/jdk1.7* \ /usr/java/jre1.7* \ /usr/lib/jvm/j2sdk1.7-oracle \ /usr/lib/jvm/j2sdk1.7-oracle/jre \ /usr/lib/jvm/java-7-oracle* \ /usr/lib/j2sdk1.6-sun \ /usr/lib/jvm/java-6-sun \ /usr/lib/jvm/java-1.6.0-sun-1.6.0.* \ /usr/lib/jvm/java-1.6.0-sun-1.6.0.*/jre/ \ /usr/lib/jvm/j2sdk1.6-oracle \ /usr/lib/jvm/j2sdk1.6-oracle/jre \ /usr/java/jdk1.6* \ /usr/java/jre1.6* \ /usr/java/jdk1.8* \ /usr/java/jre1.8* \ /usr/lib/jvm/j2sdk1.8-oracle \ /usr/lib/jvm/j2sdk1.8-oracle/jre \ /usr/lib/jvm/java-8-oracle* \ /Library/Java/Home \ /usr/java/default \ /usr/lib/jvm/default-java \ /usr/lib/jvm/java-openjdk \ /usr/lib/jvm/jre-openjdk \ /usr/lib/jvm/java-1.7.0-openjdk* \ /usr/lib/jvm/java-7-openjdk* \ /usr/lib/jvm/java-1.6.0-openjdk \ /usr/lib/jvm/java-1.6.0-openjdk-* \ /usr/lib/jvm/jre-1.6.0-openjdk* \ /usr/lib/jvm/java-1.8.0-openjdk* \ /usr/lib/jvm/java-8-openjdk*' ++ '[' -z '' ']' ++ for candidate_regex in '$JAVA_HOME_CANDIDATES' +++ ls -rd '\' ++ for candidate_regex in '$JAVA_HOME_CANDIDATES' +++ ls -rd '/usr/java/jdk1.7*' ++ for candidate_regex in '$JAVA_HOME_CANDIDATES' +++ ls -rd '\' ++ for candidate_regex in '$JAVA_HOME_CANDIDATES' +++ ls -rd '/usr/java/jre1.7*' ++ for candidate_regex in '$JAVA_HOME_CANDIDATES' +++ ls -rd '\' ++ for candidate_regex in '$JAVA_HOME_CANDIDATES' +++ ls -rd /usr/lib/jvm/j2sdk1.7-oracle ++ for candidate_regex in '$JAVA_HOME_CANDIDATES' +++ ls -rd '\' ++ for candidate_regex in '$JAVA_HOME_CANDIDATES' +++ ls -rd /usr/lib/jvm/j2sdk1.7-oracle/jre ++ for candidate_regex in '$JAVA_HOME_CANDIDATES' +++ ls -rd '\' ++ for candidate_regex in '$JAVA_HOME_CANDIDATES' +++ ls -rd /usr/lib/jvm/java-7-oracle-cloudera ++ for candidate in '`ls -rd $candidate_regex 2>/dev/null`' ++ '[' -e /usr/lib/jvm/java-7-oracle-cloudera/bin/java ']' ++ export JAVA_HOME=/usr/lib/jvm/java-7-oracle-cloudera ++ JAVA_HOME=/usr/lib/jvm/java-7-oracle-cloudera ++ break 2 + verify_java_home + '[' -z /usr/lib/jvm/java-7-oracle-cloudera ']' + echo JAVA_HOME=/usr/lib/jvm/java-7-oracle-cloudera + set -x + echo 'using 5 as CDH_VERSION' + perl -pi -e 's#{{CMF_CONF_DIR}}#/run/cloudera-scm-agent/process/26-sqoop-SQOOP_SERVER#g' /run/cloudera-scm-agent/process/26-sqoop-SQOOP_SERVER/catalina_logging.properties /run/cloudera-scm-agent/process/26-sqoop-SQOOP_SERVER/cloudera-monitor.properties /run/cloudera-scm-agent/process/26-sqoop-SQOOP_SERVER/cloudera-stack-monitor.properties /run/cloudera-scm-agent/process/26-sqoop-SQOOP_SERVER/log4j.properties /run/cloudera-scm-agent/process/26-sqoop-SQOOP_SERVER/sqoop_bootstrap.properties /run/cloudera-scm-agent/process/26-sqoop-SQOOP_SERVER/sqoop.properties + '[' 5 -ge 5 ']' + '[' -z /opt/cloudera/parcels/CDH-5.3.0-1.cdh5.3.0.p0.30/meta/cdh_env.sh ']' + TOMCAT_CONF=/opt/cloudera/parcels/CDH-5.3.0-1.cdh5.3.0.p0.30/lib/sqoop2/../../etc/sqoop2/tomcat-conf.dist + export CATALINA_BASE=/var/lib/sqoop2/tomcat-deployment + CATALINA_BASE=/var/lib/sqoop2/tomcat-deployment + env TOMCAT_CONF=/opt/cloudera/parcels/CDH-5.3.0-1.cdh5.3.0.p0.30/lib/sqoop2/../../etc/sqoop2/tomcat-conf.dist TOMCAT_DEPLOYMENT=/var/lib/sqoop2/tomcat-deployment SQOOP2_HOME=/opt/cloudera/parcels/CDH-5.3.0-1.cdh5.3.0.p0.30/lib/sqoop2 bash /opt/cloudera/parcels/CDH-5.3.0-1.cdh5.3.0.p0.30/lib/sqoop2/tomcat-deployment.sh + export CATALINA_TMPDIR=/run/cloudera-scm-agent/process/26-sqoop-SQOOP_SERVER/temp + CATALINA_TMPDIR=/run/cloudera-scm-agent/process/26-sqoop-SQOOP_SERVER/temp + export CATALINA_OUT=/var/log/sqoop2/sqoop.out + CATALINA_OUT=/var/log/sqoop2/sqoop.out + export CATALINA_PID=/run/cloudera-scm-agent/process/26-sqoop-SQOOP_SERVER/sqoop.pid + CATALINA_PID=/run/cloudera-scm-agent/process/26-sqoop-SQOOP_SERVER/sqoop.pid + OPTIONS='-Xms492830720 -Xmx492830720 -XX:OnOutOfMemoryError=/usr/lib/cmf/service/common/killparent.sh' + OPTIONS='-Xms492830720 -Xmx492830720 -XX:OnOutOfMemoryError=/usr/lib/cmf/service/common/killparent.sh -Dlog4j.configuration=file:////run/cloudera-scm-agent/process/26-sqoop-SQOOP_SERVER/log4j.properties' + OPTIONS='-Xms492830720 -Xmx492830720 -XX:OnOutOfMemoryError=/usr/lib/cmf/service/common/killparent.sh -Dlog4j.configuration=file:////run/cloudera-scm-agent/process/26-sqoop-SQOOP_SERVER/log4j.properties -Dsqoop.config.dir=/run/cloudera-scm-agent/process/26-sqoop-SQOOP_SERVER' + OPTIONS='-Xms492830720 -Xmx492830720 -XX:OnOutOfMemoryError=/usr/lib/cmf/service/common/killparent.sh -Dlog4j.configuration=file:////run/cloudera-scm-agent/process/26-sqoop-SQOOP_SERVER/log4j.properties -Dsqoop.config.dir=/run/cloudera-scm-agent/process/26-sqoop-SQOOP_SERVER -Djava.net.preferIPv4Stack=true' + OPTIONS='-Xms492830720 -Xmx492830720 -XX:OnOutOfMemoryError=/usr/lib/cmf/service/common/killparent.sh -Dlog4j.configuration=file:////run/cloudera-scm-agent/process/26-sqoop-SQOOP_SERVER/log4j.properties -Dsqoop.config.dir=/run/cloudera-scm-agent/process/26-sqoop-SQOOP_SERVER -Djava.net.preferIPv4Stack=true -Dsqoop.http.port=12000' + OPTIONS='-Xms492830720 -Xmx492830720 -XX:OnOutOfMemoryError=/usr/lib/cmf/service/common/killparent.sh -Dlog4j.configuration=file:////run/cloudera-scm-agent/process/26-sqoop-SQOOP_SERVER/log4j.properties -Dsqoop.config.dir=/run/cloudera-scm-agent/process/26-sqoop-SQOOP_SERVER -Djava.net.preferIPv4Stack=true -Dsqoop.http.port=12000 -Dsqoop.admin.port=8005' + export 'CATALINA_OPTS=-Xms492830720 -Xmx492830720 -XX:OnOutOfMemoryError=/usr/lib/cmf/service/common/killparent.sh -Dlog4j.configuration=file:////run/cloudera-scm-agent/process/26-sqoop-SQOOP_SERVER/log4j.properties -Dsqoop.config.dir=/run/cloudera-scm-agent/process/26-sqoop-SQOOP_SERVER -Djava.net.preferIPv4Stack=true -Dsqoop.http.port=12000 -Dsqoop.admin.port=8005 ' + CATALINA_OPTS='-Xms492830720 -Xmx492830720 -XX:OnOutOfMemoryError=/usr/lib/cmf/service/common/killparent.sh -Dlog4j.configuration=file:////run/cloudera-scm-agent/process/26-sqoop-SQOOP_SERVER/log4j.properties -Dsqoop.config.dir=/run/cloudera-scm-agent/process/26-sqoop-SQOOP_SERVER -Djava.net.preferIPv4Stack=true -Dsqoop.http.port=12000 -Dsqoop.admin.port=8005 ' + export LOGGING_CONFIG=-Djava.util.logging.config.file=/run/cloudera-scm-agent/process/26-sqoop-SQOOP_SERVER/catalina_logging.properties + LOGGING_CONFIG=-Djava.util.logging.config.file=/run/cloudera-scm-agent/process/26-sqoop-SQOOP_SERVER/catalina_logging.properties + mkdir -p /run/cloudera-scm-agent/process/26-sqoop-SQOOP_SERVER/temp + EXT_LIBS_DIR=/var/lib/sqoop2 + cp /usr/share/java/mysql-connector-java.jar /var/lib/sqoop2 + cp /usr/share/cmf/lib/postgresql-9.0-801.jdbc4.jar /var/lib/sqoop2 + cp /usr/share/java/oracle-connector-java.jar /var/lib/sqoop2 + '[' '' == upgrade -o '' == create-database ']' + exec /opt/cloudera/parcels/CDH-5.3.0-1.cdh5.3.0.p0.30/lib/bigtop-tomcat/bin/catalina.sh run Jan 22, 2015 8:08:29 AM org.apache.tomcat.util.digester.Digester endElement WARNING: No rules found matching 'HTML/HEAD'. Jan 22, 2015 8:08:29 AM org.apache.tomcat.util.digester.Digester endElement WARNING: No rules found matching 'HTML/BODY/SERVER/LISTENER'. Jan 22, 2015 8:08:29 AM org.apache.tomcat.util.digester.Digester endElement WARNING: No rules found matching 'HTML/BODY/SERVER/LISTENER'. Jan 22, 2015 8:08:29 AM org.apache.tomcat.util.digester.Digester endElement WARNING: No rules found matching 'HTML/BODY/SERVER/LISTENER'. Jan 22, 2015 8:08:29 AM org.apache.tomcat.util.digester.Digester endElement WARNING: No rules found matching 'HTML/BODY/SERVER/LISTENER'. Jan 22, 2015 8:08:29 AM org.apache.tomcat.util.digester.Digester endElement WARNING: No rules found matching 'HTML/BODY/SERVER/LISTENER'. Jan 22, 2015 8:08:29 AM org.apache.tomcat.util.digester.Digester endElement WARNING: No rules found matching 'HTML/BODY/SERVER/GLOBALNAMINGRESOURCES/RESOURCE'. Jan 22, 2015 8:08:29 AM org.apache.tomcat.util.digester.Digester endElement WARNING: No rules found matching 'HTML/BODY/SERVER/GLOBALNAMINGRESOURCES'. Jan 22, 2015 8:08:29 AM org.apache.tomcat.util.digester.Digester endElement WARNING: No rules found matching 'HTML/BODY/SERVER/SERVICE/CONNECTOR'. Jan 22, 2015 8:08:29 AM org.apache.tomcat.util.digester.Digester endElement WARNING: No rules found matching 'HTML/BODY/SERVER/SERVICE/ENGINE/REALM'. Jan 22, 2015 8:08:29 AM org.apache.tomcat.util.digester.Digester endElement WARNING: No rules found matching 'HTML/BODY/SERVER/SERVICE/ENGINE/HOST'. Jan 22, 2015 8:08:29 AM org.apache.tomcat.util.digester.Digester endElement WARNING: No rules found matching 'HTML/BODY/SERVER/SERVICE/ENGINE'. Jan 22, 2015 8:08:29 AM org.apache.tomcat.util.digester.Digester endElement WARNING: No rules found matching 'HTML/BODY/SERVER/SERVICE'. Jan 22, 2015 8:08:29 AM org.apache.tomcat.util.digester.Digester endElement WARNING: No rules found matching 'HTML/BODY/SERVER'. Jan 22, 2015 8:08:29 AM org.apache.tomcat.util.digester.Digester endElement WARNING: No rules found matching 'HTML/BODY'. Jan 22, 2015 8:08:29 AM org.apache.tomcat.util.digester.Digester endElement WARNING: No rules found matching 'HTML'. Jan 22, 2015 8:08:29 AM org.apache.catalina.startup.Catalina load INFO: Initialization processed in 263 ms Jan 22, 2015 8:08:29 AM org.apache.tomcat.util.digester.Digester endElement WARNING: No rules found matching 'HTML/HEAD'. Jan 22, 2015 8:08:29 AM org.apache.tomcat.util.digester.Digester endElement WARNING: No rules found matching 'HTML/BODY/SERVER/LISTENER'. Jan 22, 2015 8:08:29 AM org.apache.tomcat.util.digester.Digester endElement WARNING: No rules found matching 'HTML/BODY/SERVER/LISTENER'. Jan 22, 2015 8:08:29 AM org.apache.tomcat.util.digester.Digester endElement WARNING: No rules found matching 'HTML/BODY/SERVER/LISTENER'. Jan 22, 2015 8:08:29 AM org.apache.tomcat.util.digester.Digester endElement WARNING: No rules found matching 'HTML/BODY/SERVER/LISTENER'. Jan 22, 2015 8:08:29 AM org.apache.tomcat.util.digester.Digester endElement WARNING: No rules found matching 'HTML/BODY/SERVER/LISTENER'. Jan 22, 2015 8:08:29 AM org.apache.tomcat.util.digester.Digester endElement WARNING: No rules found matching 'HTML/BODY/SERVER/GLOBALNAMINGRESOURCES/RESOURCE'. Jan 22, 2015 8:08:29 AM org.apache.tomcat.util.digester.Digester endElement WARNING: No rules found matching 'HTML/BODY/SERVER/GLOBALNAMINGRESOURCES'. Jan 22, 2015 8:08:29 AM org.apache.tomcat.util.digester.Digester endElement WARNING: No rules found matching 'HTML/BODY/SERVER/SERVICE/CONNECTOR'. Jan 22, 2015 8:08:29 AM org.apache.tomcat.util.digester.Digester endElement WARNING: No rules found matching 'HTML/BODY/SERVER/SERVICE/ENGINE/REALM'. Jan 22, 2015 8:08:29 AM org.apache.tomcat.util.digester.Digester endElement WARNING: No rules found matching 'HTML/BODY/SERVER/SERVICE/ENGINE/HOST'. Jan 22, 2015 8:08:29 AM org.apache.tomcat.util.digester.Digester endElement WARNING: No rules found matching 'HTML/BODY/SERVER/SERVICE/ENGINE'. Jan 22, 2015 8:08:29 AM org.apache.tomcat.util.digester.Digester endElement WARNING: No rules found matching 'HTML/BODY/SERVER/SERVICE'. Jan 22, 2015 8:08:29 AM org.apache.tomcat.util.digester.Digester endElement WARNING: No rules found matching 'HTML/BODY/SERVER'. Jan 22, 2015 8:08:29 AM org.apache.tomcat.util.digester.Digester endElement WARNING: No rules found matching 'HTML/BODY'. Jan 22, 2015 8:08:29 AM org.apache.tomcat.util.digester.Digester endElement WARNING: No rules found matching 'HTML'. Jan 22, 2015 8:08:29 AM org.apache.catalina.startup.Catalina load INFO: Initialization processed in 56 ms Jan 22, 2015 8:08:29 AM org.apache.catalina.startup.Catalina start SEVERE: Cannot start server. Server instance is not configured.         ... View more

In attempting to analyze the problem I recreated a similar setup on another hardware. And in this setup Sqoop seems to start properly. The question then becomes how do I analyze the problem? What other logs are relevant? ... View more

Also I should add: - I have tried first by upgrading CDH 5.1.3 to CDH 5.3. When I could not get Sqoop2 to work I performed a full CDH install. - All the other services (HDFS, Hive, Hue, HBase, Solr, Spark, Impala)  that I have configured seem to be up and functioning properly. - I have tried to remove the Sqoop2 service and add it again. ... View more