Created 05-19-2016 04:23 PM
Hi,
We are trying to use Squirrel as a SQL client against Hive with HDP2.3.2 secured cluster. But the connection fails with the following error message:
java.lang.RuntimeException: Illegal Hadoop Version: Unknown (expected A.B.* format)
Detailed log stack below :
2016-05-19 10:59:34,902 [pool-5-thread-1] INFO org.apache.hive.jdbc.Utils - Supplied authorities: <<server_name>>:10000 2016-05-19 10:59:34,902 [pool-5-thread-1] INFO org.apache.hive.jdbc.Utils - Resolved authority: <<server_name>>:10000 2016-05-19 10:59:34,915 [pool-5-thread-1] INFO net.sourceforge.squirrel_sql.fw.util.log.SystemOutToLog - SLF4J: Failed to load class "org.slf4j.impl.StaticLoggerBinder". 2016-05-19 10:59:34,915 [pool-5-thread-1] INFO net.sourceforge.squirrel_sql.fw.util.log.SystemOutToLog - SLF4J: Defaulting to no-operation (NOP) logger implementation 2016-05-19 10:59:34,915 [pool-5-thread-1] INFO net.sourceforge.squirrel_sql.fw.util.log.SystemOutToLog - SLF4J: See http://www.slf4j.org/codes.html#StaticLoggerBinder for further details. 2016-05-19 10:59:34,922 [pool-5-thread-1] WARN org.apache.hadoop.util.VersionInfo - Could not read 'common-version-info.properties', java.io.IOException: Resource not found java.io.IOException: Resource not found at org.apache.hadoop.util.VersionInfo.<init>(VersionInfo.java:49) at org.apache.hadoop.util.VersionInfo.<clinit>(VersionInfo.java:99) at org.apache.hadoop.hive.shims.ShimLoader.getMajorVersion(ShimLoader.java:160) at org.apache.hadoop.hive.shims.ShimLoader.loadShims(ShimLoader.java:139) at org.apache.hadoop.hive.shims.ShimLoader.getHadoopThriftAuthBridge(ShimLoader.java:125) at org.apache.hive.service.auth.KerberosSaslHelper.getKerberosTransport(KerberosSaslHelper.java:54) at org.apache.hive.jdbc.HiveConnection.createBinaryTransport(HiveConnection.java:451) at org.apache.hive.jdbc.HiveConnection.openTransport(HiveConnection.java:207) at org.apache.hive.jdbc.HiveConnection.<init>(HiveConnection.java:180) at org.apache.hive.jdbc.HiveDriver.connect(HiveDriver.java:105) at net.sourceforge.squirrel_sql.fw.sql.SQLDriverManager.getConnection(SQLDriverManager.java:133) at net.sourceforge.squirrel_sql.client.mainframe.action.OpenConnectionCommand.executeConnect(OpenConnectionCommand.java:167) at net.sourceforge.squirrel_sql.client.mainframe.action.OpenConnectionCommand.access$000(OpenConnectionCommand.java:45) at net.sourceforge.squirrel_sql.client.mainframe.action.OpenConnectionCommand$1.run(OpenConnectionCommand.java:104) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 2016-05-19 10:59:34,924 [AWT-EventQueue-1] DEBUG net.sourceforge.squirrel_sql.client.gui.db.ConnectToAliasCallBack - java.util.concurrent.ExecutionException 2016-05-19 10:59:34,924 [AWT-EventQueue-1] ERROR net.sourceforge.squirrel_sql.client.gui.db.ConnectToAliasCallBack - Unexpected Error occurred attempting to open an SQL connection. java.util.concurrent.ExecutionException: java.lang.RuntimeException: java.lang.RuntimeException: Illegal Hadoop Version: Unknown (expected A.B.* format) at java.util.concurrent.FutureTask.report(FutureTask.java:122) at java.util.concurrent.FutureTask.get(FutureTask.java:206) at net.sourceforge.squirrel_sql.client.mainframe.action.OpenConnectionCommand.awaitConnection(OpenConnectionCommand.java:132) at net.sourceforge.squirrel_sql.client.mainframe.action.OpenConnectionCommand.access$100(OpenConnectionCommand.java:45) at net.sourceforge.squirrel_sql.client.mainframe.action.OpenConnectionCommand$2.run(OpenConnectionCommand.java:115) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) Caused by: java.lang.RuntimeException: java.lang.RuntimeException: Illegal Hadoop Version: Unknown (expected A.B.* format) at net.sourceforge.squirrel_sql.client.mainframe.action.OpenConnectionCommand.executeConnect(OpenConnectionCommand.java:175) at net.sourceforge.squirrel_sql.client.mainframe.action.OpenConnectionCommand.access$000(OpenConnectionCommand.java:45) at net.sourceforge.squirrel_sql.client.mainframe.action.OpenConnectionCommand$1.run(OpenConnectionCommand.java:104) ... 5 more Caused by: java.lang.RuntimeException: Illegal Hadoop Version: Unknown (expected A.B.* format) at org.apache.hadoop.hive.shims.ShimLoader.getMajorVersion(ShimLoader.java:164) at org.apache.hadoop.hive.shims.ShimLoader.loadShims(ShimLoader.java:139) at org.apache.hadoop.hive.shims.ShimLoader.getHadoopThriftAuthBridge(ShimLoader.java:125) at org.apache.hive.service.auth.KerberosSaslHelper.getKerberosTransport(KerberosSaslHelper.java:54) at org.apache.hive.jdbc.HiveConnection.createBinaryTransport(HiveConnection.java:451) at org.apache.hive.jdbc.HiveConnection.openTransport(HiveConnection.java:207) at org.apache.hive.jdbc.HiveConnection.<init>(HiveConnection.java:180) at org.apache.hive.jdbc.HiveDriver.connect(HiveDriver.java:105) at net.sourceforge.squirrel_sql.fw.sql.SQLDriverManager.getConnection(SQLDriverManager.java:133) at net.sourceforge.squirrel_sql.client.mainframe.action.OpenConnectionCommand.executeConnect(OpenConnectionCommand.java:167) ... 7 more
--------------------------------------------------------------------------------------------------------------------------------------------------------------
Here is our JDBC connect string:
jdbc:hive2://servername:10000/default;principal=hive/servername.com@HADOOPPROD.LOCAL;auth-kerberos
Here are our jars in the extra classpath section:
hadoop-common-2.7.1.2.3.2.0-2950.jar
hive-jdbc-1.2.1.2.3.2.0-2950-standalone.jar
We get the same error even if we do the same with DBVIsualizer.
Thanks
Created 05-19-2016 07:08 PM
Able to resolve the issue after following the instructions in this link.
https://hortonworks.my.salesforce.com/kA1E0000000fyL5?lang=en_US&popup=true&caseId=500E000000Z4YaH
-Datta
Created 05-19-2016 07:08 PM
Able to resolve the issue after following the instructions in this link.
https://hortonworks.my.salesforce.com/kA1E0000000fyL5?lang=en_US&popup=true&caseId=500E000000Z4YaH
-Datta
Created 06-08-2016 12:08 AM
This links to a password protected page, could you include the instructions in your answer?
Created 07-26-2016 12:57 PM
Also would like to see this doc - can someone post the instructions. I cant access that link. Thanks.
Created 12-22-2016 03:18 PM
Have a look at this article. While it discusses DbVisualizer not SQuirreL, the underlying problem and solution was the same.