Support Questions
Find answers, ask questions, and share your expertise

Spark connection issue in CI/CD build

Explorer

Hello All,

 

I am facing issue in my master build after switching from HDP 2.6.3 to HDP 3.1.4

 

 

Error: ERROR c.d.product.utils.MyProductNameAssertion - org.apache.commons.dbcp.SQLNestedException: Cannot create PoolableConnectionFactory (Could not open client transport with JDBC Uri: jdbc:hive2://hdp-slave.mydomain.com:10016/foodmart: Could not establish connection to jdbc:hive2://hdp-slave.mydomain.com:10016/foodmart: Required field 'client_protocol' is unset! Struct:TOpenSessionReq(client_protocol:null, configuration:{use:database=foodmart}))

 

 

 

Description: This error is for Spark connection in my master build.

I tried changing the 'hiveVersion' property in build.gradle of myproduct-sql and swift module from 2.1.0 to 3.1.0, but that did not work.

 

hive jars on my nexus:

[root@nexus2 ~]# find / -name "*.jar" | grep jdbc | grep hive
/opt/sonatype-work/nexus/storage/thirdparty/.nexus/trash/.nexus/attributes/org/apache/hive/hive-jdbc/0.13.1-cdh5.3.0/hive-jdbc-0.13.1-cdh5.3.0-cdh5.3.0.jar
/opt/sonatype-work/nexus/storage/thirdparty/.nexus/trash/org/apache/hive/hive-jdbc/0.13.1-cdh5.3.0/hive-jdbc-0.13.1-cdh5.3.0-cdh5.3.0.jar
/opt/sonatype-work/nexus/storage/thirdparty/m2/repository/org/apache/hive/hive-jdbc/0.14.0/hive-jdbc-0.14.0.jar
/opt/sonatype-work/nexus/storage/thirdparty/m2/repository/org/apache/hive/hive-jdbc/1.1.0/hive-jdbc-1.1.0.jar


/opt/sonatype-work/nexus/storage/thirdparty/m2/repository/org/apache/hive/hive-jdbc/1.1.0-cdh5.16.99/hive-jdbc-1.1.0-cdh5.16.99.jar

 

Any hints how to fix this issue? Thanks.

0 REPLIES 0