Member since
01-27-2021
9
Posts
3
Kudos Received
2
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
730 | 04-27-2022 11:44 PM | |
1299 | 03-03-2022 10:42 PM |
04-29-2022
02:20 AM
Thank you for the steps. hiveserver2 is up and running, but facing the below still in the hive session: [root@b7-40 ~]# hive SLF4J: Class path contains multiple SLF4J bindings. SLF4J: Found binding in [jar:file:/opt/cloudera/parcels/CDH-7.1.7-1.cdh7.1.7.p1000.24102687/jars/log4j-slf4j-impl-2.17.1.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: Found binding in [jar:file:/opt/cloudera/parcels/CDH-7.1.7-1.cdh7.1.7.p1000.24102687/jars/slf4j-log4j12-1.7.30.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation. SLF4J: Actual binding is of type [org.apache.logging.slf4j.Log4jLoggerFactory] WARNING: Use "yarn jar" to launch YARN applications. SLF4J: Class path contains multiple SLF4J bindings. SLF4J: Found binding in [jar:file:/opt/cloudera/parcels/CDH-7.1.7-1.cdh7.1.7.p1000.24102687/jars/log4j-slf4j-impl-2.17.1.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: Found binding in [jar:file:/opt/cloudera/parcels/CDH-7.1.7-1.cdh7.1.7.p1000.24102687/jars/slf4j-log4j12-1.7.30.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation. SLF4J: Actual binding is of type [org.apache.logging.slf4j.Log4jLoggerFactory] Connecting to jdbc:hive2://b7-33.lab.archivas.com:2181,b7-40.lab.archivas.com:2181,b7-6.lab.archivas.com:2181/default;password=root;serviceDiscoveryMode=zooKeeper;ssl=true;user=root;zooKeeperNamespace=hiveserver2 22/04/29 03:00:25 [main]: WARN jdbc.HiveConnection: Failed to connect to b7-40.lab.archivas.com:10000 22/04/29 03:00:25 [main]: ERROR jdbc.Utils: Unable to read HiveServer2 configs from ZooKeeper Unknown HS2 problem when communicating with Thrift server. Error: Could not open client transport for any of the Server URI's in ZooKeeper: javax.net.ssl.SSLHandshakeException: PKIX path building failed: sun.security.provider.certpath.SunCertPathBuilderException: unable to find valid certification path to requested target (state=08S01,code=0) Beeline version 3.1.3000.7.1.7.1000-141 by Apache Hive beeline> !connect jdbc:hive2://b7-40.lab.archivas.com:10000 Connecting to jdbc:hive2://b7-40.lab.archivas.com:10000 Enter username for jdbc:hive2://b7-40.lab.archivas.com:10000: root Enter password for jdbc:hive2://b7-40.lab.archivas.com:10000: ******** 22/04/29 03:01:22 [main]: WARN jdbc.HiveConnection: Failed to connect to b7-40.lab.archivas.com:10000 Unknown HS2 problem when communicating with Thrift server. Error: Could not open client transport with JDBC Uri: jdbc:hive2://b7-40.lab.archivas.com:10000: Invalid status 21 (state=08S01,code=0) beeline> !connect jdbc:hive2://b7-33.lab.archivas.com:10000 Connecting to jdbc:hive2://b7-33.lab.archivas.com:10000 Enter username for jdbc:hive2://b7-33.lab.archivas.com:10000: root Enter password for jdbc:hive2://b7-33.lab.archivas.com:10000: ******** 22/04/29 03:01:44 [main]: WARN jdbc.HiveConnection: Failed to connect to b7-33.lab.archivas.com:10000 Could not open connection to the HS2 server. Please check the server URI and if the URI is correct, then ask the administrator to check the server status. Error: Could not open client transport with JDBC Uri: jdbc:hive2://b7-33.lab.archivas.com:10000: java.net.ConnectException: Connection refused (Connection refused) (state=08S01,code=0) beeline> !connect jdbc:hive2://b7-40.lab.archivas.com:10002 Connecting to jdbc:hive2://b7-40.lab.archivas.com:10002 Enter username for jdbc:hive2://b7-40.lab.archivas.com:10002: root Enter password for jdbc:hive2://b7-40.lab.archivas.com:10002: ******** 22/04/29 03:02:29 [main]: WARN jdbc.HiveConnection: Failed to connect to b7-40.lab.archivas.com:10002 Unknown HS2 problem when communicating with Thrift server. Error: Could not open client transport with JDBC Uri: jdbc:hive2://b7-40.lab.archivas.com:10002: Invalid status 21 (state=08S01,code=0)
... View more
04-27-2022
11:44 PM
@Meepoljd yes. these calls were made, to get, metadata information from backend db (mysql, postgres) for each request comes in to hms for query processing.
... View more
04-06-2022
01:12 AM
1 Kudo
@drgenious can you share more details on the query executed and log details to check further? this error can happen for multiple reasons like data type, memory etc. it does not show the real reason. attach the trace along with other details requested.
... View more
03-22-2022
10:40 AM
@Ane can you give a try by explicitly mentioning target database before calling CTAS. use <target_database>
... View more
03-08-2022
01:31 AM
@marudhu_ramaiah, Has the reply helped resolve your issue? If so, please mark the appropriate reply as the solution, as it will make it easier for others to find the answer in the future.
... View more
02-21-2022
04:06 AM
issue is more generic. have we have complete stacktrace to see the root cause?
... View more
02-18-2022
01:16 AM
let table hwctest has 2 columns as below, +--------------------------+------------+----------+
| col_name | data_type | comment |
+--------------------------+------------+----------+
| col1 | string | |
| col2 | string | |
| dt | date | |
| | NULL | NULL |
| # Partition Information | NULL | NULL |
| # col_name | data_type | comment |
| dt | date | |
+--------------------------+------------+----------+ getting column name from metadata and stored in temp var, beeline -u "jdbcurl" --showHeader=false --outputformat=csv2 -e "SELECT COLUMN_NAME FROM sys.COLUMNS_V2 c JOIN sys.TBLS a ON c.CD_ID=a.TBL_ID where a.TBL_NAME='hwctest'" | tr "\n" "," > tmp
a=$(cat tmp) Passing col names as variable, beeline -u "jdbcurl" --hivevar colName=${a%?}
.....
0: jdbc:hive2://c2757-node3.coelab.cloudera.c> select case when array_contains(split('${colName}',','),'col1') then 1 else 0
. . . . . . . . . . . . . . . . . . . . . . .> end as type
.....
INFO : Executing command(queryId=hive_20220218082727_46d036f4-7667-485a-a2c9-c5be158292d4): select case when array_contains(split('col1,col2',','),'col1') then 1 else 0
end as type
+-------+
| type |
+-------+
| 1 |
+-------+ replace the value col1 in your case.
... View more
02-17-2022
11:32 PM
can we have complete error stack trace or hs2 logs and version details for reference?
... View more
02-09-2022
04:55 AM
In general, ambari will create that znode by default. we dont need to create manually. logs shows that issue with sasl. we can still create znode manually after logging into zookeeper cli. [root@c2757-node3 ~]# /opt/cloudera/parcels/CDH-7.1.6-1.cdh7.1.6.p0.10506313/lib/zookeeper/bin/zkCli.sh -server c2757-node3.coelab.cloudera.com:2181
/usr/java/jdk1.8.0_232-cloudera/bin/java
Connecting to c2757-node3.coelab.cloudera.com:2181
Welcome to ZooKeeper!
JLine support is enabled
WATCHER::
WatchedEvent state:SyncConnected type:None path:null
[zk: c2757-node3.coelab.cloudera.com:2181(CONNECTED) 0] ls /
[confstore, hbase, hiveserver2, kafka, rmstore, solr-infra, zookeeper]
[zk: c2757-node3.coelab.cloudera.com:2181(CONNECTED) 1] ls /hiveserver2
[serverUri=c2757-node3.coelab.cloudera.com:10000;version=3.1.3000.7.1.6.0-297;sequence=0000000024]
[zk: c2757-node3.coelab.cloudera.com:2181(CONNECTED) 7] create /sample
Created /sample
[zk: c2757-node3.coelab.cloudera.com:2181(CONNECTED) 8] ls /
[confstore, hbase, hiveserver2, kafka, rmstore, sample, solr-infra, zookeeper]
... View more