Member since
08-07-2018
5
Posts
0
Kudos Received
0
Solutions
08-22-2018
08:35 AM
Hi @Vinicius Higa Murakami, That worked. After installing the hive interact module i was able to create the external table. Thank you so much! Sorry for the late response but i went on vacation 😛
... View more
08-10-2018
08:16 AM
Hi @Vinicius Higa Murakami, thanks for your responses once again. i'm able to create tables without the druidstoragehandler. as you recommended i enabled the DEBUG logging level and those are the informations i could retrieve from the logs: hive-server2.log: WARN: Establishing SSL connection without server's identity verification is not recommended. According to MySQL 5.5.45+, 5.6.26+ and 5.7.6+ requirements SSL connection must be established by default if explicit option isn't set. For compliance with existing applications not using SSL the verifyServerCertificate property is set to 'false'. You need either to explicitly disable SSL by setting useSSL=false, or set useSSL=true and provide truststore for server certificate verification I dunno if this can be of any help, but that's the only warning there is in the file hivemetastore.log 2018-08-10 07:11:37,134 ERROR [Thread-18]: bonecp.ConnectionHandle (ConnectionHandle.java:markPossiblyBroken(388)) - Database access problem. Killing off this connection and all remaining connections in the connection pool. SQL State = 08S01
2018-08-10 07:11:37,135 ERROR [Thread-18]: txn.TxnHandler (TxnHandler.java:getDbConn(1978)) - There is a problem with a connection from the pool, retrying(rc=9): Communications link failure
The last packet successfully received from the server was 15,572 milliseconds ago. The last packet sent successfully to the server was 12 milliseconds ago. (SQLState=08S01, ErrorCode=0)
com.mysql.jdbc.exceptions.jdbc4.CommunicationsException: Communications link failure
The last packet successfully received from the server was 15,572 milliseconds ago. The last packet sent successfully to the server was 12 milliseconds ago.
at sun.reflect.GeneratedConstructorAccessor67.newInstance(Unknown Source)
...
at org.apache.hadoop.hive.ql.txn.compactor.Cleaner.run(Cleaner.java:81)
Caused by: java.io.EOFException: Can not read response from server. Expected to read 4 bytes, read 0 bytes before connection was unexpectedly lost.
at com.mysql.jdbc.MysqlIO.readFully(MysqlIO.java:3011)
at com.mysql.jdbc.MysqlIO.reuseAndReadPacket(MysqlIO.java:3469)
... 10 more
2018-08-10 07:11:37,164 ERROR [BoneCP-pool-watch-thread]: bonecp.BoneCP (BoneCP.java:obtainInternalConnection(292)) - Failed to acquire connection to jdbc:mysql://sandbox-hdp.hortonworks.com/hive?createDatabaseIfNotExist=true. Sleeping for 7000 ms. Attempts left: 5
com.mysql.jdbc.exceptions.jdbc4.CommunicationsException: Communications link failure<br> this is the error where the connection fails, but i didn't have any luck googling the error. Maybe you guys have seen this in the past. Thanks
... View more
08-09-2018
08:05 AM
Hi @Vinicius Higa Murakami, i tried to use your connection string and tried to create the external table, but the same errors occurs. Error: org.apache.thrift.transport.TTransportException (state=08S01,code=0 As stated in the original post it breaks every successive query. Thanks
... View more
08-08-2018
06:29 AM
Hi @Vinicius Higa Murakami, thanks for your reply. My mysqld daemon is up and running. I am able to connect to hive without ZK: 0: jdbc:hive2://sandbox-hdp.hortonworks.com:1> show tables;
+-----------+--+
| tab_name |
+-----------+--+
+-----------+--+
No rows selected (0.375 seconds) and those are the metastore properties: hive.conf.hidden.list=javax.jdo.option.ConnectionPassword,hive.server2.keystore.password
javax.jdo.option.ConnectionDriverName=com.mysql.jdbc.Driver
javax.jdo.option.ConnectionURL=jdbc:mysql://sandbox-hdp.hortonworks.com/hive?createDatabaseIfNotExist=true
javax.jdo.option.ConnectionUserName=root
javax.jdo.option.DetachAllOnCommit=true
javax.jdo.option.Multithreaded=true
javax.jdo.option.NonTransactionalRead=true
Any idea? Thanks
... View more
08-07-2018
01:41 PM
I have the wikiticker database already set up on druid, and i want to access it with hive. My environment is a HDP 2.6.5 sanbox on vmware i'm connecting to hive2 using beeline, and those are the commands i use: !connect jdbc:hive2://sandbox-hdp.hortonworks.com:2181/;serviceDiscoveryMode=zooKeeper;zooKeeperNamespace=hiveserver2
add jar /usr/hdp/2.6.5.0-292/hive2/lib/hive-druid-handler.jar;
CREATE EXTERNAL TABLE druid_table_1
STORED BY 'org.apache.hadoop.hive.druid.DruidStorageHandler'
TBLPROPERTIES ("druid.datasource" = "wikiticker"); The error i get is: Error: org.apache.thrift.transport.TTransportException (state=08S01,code=0) After that, every command i type gives the same error, even "show tables". In hiveserver2.log i found those lines: 2018-08-07 13:11:36,622 ERROR [HiveServer2-Background-Pool: Thread-22099]: bonecp.ConnectionHandle (ConnectionHandle.java:markPossiblyBroken(388)) - Database access problem. Killing off this connection and all remaining connections in the connection pool. SQL State = 08S01
2018-08-07 13:11:36,622 ERROR [HiveServer2-Background-Pool: Thread-22099]: txn.TxnHandler (TxnHandler.java:getDbConn(1978)) - There is a problem with a connection from the pool, retrying(rc=9): Communications link failure I get the same error using the Hive View 2.0 in Ambari. Thanks
... View more
Labels:
- Labels:
-
Apache Hive