Archives of Support Questions (Read Only)

This is an archived board for historical reference. Information and links may no longer be available or relevant
Announcements
This board is archived and read-only for historical reference. To ask a new question, please post a new topic on the appropriate active board.

HiveServer2, automatically shutdown ?

avatar
Rising Star

Hi,

I installed HiveServer2 on ambari 2.6. Whlie accessing hive through terminal or webUI, its not working. The error is comming Error: Could not open client transport with JDBC Url: jdbc:hive2://ip:10000/transportMode=binary:Java.net.ConnectionException (Connection Refused).

SET hive.exec.dynamic.partition = true;
SET hive.exec.dynamic.partition.mode = nonstrict;
SET hive.exec.max.dynamic.partitions = 10000;
SET hive.exec.max.dynamic.partitions.pernode = 1000;

these are the configuration which is available on config file.

Could anybody help regarding this issue would be great.

Thanks.

1 ACCEPTED SOLUTION

avatar
Master Mentor

@Surendra Shringi

Looks like a Tuning issue. Here we see that the "Requested Memory" is More than the "Max Memory".

requestedMemory=10096, maxMemory=7936.

.

Please refer to the following Support KB to know more about this kind of error:

https://community.hortonworks.com/content/supportkb/48814/resource-manager-unable-to-start.html

View solution in original post

4 REPLIES 4

avatar
Master Mentor

@Surendra Shringi

Are you able to do Telnet on the HS2 Hostname & Port?

From Hive Client host

# telnet $HS2_HOSTNAME  10000
(OR)
# nc -v $HS2_HOSTNAME  10000

.

On the HS2 host can you please check if the port 10000 is listening and bound properly and the IP tables is disabled?

# netstat -tnlpa | grep 10000
# service iptables stop

.

Also please restart HS2 and then see if you find any Errors in the HS2 log?

# ls -l /var/log/hive/hiveserver2.log

.

Also can you please try with the Zookeeper based dynamic URLs? Like following to see if it works?

# beeline -n barney -p bedrock -u "jdbc:hive2://m1.hdp.local:2181,m2.hdp.local:2181,m3.hdp.local:2181/<db>"

https://community.hortonworks.com/articles/4103/hiveserver2-jdbc-connection-url-examples.html


avatar
Rising Star

@Jay Kumar SenSharma

Thanks for your quick reply.

I tried telnet $HS 10000 and nc -v $HS 10000, but nothing is coming.

When i run the command "nc -v $HS Host 10000", i got only this Ncat: Version 7.50 ( https://nmap.org/ncat )
Ncat: Connection refused.

Then tried

netstat -tnlpa | grep 10000 but nothing is coming.

When i run i got below error

ls -l /var/log/hive/hiveserver2.log

Caused by: org.apache.hadoop.yarn.exceptions.InvalidResourceRequestException: Invalid resource request, requested memory < 0, or requested memory > max configured, requestedMemory=10096, maxMemory=7936.

Could you pls let me know more about it.

avatar
Master Mentor

@Surendra Shringi

Looks like a Tuning issue. Here we see that the "Requested Memory" is More than the "Max Memory".

requestedMemory=10096, maxMemory=7936.

.

Please refer to the following Support KB to know more about this kind of error:

https://community.hortonworks.com/content/supportkb/48814/resource-manager-unable-to-start.html

avatar
Rising Star

Its working fine now . Thank you @Jay Kumar SenSharma