Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

HiveServer2, automatically shutdown ?

Solved Go to solution
Highlighted

HiveServer2, automatically shutdown ?

New Contributor

Hi,

I installed HiveServer2 on ambari 2.6. Whlie accessing hive through terminal or webUI, its not working. The error is comming Error: Could not open client transport with JDBC Url: jdbc:hive2://ip:10000/transportMode=binary:Java.net.ConnectionException (Connection Refused).

SET hive.exec.dynamic.partition = true;
SET hive.exec.dynamic.partition.mode = nonstrict;
SET hive.exec.max.dynamic.partitions = 10000;
SET hive.exec.max.dynamic.partitions.pernode = 1000;

these are the configuration which is available on config file.

Could anybody help regarding this issue would be great.

Thanks.

1 ACCEPTED SOLUTION

Accepted Solutions

Re: HiveServer2, automatically shutdown ?

Super Mentor

@Surendra Shringi

Looks like a Tuning issue. Here we see that the "Requested Memory" is More than the "Max Memory".

requestedMemory=10096, maxMemory=7936.

.

Please refer to the following Support KB to know more about this kind of error:

https://community.hortonworks.com/content/supportkb/48814/resource-manager-unable-to-start.html

4 REPLIES 4

Re: HiveServer2, automatically shutdown ?

Super Mentor

@Surendra Shringi

Are you able to do Telnet on the HS2 Hostname & Port?

From Hive Client host

# telnet $HS2_HOSTNAME  10000
(OR)
# nc -v $HS2_HOSTNAME  10000

.

On the HS2 host can you please check if the port 10000 is listening and bound properly and the IP tables is disabled?

# netstat -tnlpa | grep 10000
# service iptables stop

.

Also please restart HS2 and then see if you find any Errors in the HS2 log?

# ls -l /var/log/hive/hiveserver2.log

.

Also can you please try with the Zookeeper based dynamic URLs? Like following to see if it works?

# beeline -n barney -p bedrock -u "jdbc:hive2://m1.hdp.local:2181,m2.hdp.local:2181,m3.hdp.local:2181/<db>"

https://community.hortonworks.com/articles/4103/hiveserver2-jdbc-connection-url-examples.html


Re: HiveServer2, automatically shutdown ?

New Contributor

@Jay Kumar SenSharma

Thanks for your quick reply.

I tried telnet $HS 10000 and nc -v $HS 10000, but nothing is coming.

When i run the command "nc -v $HS Host 10000", i got only this Ncat: Version 7.50 ( https://nmap.org/ncat )
Ncat: Connection refused.

Then tried

netstat -tnlpa | grep 10000 but nothing is coming.

When i run i got below error

ls -l /var/log/hive/hiveserver2.log

Caused by: org.apache.hadoop.yarn.exceptions.InvalidResourceRequestException: Invalid resource request, requested memory < 0, or requested memory > max configured, requestedMemory=10096, maxMemory=7936.

Could you pls let me know more about it.

Re: HiveServer2, automatically shutdown ?

Super Mentor

@Surendra Shringi

Looks like a Tuning issue. Here we see that the "Requested Memory" is More than the "Max Memory".

requestedMemory=10096, maxMemory=7936.

.

Please refer to the following Support KB to know more about this kind of error:

https://community.hortonworks.com/content/supportkb/48814/resource-manager-unable-to-start.html

Re: HiveServer2, automatically shutdown ?

New Contributor

Its working fine now . Thank you @Jay Kumar SenSharma