question Re: HiveServer2, automatically shutdown ? in Support Questions

HiveServer2, automatically shutdown ?

sshringi003 — Tue, 09 Oct 2018 12:20:34 GMT

Hi,

I installed HiveServer2 on ambari 2.6. Whlie accessing hive through terminal or webUI, its not working. The error is comming Error: Could not open client transport with JDBC Url: jdbc:hive2://ip:10000/transportMode=binary:Java.net.ConnectionException (Connection Refused).

SET hive.exec.dynamic.partition = true;
SET hive.exec.dynamic.partition.mode = nonstrict;
SET hive.exec.max.dynamic.partitions = 10000;
SET hive.exec.max.dynamic.partitions.pernode = 1000;

these are the configuration which is available on config file.

Could anybody help regarding this issue would be great.

Thanks.

Re: HiveServer2, automatically shutdown ?

jsensharma — Tue, 09 Oct 2018 12:25:52 GMT

@Surendra Shringi

Are you able to do Telnet on the HS2 Hostname & Port?

From Hive Client host

# telnet $HS2_HOSTNAME  10000
(OR)
# nc -v $HS2_HOSTNAME  10000

On the HS2 host can you please check if the port 10000 is listening and bound properly and the IP tables is disabled?

# netstat -tnlpa | grep 10000
# service iptables stop

Also please restart HS2 and then see if you find any Errors in the HS2 log?

# ls -l /var/log/hive/hiveserver2.log

Also can you please try with the Zookeeper based dynamic URLs? Like following to see if it works?

# beeline -n barney -p bedrock -u "jdbc:hive2://m1.hdp.local:2181,m2.hdp.local:2181,m3.hdp.local:2181/<db>"

https://community.hortonworks.com/articles/4103/hiveserver2-jdbc-connection-url-examples.html

Re: HiveServer2, automatically shutdown ?

sshringi003 — Tue, 09 Oct 2018 14:06:32 GMT

@Jay Kumar SenSharma

Thanks for your quick reply.

I tried telnet $HS 10000 and nc -v $HS 10000, but nothing is coming.

When i run the command "nc -v $HS Host 10000", i got only this Ncat: Version 7.50 ( https://nmap.org/ncat )
Ncat: Connection refused.

Then tried

netstat -tnlpa | grep 10000 but nothing is coming.

When i run i got below error

ls -l /var/log/hive/hiveserver2.log

Caused by: org.apache.hadoop.yarn.exceptions.InvalidResourceRequestException: Invalid resource request, requested memory < 0, or requested memory > max configured, requestedMemory=10096, maxMemory=7936.

Could you pls let me know more about it.

Re: HiveServer2, automatically shutdown ?

jsensharma — Tue, 09 Oct 2018 14:19:13 GMT

@Surendra Shringi

Looks like a Tuning issue. Here we see that the "Requested Memory" is More than the "Max Memory".

requestedMemory=10096, maxMemory=7936.

Please refer to the following Support KB to know more about this kind of error:

https://community.hortonworks.com/content/supportkb/48814/resource-manager-unable-to-start.html

Re: HiveServer2, automatically shutdown ?

sshringi003 — Tue, 09 Oct 2018 14:26:23 GMT

Its working fine now . Thank you @Jay Kumar SenSharma