Cloudera Community
liana_napalkova
user rank
Contributor

HiveServer2: Could not open client transport with ...

by Contributor in Support Questions
‎04-14-2018 04:34 PM
1 Kudo
‎04-14-2018 04:34 PM
1 Kudo
I have problems with HiveServer2 in Ambari. When I start the service, HiveServer2 runs during several minutes and then the service gets stopped. Connection failed on host eureambarislave1.local.eurecat.org:10000 (Traceback (most recent call last): File "/var/lib/ambari-agent/cache/common-services/HIVE/0.12.0.2.0/package/alerts/alert_hive_thrift_port.py", line 212, in execute ldap_password=ldap_password) File "/usr/lib/python2.6/site-packages/resource_management/libraries/functions/hive_check.py", line 81, in check_thrift_port_sa... I tried to execute the beeline command from terminal: [root@eureambarislave1 hive]# beeline -u jdbc:hive2://eureambarislave1.local.eurecat.org:10000/;transportMode=binary Connecting to jdbc:hive2://eureambarislave1.local.eurecat.org:10000/ 18/04/14 16:24:17 [main]: WARN jdbc.HiveConnection: Failed to connect to eureambarislave1.local.eurecat.org:10000 Error: Could not open client transport with JDBC Uri: jdbc:hive2://eureambarislave1.local.eurecat.org:10000/: java.net.ConnectException: Connection refused (Connection refused) (state=08S01,code=0) Beeline version 1.2.1000.2.6.4.0-91 by Apache Hive 0: jdbc:hive2://eureambarislave1.local.eureca (closed)> Also I tried to start HiveServer2 manually, but it gets stuck at "nohup: ignoring input and appending output to ‘nohup.out’": [root@eureambarislave1 hive]# su $HIVE_USER [root@eureambarislave1 hive]# nohup /usr/hdp/current/hive-server2/bin/hiveserver2 -hiveconf hive.metastore.uris=/tmp/hiveserver2HD.out 2 /tmp/hiveserver2HD.log nohup: ignoring input and appending output to ‘nohup.out’ Finally I checked the port 10000, but there is no output: [root@eureambarislave1 hive]# netstat -tnlpa | grep 10000 This is the output of HiveServer2 logs: 2018-04-14 08:53:52,032 INFO [main]: server.HiveServer2 (HiveStringUtils.java:startupShutdownMessage(693)) - STARTUP_MSG: /************************************************************ STARTUP_MSG: Starting HiveServer2 STARTUP_MSG: host = eureambarislave1.local.eurecat.org/192.168.0.10 STARTUP_MSG: args = [--hiveconf, hive.aux.jars.path=file:///usr/hdp/current/hive-webhcat/share/hcatalog/hive-hcatalog-core.jar, -hiveconf, hive.metastore.uris= , -hiveconf, hive.log.file=hiveserver2.log, -hiveconf, hive.log.dir=/var/log/hive] STARTUP_MSG: version = 1.2.1000.2.6.4.0-91 ... View more
Labels:

Re: ResourceManager is started with alerts and ip:...

by Contributor in Support Questions
‎04-14-2018 09:06 AM
‎04-14-2018 09:06 AM
I found ResourceManager logs in "/var/log/hadoop-yarn" 2018-04-12 22:41:29,700 INFO resourcemanager.ResourceManager (LogAdapter.java:info(45)) - STARTUP_MSG: /************************************************************ STARTUP_MSG: Starting ResourceManager STARTUP_MSG: user = yarn STARTUP_MSG: host = eureambarislave1.local.eurecat.org/192.168.0.10 STARTUP_MSG: args = [] STARTUP_MSG: version = 2.7.3.2.6.4.0-91 ... View more

ResourceManager is started with alerts and ip:8088...

by Contributor in Support Questions
‎04-14-2018 09:01 AM
‎04-14-2018 09:01 AM
I installed Ambari, but cannot start ResourceManager. I followed different indications that I found in this forum, but nothing helped so far. In particular, UI shows the following error : "Connection failed to http://eureambarislave1.local.eurecat.org:8088 (<urlopen error [Errno 111] Connection refused>)" But the port 8088 is opened and proxy is setup. The output of "jps" in ResourceManager host: # jps 9953 QuorumPeerMain 15683 RMAdminCLI 17508 NodeManager 15813 RMAdminCLI 19881 RunJar 11435 RMAdminCLI 4428 RunJar 16428 RMAdminCLI 23535 SecondaryNameNode 11760 RMAdminCLI 19313 Jps 5811 RunJar 15923 RMAdminCLI 16053 RMAdminCLI 11319 RMAdminCLI 17241 ApplicationHistoryServer 27546 JobHistoryServer 11675 RMAdminCLI 22687 DataNode 11519 RMAdminCLI Is it fine that I have so many processes of "RMAdminCLI"? Also, I cannot open http://xxx.xx.xx.xx:8088 in the browser. ... View more

Re: Private and public IP's of hosts are messed up...

by Contributor in Support Questions
‎04-14-2018 08:30 AM
‎04-14-2018 08:30 AM
Ok, I restarted ambari agents in all hosts (including the master host) and now IP are listed correctly. Thanks! ResourceManager and HiverServer2 still do not work. I will revise logs and open a new issue, if needed. ... View more

Re: Private and public IP's of hosts are messed up...

by Contributor in Support Questions
‎04-14-2018 08:17 AM
‎04-14-2018 08:17 AM
No, I am building my cluster in OpenStack (centos 7). Master # cat /etc/hosts 127.0.0.1 localhost localhost.localdomain localhost4 localhost4.localdomain4 ::1 localhost localhost.localdomain localhost6 localhost6.localdomain6 192.168.0.9 eureambarimaster1.local.eurecat.org eureambarimaster1 192.168.0.10 eureambarislave1.local.eurecat.org eureambarislave1 192.168.0.11 eureambarislave2.local.eurecat.org eureambarislave2 # ifconfig eth0: flags=4163<UP,BROADCAST,RUNNING,MULTICAST> mtu 1450 inet 192.168.0.9 netmask 255.255.255.0 broadcast 192.168.0.255 inet6 fe80::f816:3eff:fe64:9948 prefixlen 64 scopeid 0x20<link> ether fa:16:3e:64:99:48 txqueuelen 1000 (Ethernet) RX packets 4886387 bytes 9326946742 (8.6 GiB) RX errors 0 dropped 0 overruns 0 frame 0 TX packets 3961905 bytes 3114838916 (2.9 GiB) TX errors 0 dropped 0 overruns 0 carrier 0 collisions 0 lo: flags=73<UP,LOOPBACK,RUNNING> mtu 65536 inet 127.0.0.1 netmask 255.0.0.0 inet6 ::1 prefixlen 128 scopeid 0x10<host> loop txqueuelen 1 (Local Loopback) RX packets 4326060 bytes 2524451944 (2.3 GiB) RX errors 0 dropped 0 overruns 0 frame 0 TX packets 4326060 bytes 2524451944 (2.3 GiB) TX errors 0 dropped 0 overruns 0 carrier 0 collisions 0 Slave 1 # cat /etc/hosts 127.0.0.1 localhost localhost.localdomain localhost4 localhost4.localdomain4 ::1 localhost localhost.localdomain localhost6 localhost6.localdomain6 192.168.0.9 eureambarimaster1.local.eurecat.org eureambarimaster1 192.168.0.10 eureambarislave1.local.eurecat.org eureambarislave1 192.168.0.11 eureambarislave2.local.eurecat.org eureambarislave2 Initially I installed Ambari when /etc/hosts was containing public IP's of hosts. In this case most of the services of Ambari were not working. Then I changed IP's to private ones, and most of the services started working (excluding ResourceManager and HiveServer2). Maybe, public IP of a master node was written automatically in some configs? Is it better to completely reinstall Ambari or is there any workaround? ... View more

Private and public IP's of hosts are messed up in ...

by Contributor in Support Questions
‎04-13-2018 09:52 PM
‎04-13-2018 09:52 PM
I have just noticed that private and public IP's are messed up in Ambari UI. I don't understand why the public IP appears next to my master host, while the slave nodes have private IP. Is it correct? If not, how can I fix it? ... View more
Labels:

Re: How to interpret alerts in Ambari UI

by Contributor in Support Questions
‎04-13-2018 09:44 PM
‎04-13-2018 09:44 PM
I only have "hdfs" folder inside "/var/log/hadoop/". I checked all 3 nodes to be sure. ... View more

Re: How to interpret alerts in Ambari UI

by Contributor in Support Questions
‎04-13-2018 09:32 PM
‎04-13-2018 09:32 PM
If it might be relevant: I tried to execute "yarn application -list" from master and hosts, but I get this error: 18/04/13 21:28:14 INFO ipc.Client: Retrying connect to server: eureambarislave1.local.eurecat.org/192.168.0.10:8050. Already tried 6 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=50, sleepTime=1000 MILLISECONDS) Is it related to proxy settings of yarn? Thanks. ... View more

Re: How to interpret alerts in Ambari UI

by Contributor in Support Questions
‎04-13-2018 09:22 PM
‎04-13-2018 09:22 PM
Thanks for your feedback. ResourceManager is only installed in Slave 1 (totally I have 1 master and 2 slaves). Where can I find the logs of RM? According to the space, I attached volume to my nodes in OpenStack. However, I do not see the effect of this change. Is there something else I had to do? ... View more

How to interpret alerts in Ambari UI

by Contributor in Support Questions
‎04-13-2018 07:59 PM
‎04-13-2018 07:59 PM
I almost finished installing Hadoop cluster with Ambari, but still have some issues: 1) Some old alerts appear in the top header. When I click on them, I see that they refer to issues N hours ago. How can I delete these alerts and why do they still appear? 2) I have 1 alert next to Resource Manager, but when I check the date of this alert, I see "for 22 hours". I do not understand if it's something that happens now, or I should ignore these alerts. Also, ResourceManager is installed and started in slave node 1. When I open xxx.xx.xx.xx:8088 in the browser, I do not see anything. The port 8088 is opened and firewall is disabled. No other process is running on port 8088. What do I miss? ... View more
Contact Me
Online
Offline
Last Visited
‎09-05-2018 01:06 PM
Community Statistics
Member Since ‎04-08-2018 02:59 PM
Last Visited ‎09-05-2018 01:06 PM
Posts 64
Kudos received 2