Announcements
Check out our newest addition to the community, the Cloudera Data Analytics (CDA) group hub.
AlonEldi
Explorer

Unable to view yarn Application log when the clust...

by Explorer in Support Questions
‎08-22-2017 10:05 AM
‎08-22-2017 10:05 AM
Hi ,   Our cluster is using private IP's for the nodes inteconnect and public IP's to access each node .   I had issues with HUE and enabled the parameter Bind Hue Server to Wildcard Address   Now I have problems with the YARN Application logs which I get the error "This site can’t be reached"   Enabled all Bind variabled under HDFS and YARN : - Bind JobHistory Server to Wildcard Address - Bind ResourceManager to Wildcard Address - Bind DataNode to Wildcard Address - Bind JournalNode to Wildcard Address - Bind NameNode to Wildcard Address - Bind SecondaryNameNode to Wildcard Address   still can not view application logs and getting the same error .   Its should be an easy way out to be able to work with private and public IP's 🙂   Do I miss anything here ?   Many Thanks   Alon ... View more
Labels:

Re: HDFS Name node high avaliability

by Explorer in Support Questions
‎08-03-2017 07:22 AM
‎08-03-2017 07:22 AM
Thanks 🙂   Checked the logs got the message :   java.net.ConnectException: Call From gc-test-impala28-03.c.bi-environment-1271.internal/10.128.0.46 to gc-test-impala28-03.c.bi-environment-1271.internal:8022 failed on connection exception: java.net.ConnectException: Connection refused; For more details see: " http://wiki.apache.org/hadoop/ConnectionRefused"   it seems that for some reason it could not connect to the second name node port 8022 .   Checked if port is listening and got :   root@gc-test-impala28-03:~# netstat -tulpan | grep 8022 tcp        0      1 10.128.0.46:44608       10.128.0.45:8022        SYN_SENT    16026/java   Any Idea ?   Thanks   Alon ... View more

Re: HDFS Name node high avaliability

by Explorer in Support Questions
‎07-31-2017 10:11 PM
‎07-31-2017 10:11 PM
Hi , Thanks for the quick reply .   I used the following instructions :   https://www.cloudera.com/documentation/enterprise/5-8-x/topics/cdh_hag_hdfs_ha_enabling.html#topic_2_3   The service name is nameservice1 (the default) combined from node 4 (active) and node 3(standby)   as I mentioned when shutting down node 4 it seems that the name service is still looking for node 4 . otherwise it not clear why I'm getting this error .   If it was possible I would add screen shots to the post .   node 3 & 4 roles are : datanode failover controler journal node name node zookeepr node manager hive gateway     The cloudera version is 5.11   Thanks   Alon     ... View more

HDFS Name node high avaliability

by Explorer in Support Questions
‎07-31-2017 07:47 AM
‎07-31-2017 07:47 AM
Hi ,   I have tested Cloudera 5.11 High avaliability active passive with 2 name nodes and noticed that when name node or standby node machines are down the HDFS is not available.   when stoping name node on node 4 getting the error : hadoop fs -ls /user/hive/warehouse/dwh.db/ llegalArgumentException: java.net.UnknownHostException: gc-test-impala28-04.c.bi-environment-1271.internal error 400   Do I miss anything ?   Thanks   Alon       ... View more
Labels:

Re: HDFS Name node high avaliability

by Explorer in Support Questions
‎07-31-2017 07:46 AM
‎07-31-2017 07:46 AM
when stoping name node on node 4 getting the error : llegalArgumentException: java.net.UnknownHostException: gc-test-impala28-04.c.bi-environment-1271.internal error 400 ... View more

HDFS Name node high avaliability

by Explorer in Support Questions
‎07-31-2017 07:42 AM
‎07-31-2017 07:42 AM
Hi ,   I have tested Cloudera 5.11 High avaliability active passive with 2 name nodes and noticed that when name node or standby node machines are down the HDFS is not available.   Do I miss anything ?   Thanks   Alon     ... View more
Labels:

Re: Query Cancel and idle_query_timeout is not wor...

by Explorer in Support Questions
‎07-31-2017 02:21 AM
‎07-31-2017 02:21 AM
Hi ,   Idle session works indeed . I have set it to 1 hour but can not wait 1 hour untill killed queries will be dead .   Work arround that I found is disconnecting from the session after query has been cancelled in the UI .   It should work better .   Thanks   Alon ... View more

Query Cancel and idle_query_timeout is not working

by Explorer in Support Questions
‎07-27-2017 05:48 AM
‎07-27-2017 05:48 AM
Hi ,   We use SQLDX tom cancel query .   When we cancel the query it apears in impalad as waiting to be closed for ages taking resources from the system .   After changing the  parameter idle_query_timeout to 2 minutes , I expected that the canceled query will be canceled after 2 minutes .   and its not .   How it can be sloved .   canceling query from the query monitor does not work at all .   Note we are using HAPROXY and LDAP to connect to Impala .   Please your help .   Thanks   Alon ... View more
Labels:

Re: Python Error 'TSaslClientTransport' object has...

by Explorer in Support Questions
‎07-26-2017 04:40 AM
2 Kudos
‎07-26-2017 04:40 AM
2 Kudos
Solved the problem by reinstalling thrift and impyla with the following versions:   as root :   pip uninstall thrift pip uninstall impyla pip install thrift==0.9.3 pip install impyla==0.13.8   Regards   Alon ... View more

Python Error 'TSaslClientTransport' object has no ...

by Explorer in Support Questions
‎07-26-2017 04:29 AM
‎07-26-2017 04:29 AM
Hi , using Ubuntu 14.0.4 and 16.0.4 unable to work with Impala via Python .   Installed :   pip install impyla apt-get install libsasl2-dev python-dev libldap2-dev libssl-dev pip install thrift_sasl pip install sasl   thrift version install : thrift (0.10.0) thrift-sasl (0.2.1) impyla (0.14.0)   The Example Code ------------------------------ from impala.dbapi import connect conn = connect(host="104.198.200.187", port="25003", user="user", password='pass', auth_mechanism='PLAIN') print "Connected Successfully" cur = conn.cursor()   -------------------------------------------------------------------------------- stack error :   Traceback (most recent call last):   File "/home/alon/PycharmProjects/test/test.py", line 6, in <module>     cur = conn.cursor()   File "/usr/local/lib/python2.7/dist-packages/impala/hiveserver2.py", line 125, in cursor     session = self.service.open_session(user, configuration)   File "/usr/local/lib/python2.7/dist-packages/impala/hiveserver2.py", line 995, in open_session     resp = self._rpc('OpenSession', req)   File "/usr/local/lib/python2.7/dist-packages/impala/hiveserver2.py", line 923, in _rpc     response = self._execute(func_name, request)   File "/usr/local/lib/python2.7/dist-packages/impala/hiveserver2.py", line 940, in _execute     return func(request)   File "/usr/local/lib/python2.7/dist-packages/impala/_thrift_gen/TCLIService/TCLIService.py", line 175, in OpenSession     return self.recv_OpenSession()   File "/usr/local/lib/python2.7/dist-packages/impala/_thrift_gen/TCLIService/TCLIService.py", line 193, in recv_OpenSession     result.read(self._iprot)   File "/usr/local/lib/python2.7/dist-packages/impala/_thrift_gen/TCLIService/TCLIService.py", line 1109, in read     fastbinary.decode_binary(self, iprot.trans, (self.__class__, self.thrift_spec)) AttributeError: 'TSaslClientTransport' object has no attribute 'trans'   dont know what is going wrong here .   Thanks   Alon     ... View more
Labels:
Contact Me
Online
Offline
Last Visited
‎08-22-2017 01:25 PM
Public Statistics
Date Registered ‎04-03-2017 06:58 AM
Last Visited ‎08-22-2017 01:25 PM
Total Messages Posted 23
Total Kudos Received 3