Member since
03-14-2016
4721
Posts
1111
Kudos Received
874
Solutions
My Accepted Solutions
| Title | Views | Posted |
|---|---|---|
| 2717 | 04-27-2020 03:48 AM | |
| 5277 | 04-26-2020 06:18 PM | |
| 4444 | 04-26-2020 06:05 PM | |
| 3567 | 04-13-2020 08:53 PM | |
| 5377 | 03-31-2020 02:10 AM |
06-18-2017
05:04 AM
@Sami Ahmad
Yes, you should set the `no_proxy' variable which should contain a comma-separated list of domain extensions proxy should _not_ be used for. Also from ambari side also you should make sure to set the "-Dhttp.proxyHost" and "-Dhttp.proxyPort" and also for nonProxyHosts to prevent some host names from accessing the proxy server, define the list of excluded hosts, as follows: -Dhttp.nonProxyHosts=<pipe|separated|list|of|hosts>
Please see: https://docs.hortonworks.com/HDPDocuments/Ambari-2.4.0.0/bk_ambari-reference/content/ch_setting_up_an_internet_proxy_server_for_ambari.html
.
... View more
06-18-2017
04:06 AM
@Sateesh Mandumula We see that you are using Kerberized Hive. So you should be defining the Principal in the HiveServer2 connection URL, Something like: jdbc:hive2://<hostname>:10000/<hive_db>;principal=hive/_HOST@EXAMPLE.COM .
... View more
06-18-2017
03:47 AM
1 Kudo
@sneha challa We need to check if the "Port Forwarding" for the port 8888 is present or not? Please check: https://community.hortonworks.com/articles/65914/how-to-add-ports-to-the-hdp-25-virtualbox-sandbox.html - We can also check if we have set the networking mode to host-only on the VirtualBox instance. - If the port forwarding is enabled for 8888 port then we should check if by any chance firewall is not causing any issue. - So please try to do SSH to the sandbox as following (on port 2222 only), Default password should be "hadoop" # ssh root@127.0.0.1 -p 2222 - After doing SSH, please check if the firewall is disabled. # service iptables status
iptables: Firewall is not running.
- Also please check if the port 8888 is opened inside the Sandbox? # netstat -tnlpa | grep 8888 .
... View more
06-17-2017
04:28 PM
@Sateesh Mandumula Looks like the Hive Server JDBC URL is not being set correctly. Can you please refer to the following article to determine the URL: https://community.hortonworks.com/articles/4103/hiveserver2-jdbc-connection-url-examples.html .
... View more
06-17-2017
02:40 PM
1 Kudo
@Sateesh Mandumula Did you try the "HiveServer2 JDBC URL" mentioned in the Hive Service section in the Ambari UI? . By clicking on the copy to clipboard button at the end of the URL you can get the connection url. . - If that does not work then can you please let us know if by any chance you have enabled SSL (i se port 8443) - Also are you using kerberized setup? - How are you trying to connect to HiveServer2 (using Shell, Java code ...etc), Can you please share the complete stackTrace of the Error that you are getting? .
... View more
06-17-2017
05:57 AM
@Sami Ahmad
Yum uses the proxy settings from "/etc/yum.conf" file by default. It might not be true for other utilities. Also please check "~/.base_profile" and "~/.profile" scripts define the proxy settings so that it will be applicable globally. export http_proxy=http://dotatofwproxy.tolls.dot.state.fl.us:8080 . Another example, please try to validate if your mentioned proxy host and port is working correctly or not by using plain "wget" as following: wget -e use_proxy=yes -e http_proxy=http://dotatofwproxy.tolls.dot.state.fl.us:8080 http://$AMBARI_SERVERHOST:8080/resources/DBConnectionVerification.jar
... View more
06-17-2017
05:05 AM
@Sami Ahmad
- If we try to understand what is happening behind the error: 2017-06-16 21:27:10,803 - Error downloading DBConnectionVerification.jar
from Ambari Server resources. Check network access to Ambari Server.
HTTP Error 504: Gateway Timeout
- Ambari uses the following JAR "/var/lib/ambari-server/resources/DBConnectionVerification.jar" to perform various DB connectivity tests. - This JAR need to be present in all the Ambari Agent Hosts. So Ambari Agents uses the following URL to download the mentioned JAR from ambari server host and then puts it inside their "/var/lib/ambari-agent/tmp/DBConnectionVerification.jar" location.
http://$AMBARI_SERVERHOST:8080/resources/DBConnectionVerification.jar
- Now if due to some reason the agents are not able to download this JAR from ambari server host over HTTP then the clients (agents) will fail to perform the DB connection check.
- In your case the Agents are not able to download this JAR from ambari server host because of the following error:
HTTP Error 504: Gateway Timeout
- This indicates that from the agent machines the following URL access is failing (using wget here just for demo, agents will use the python approach to download this jar): wget http://$AMBARI_SERVERHOST:8080/resources/DBConnectionVerification.jar What is the root cause:
- Putting this JAR manually from Ambari Server host to Agents machines can make it work temporarily, but it will not fix the permanent issue. We should findout why the Agents are not able to download this jar from ambari server host. Agents should be able to access ambari server resources using HTTP. .
... View more
06-17-2017
03:47 AM
@zkfs I see the repo URL you are using as http://centos/yum/HDP/centos6/2.x/updates/2.1.10.0/repodata/repomd.xml Here the host name is "http://centos". Can you please check if you have really configured this hostname in your "/etc/hosts" file? Is that host name intended or by mistake? Can you also search which repo file in your system has the hostname "centos"? grep "http://centos" /etc/yum.repos.d/* . If you have configured a custom HDP/Ambari repo then let us know if "http://centos" is it your custom repo host? If, yes then the mentioned hostname should be resolvable and reachable. A simple WGET can help in knowing if the mentioned URL is accessible or not ? wget http://centos/yum/HDP/centos6/2.x/updates/2.1.10.0/repodata/repomd.xml - If the URL is not accessible then it means wither your Custom Local repo (hosted on "centos") is not configured properly and not accessible. (OR) Some unwanted files with the mentioned host might be present in yoru "/etc/yum./repos.d" directory you might want to either fix them or remove them from the repos.d directory. and perform "yum clean all" .
... View more
06-17-2017
12:08 AM
@Sami Ahmad Ambari Agent can be installed manually as well as via Ambari UI and both options are valid. You mentioned that "apparently ambari install is expecting ambari-agent to be installed already?" >>> Ambari Server installation does not require the agent to be installed already. Can you please share the Ambari Server installation log/output of the console which makes you feel that ambari installation is expecting agent installation? . Are you getting the same IOError and file not found on every ambari agent host? /usr/sbin/ambari-agent: line 97: ambari-sudo.sh: command not found
IOError: [Errno 2] No such file or directory: \'/var/lib/ambari-agent/data/version\' If that is happening on any particular Agent host then it might be due to incomplete agent installation. So either you willl need to check the "yum.log" to see if the agent installation was successful or not? (OR) Better to run the following command manually on the agent hosts to recover the installation. # yum reinstall ambari-agent -y .
... View more
06-15-2017
06:13 PM
@timc c
Have you tried restarting the hive service and test the same.
... View more