Member since
03-14-2016
4721
Posts
1111
Kudos Received
874
Solutions
My Accepted Solutions
| Title | Views | Posted |
|---|---|---|
| 2725 | 04-27-2020 03:48 AM | |
| 5285 | 04-26-2020 06:18 PM | |
| 4450 | 04-26-2020 06:05 PM | |
| 3576 | 04-13-2020 08:53 PM | |
| 5380 | 03-31-2020 02:10 AM |
04-24-2018
03:07 PM
@Prakash Punj As we see the error which shows that due to SSL issue amabri agent is not able to communicate with ambari server. IOError: Request to https://ambari.asotc.com:8441/agent/v1/register/ds.asotc.com failed due
to <urlopen error EOF occurred in violation of protocol
(_ssl.c:661)>
ERROR 2018-04-24 10:55:27,949 Controller.py:227 - Error:Request to
https://ambari.asotc.com:8441/agent/v1/register/ds.asotc.com failed due
to <urlopen error EOF occurred in violation of protocol
(_ssl.c:661)> So can you please try adding the following option to security section in "/etc/amabri-agent/conf/ambari-agent.ini" in all the hosts in the cluster [security]
force_https_protocol=PROTOCOL_TLSv1_2 For more information on thjis please refer to: https://community.hortonworks.com/questions/114808/ambari-agents-cannot-reach-ambari-server-after-cha.html .
... View more
04-24-2018
02:43 PM
@Prakash Punj Have you restarted your ambari agent after making the DEBUG logging change? Looks like your Agent log is not updated. I still see the same timestamp in your posted log which is same as the timestamp posted in the original HCC thread. INFO 2018-04-24 09:23:27,039 Facter.py:202 - Directory:
'/etc/resource_overrides' does not exist - it won't be used for
gathering system resources. Please check if the log file time stamps are changing or not? # ls -l /var/log/ambari-agent/ambari-agent.out
# ls -l /var/log/ambari-agent/ambari-agent.log .
... View more
04-24-2018
02:29 PM
@Victor Yes, it is possible to download HDP sandbox and then download all HDF components on HDP sandbox.
... View more
04-24-2018
02:26 PM
@Victor Regarding your specific query: "I have downloaded the Apache Ambari Version 2.6.1.0, so do I have both HDP and HDF now ?" When you install ambari and then try to setup a cluster then b y default you can setup a HDP cluster because ambari already ships the HDP common-services and HDP stack information along with it's binary. However if you want to install HDF or some other Stacks then you will have to download the required "mpacks" and then install those Mpackas to Ambari and then only you can install the services/components available as part of those mpacks. Like: https://docs.hortonworks.com/HDPDocuments/HDF3/HDF-3.1.1/bk_installing-hdf-on-hdp/content/ch_install-mpack.html A management pack (mpack) bundles service definitions, stack definitions, and stack add-on service definitions so they do not need to be included with the Ambari core functionality and can be updated in between major releases. .
... View more
04-24-2018
02:20 PM
1 Kudo
@Victor
HDP and HDF are separate products and they include different set of components. HDP Shipped components: https://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.6.4/bk_release-notes/content/comp_versions.html HDF Shipped Components: https://docs.hortonworks.com/HDPDocuments/HDF3/HDF-3.1.1/bk_release-notes/content/ch_hdf_relnotes.html So based on your requirement you can choose any of those distributions. It is also possible to have the HDF components installed on an existing HDP cluster as described in : https://docs.hortonworks.com/HDPDocuments/HDF3/HDF-3.1.1/bk_installing-hdf-on-hdp/content/upgrading_ambari.html . There are some types of Sandboxes available for download and use. Like HDP Sandbox & HDF Sandbox so you can shoose then based on your interest and requirement. Those different types of Sandbox Downloads can be found here: https://hortonworks.com/downloads/#sandbox .
... View more
04-24-2018
02:14 PM
@Kumar Veerappan Please use the Escape characters (\\) when specifying the | (pipe) sign as following: Like : -Dhttp.nonProxyHosts=aaa.com\|bbb.com\|ccc.com Example: # grep AMBARI_JVM_ARGS /var/lib/ambari-server/ambari-env.sh
export AMBARI_JVM_ARGS=$AMBARI_JVM_ARGS' -Xms512m -Xmx2048m -XX:MaxPermSize=128m -Djava.security.auth.login.config=$ROOT/etc/ambari-server/conf/krb5JAASLogin.conf -Djava.security.krb5.conf=/etc/krb5.conf -Djavax.security.auth.useSubjectCredsOnly=false -Dhttp.nonProxyHosts=aaa.com\|bbb.com\|ccc.com' . Output: # ps -ef | grep AmbariServer
root 14850 1 99 14:12 pts/0 00:00:42 /usr/lib/jvm/java/bin/java -server -XX:NewRatio=3 -XX:+UseConcMarkSweepGC -XX:-UseGCOverheadLimit -XX:CMSInitiatingOccupancyFraction=60 -XX:+CMSClassUnloadingEnabled -Dsun.zip.disableMemoryMapping=true -Xms512m -Xmx2048m -XX:MaxPermSize=128m -Djava.security.auth.login.config=/etc/ambari-server/conf/krb5JAASLogin.conf -Djava.security.krb5.conf=/etc/krb5.conf -Djavax.security.auth.useSubjectCredsOnly=false -Dhttp.nonProxyHosts=aaa.com|bbb.com|ccc.com -cp /etc/ambari-server/conf:/usr/lib/ambari-server/*:/usr/share/java/postgresql-jdbc.jar org.apache.ambari.server.controller.AmbariServer
.
... View more
04-24-2018
01:50 PM
@Kumar Veerappan Please check the following things on all your hosts 1. Check if the "iptables" or "firewall" is disabled on all hosts. 2. As the alerts scripts are executed from different hosts of the cluster nodes Hence please make sure that every host of your cluster is able to resolve each others address and able to access the mentioned Hostname & Ports. # telnet node1.dev.XXXXXXXX.io 50075
# telnet api1.dev.XXXXXXX.io 8088 3. Also on the hosts where the DataNode and Resource Manager Ports are supposed to be listening , Please check if they are actually listening and Bound to correct IPAddress and correct interface (ip address)? # netstat -tnlpa | grep 8088
# netstat -tnlpa | grep 50075 . 4. Also please check if you have installed any HTTP Proxy on your machines (cluster nodes) ? Which might be restricting the access of those URL endpoints. Like http_proxy, So better to check if you are able to access the mentioned URL from any node of the cluster using curl without any issue or not? # curl http://node1.dev.XXXXXXXX.io:50075
# curl http://api1.dev.XXXXXXX.io:8088 .
... View more
04-24-2018
01:42 PM
@Prakash Punj You said that the agent is failing but we see that there are not Errors ... the log snippets posted above are INFO only. Can you please try running the Agent in DEBUG mode and please share the complete log of agent as well as from amabri server. You can enable ambari agent debug logging by changing the "INFO" to "DEBUG" in the following file. Change the following line in "/etc/ambari-agent/conf/ambari-agent.ini" file to "DEBUG" loglevel=INFO Change above to loglevel=DEBUG . Then restart the ambari agent. Also please let us know if there is any specific reason that you are having other hosts using CentOS7 but this host as SUSE12 ?
... View more
04-24-2018
01:36 PM
@Victor I quickly looked at the code. Looks like there should be only 3 colors in that Page for the services. 1. White Color (white and grey are just the alternate row colors) 2. Green Color (means Selected or already installed services) 3. Grey Color Can you please check in some other browser. Or in Incognito mode of the browser to see if you are still seeing yellow of if there is some coloring issue from browser of OS side.
... View more
04-24-2018
01:16 PM
@Victor It depends on the version of Ambar that you are using. Some of the Tech Preview components can be seen in yellow. Can you please let us know which version of Ambari is it? And from where you installed the MPack for those components.
... View more