Member since
03-14-2016
4721
Posts
1111
Kudos Received
874
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
2439 | 04-27-2020 03:48 AM | |
4870 | 04-26-2020 06:18 PM | |
3974 | 04-26-2020 06:05 PM | |
3212 | 04-13-2020 08:53 PM | |
4918 | 03-31-2020 02:10 AM |
11-06-2019
03:43 AM
@Kou_Bou As we see that you are getting following kind of error "certificate_unknown" in AmbariServer logs 06 Nov 2019 12:06:35,805 WARN [qtp-ambari-agent-68] nio:720 - javax.net.ssl.SSLException: Received fatal alert: certificate_unknown
06 Nov 2019 12:06:35,904 WARN [qtp-ambari-agent-67] SecurityFilter:103 - Request <a href="https://192.168.253.45:8440/" target="_blank">https://192.168.253.45:8440/</a> doesn't match any patter Hence you should try to delete the OLD certificates from agent machine and then try again. As the old Agent certificates might be having incorrect names. # rm /var/lib/ambari-agent/keys/*
# ambari-agent restart While restarting it should fetch correct certificates from ambari server. . . If your question is answered then, Please make sure to mark the answer as the accepted solution. If you find a reply useful, say thanks by clicking on the thumbs up button.
... View more
11-06-2019
02:43 AM
@Kou_Bou Your "/etc/hosts" file should have the FQDN info of AmbariServer (do not use localhost) to point to ambari server. Also please change the "ambari-agent.ini" to point to the AmbariServer FQDN instead of using "localhost" https://docs.cloudera.com/HDPDocuments/Ambari-2.7.4.0/administering-ambari/content/amb_install_the_ambari_agents_manually_on_rhel-centos-oracle_7.html On each Agent node, stop the Agent.
# ambari-agent stop
Using a text editor, edit /etc/ambari-agent/conf/ambari-agent.ini to point to the new host.
[server]
hostname=$NEW FULLY.QUALIFIED.DOMAIN.NAME
url_port=8440
secured_url_port=8441 .
... View more
11-06-2019
01:35 AM
@Kou_Bou As we see the following message: WARNING 2019-11-06 09:46:39,683 NetUtil.py:93 - Failed to connect to https://localhost:8440/ca due to [Errno 111] Connection refused Which indicates that the Ambari Agent is trying to conect to the AmbariServer running in Localmachine "localhost". Ideally it should be using the FQDN of ambari server instead of "localhost:8440". So can you please try this: 1). please edit the "/etc/ambari-agent/conf/ambari-agent.ini" hostname to point to the FQDN (fully Qualified Hostname) of AmbariServer instead of localhost. Please make sure to replace the "ambariserverhost.example.com" with the actual FQDN of your ambari server. Example: # grep -A1 '\[server\]' /etc/ambari-agent/conf/ambari-agent.ini
[server]
hostname=ambariserverhost.example.com 2. Then restart Ambari Agent. # ambari-agent restart
# cat /etc/hosts 3. Now verify iof you are able to connect to the mentioned AmbariServer FQDN and Port from the agent machine as following? # telnet ambariserverhost.example.com 8440
(OR)
# nc -v ambariserverhost.example.com 8440 4. Also please make sure that the iptables/firewall is disabled on AmbariServer host and port 8440 is listening Example: # netstat -tnlpa | grep `cat /var/run/ambari-server/ambari-server.pid`
tcp6 0 0 :::8080 :::* LISTEN 7463/java
tcp6 0 0 :::8440 :::* LISTEN 7463/java .
... View more
09-30-2019
04:32 AM
@saivenkatg55 Good to know that your issue is resolved. If your question is answered then, Please make sure to mark the answer as the accepted solution. If you find a reply useful, say thanks by clicking on the thumbs up button.
... View more
09-30-2019
04:24 AM
@saivenkatg55 As we see the error indicates a Permission issue IOError: [Errno 13] Permission denied: '/var/log/ambari-metrics-monitor/ambari-metrics-monitor.log' The permission on the file does not seems to be accurate as it does not have WRITE permission. -r--r--r-- 1 ams hadoop 3.1M Aug 22 13:43 ambari-metrics-monitor.log . Please try the following command to change the permission and then try to restart metrics monitor again # chmod 644 /var/log/ambari-metrics-monitor/ambari-metrics-monitor.log . Can you try changing it to following and then try again:
... View more
09-29-2019
07:53 PM
1 Kudo
@ThanhP In addition to my previous notes, In order to further isolate the issue you can also try to start the NameNode (OR Hdfs services) manually using command line to see if it is starting fine? See the doc: how to start HDFS services or individual components manually via command line: https://docs.cloudera.com/HDPDocuments/HDP3/HDP-3.1.0/administration/content/starting_hdp_services.html Example: # su -l hdfs -c "/usr/hdp/current/hadoop-hdfs-namenode/../hadoop/sbin/hadoop-daemon.sh start namenode" .
... View more
09-29-2019
07:47 PM
1 Kudo
@ThanhP Are you sure that your NameNode is running fine and listening to Port 8020 ? Can you please verify if the port is actually listening or not? # netstat -tnlpa | grep 8020
# netstat -tnlpa | grep 50070
# ps -ef | grep -i NameNode . Most probably the NameNode may not be running healthy, Or there may be some errors reported inside the "/var/log/hadoop/hdfs/hadoop-hdfs-namenode-*.log" Can you please check and share the NN log. Also as you are using Sandbox which runs many other services so some times due to less resource availability (like free memory/cpu..etc) services does not run properly so please try to stop the services which you are not using currently like Spark/Zeppelin/Oozie ..etc to free some resources and then restart NameNode to see if it works fine? Just start the Selective Services first like HDFS/Yarn/MapReduce/Zookeeper ...etc and then later based on resource availability we can start other services which are needed else just stop other services and put them in Maintenance mode until you actually want to test them.
... View more
09-28-2019
02:36 PM
@hassaniraj Looks like the error reported in this thread could be due to the same reason mentioned on another thread of yours: https://community.cloudera.com/t5/Support-Questions/Hortonworks-sandbox-2-5-yum-update-not-working/m-p/278491 . It will be great to follow the same instructions mentioned on that thread to see if that fixes this issue. Specially if you see some "dev2.hortonworks.com.s3.amazonaws.com" repos base URLs inside your "/etc/yum.repos.d" repos then please refer to the other thread and try to disable them and try again. You should set the "enabled=0" (this will disable the sandbox.repo) which has issue. As that is just development repo and might not be available always. https://community.cloudera.com/t5/Support-Questions/yum-install-error-please-help-me-out/m-p/203121 After removing the problematic repos try to perform a clean at yum level and then try again: # yum clean all
# yum install python-pip .
... View more
09-27-2019
04:00 PM
@hassaniraj 1. Please try restarting the VM once. 2. Inside the sandbox do SSH login and then try to see if you are able to make the following curl call .. this is just to verify the repo accessibility. If the following URL does not work then please share the HTTP Header section output of the following curl commands here so that we can verify if there are some special headers like Network proxy ..etc. # curl -iLvk <a href="http://public-repo-1.hortonworks.com/HDP-UTILS-1.1.0.21/repos/centos6/repodata/repomd.xml" target="_blank">http://public-repo-1.hortonworks.com/HDP-UTILS-1.1.0.21/repos/centos6/repodata/repomd.xml</a> AND # curl -iLvk <a href="http://public-repo-1.hortonworks.com/HDP-UTILS-1.1.0.21/repos/centos6/repodata/7fcacadb44b1a860fb704795c187f549103e855a0a93ed31293a0b270a9022b4-primary.sqlite.bz2" target="_blank">http://public-repo-1.hortonworks.com/HDP-UTILS-1.1.0.21/repos/centos6/repodata/7fcacadb44b1a860fb704795c187f549103e855a0a93ed31293a0b270a9022b4-primary.sqlite.bz2</a> 3. If above works fine then we will have to look from the YUM side. Please try to perform the yum cache cleanup and then retry: # yum clean all
# yum update 4. It will be also good to verify if the "/etc/yum.repos.d/" directory has any problematic repo. Can you please list them? # ls -lart /etc/yum.repos.d/ For temporarily you can move some of the repo files from "/etc/yum.repos.d/" file to outside and then retry... this will help in isolating if there are any corrupted repo issue. 5. Recently have you made any changes to the "/etc/yum.conf" file like enabling/disabling any proxy setting ..? # cat /etc/yum.conf Also if you see some "dev2.hortonworks.com.s3.amazonaws.com" repos URLs inside your "/etc/yum.repos.d" repos then please refer to the other thread and try to disable them and try again: https://community.cloudera.com/t5/Support-Questions/yum-install-error-please-help-me-out/m-p/203121 Example: # cat /etc/yum.repos.d/sandbox.repo
[sandbox]
baseurl=<a href="http://dev2.hortonworks.com.s3.amazonaws.com/repo/dev/master/utils/" target="_blank">http://dev2.hortonworks.com.s3.amazonaws.com/repo/dev/master/utils/</a>
name=Sandbox repository (tutorials)
gpgcheck=0
enabled=0 . . If your question is answered then, Please make sure to mark the answer as the accepted solution. If you find a reply useful, say thanks by clicking on the thumbs up button.
... View more
09-27-2019
07:32 AM
@pdev As per Hadoop Doc: https://hadoop.apache.org/docs/r2.7.0/hadoop-project-dist/hadoop-hdfs/hdfs-default.xml The default configuration for "dfs.webhdfs.enabled" is "true". Which means if you do not see it in hdfs-site.xml means it is by default enabled. You can override it by editing the "hdfs-site.xml" based on your requirement. dfs.webhdfs.enabled true Enable WebHDFS (REST API) in Namenodes and Datanodes.
... View more