Member since
03-14-2016
4721
Posts
1111
Kudos Received
874
Solutions
My Accepted Solutions
| Title | Views | Posted |
|---|---|---|
| 2825 | 04-27-2020 03:48 AM | |
| 5479 | 04-26-2020 06:18 PM | |
| 4663 | 04-26-2020 06:05 PM | |
| 3704 | 04-13-2020 08:53 PM | |
| 5605 | 03-31-2020 02:10 AM |
09-30-2019
04:32 AM
@saivenkatg55 Good to know that your issue is resolved. If your question is answered then, Please make sure to mark the answer as the accepted solution. If you find a reply useful, say thanks by clicking on the thumbs up button.
... View more
09-30-2019
04:24 AM
@saivenkatg55 As we see the error indicates a Permission issue IOError: [Errno 13] Permission denied: '/var/log/ambari-metrics-monitor/ambari-metrics-monitor.log' The permission on the file does not seems to be accurate as it does not have WRITE permission. -r--r--r-- 1 ams hadoop 3.1M Aug 22 13:43 ambari-metrics-monitor.log . Please try the following command to change the permission and then try to restart metrics monitor again # chmod 644 /var/log/ambari-metrics-monitor/ambari-metrics-monitor.log . Can you try changing it to following and then try again:
... View more
09-29-2019
07:53 PM
1 Kudo
@ThanhP In addition to my previous notes, In order to further isolate the issue you can also try to start the NameNode (OR Hdfs services) manually using command line to see if it is starting fine? See the doc: how to start HDFS services or individual components manually via command line: https://docs.cloudera.com/HDPDocuments/HDP3/HDP-3.1.0/administration/content/starting_hdp_services.html Example: # su -l hdfs -c "/usr/hdp/current/hadoop-hdfs-namenode/../hadoop/sbin/hadoop-daemon.sh start namenode" .
... View more
09-29-2019
07:47 PM
1 Kudo
@ThanhP Are you sure that your NameNode is running fine and listening to Port 8020 ? Can you please verify if the port is actually listening or not? # netstat -tnlpa | grep 8020
# netstat -tnlpa | grep 50070
# ps -ef | grep -i NameNode . Most probably the NameNode may not be running healthy, Or there may be some errors reported inside the "/var/log/hadoop/hdfs/hadoop-hdfs-namenode-*.log" Can you please check and share the NN log. Also as you are using Sandbox which runs many other services so some times due to less resource availability (like free memory/cpu..etc) services does not run properly so please try to stop the services which you are not using currently like Spark/Zeppelin/Oozie ..etc to free some resources and then restart NameNode to see if it works fine? Just start the Selective Services first like HDFS/Yarn/MapReduce/Zookeeper ...etc and then later based on resource availability we can start other services which are needed else just stop other services and put them in Maintenance mode until you actually want to test them.
... View more
09-27-2019
07:32 AM
@pdev As per Hadoop Doc: https://hadoop.apache.org/docs/r2.7.0/hadoop-project-dist/hadoop-hdfs/hdfs-default.xml The default configuration for "dfs.webhdfs.enabled" is "true". Which means if you do not see it in hdfs-site.xml means it is by default enabled. You can override it by editing the "hdfs-site.xml" based on your requirement. dfs.webhdfs.enabled true Enable WebHDFS (REST API) in Namenodes and Datanodes.
... View more
09-27-2019
05:20 AM
@irfangk1 Was your query answered? If your question is answered then, Please make sure to mark the answer as the accepted solution. If you find a reply useful, say thanks by clicking on the thumbs up button. Please revert back if you have any followup query in this thread. That way we can find the solution/answer that way other community users can get the benefit.
... View more
09-27-2019
05:15 AM
@irfangk1 Is this issue resolved? Looks like you have abandoned this thread. Please revert back if you have found the solution that way other community users can get the solution Or please share the requested informations to continue the discussion..
... View more
09-25-2019
09:22 PM
@irfangk1 Looks like the SmartSense service installation is failing for you. Failed to execute command: dpkg-query -l | grep 'ii\s*smartsense-*' || apt-get -o Dpkg::Options::=--force-confdef --allow-unauthenticated --assume-yes install smartsense-hst || dpkg -i /var/lib/ambari-agent/cache/stacks/HDP/3.0/services/SMARTSENSE/package/files/deb/*.deb; Exit code: 1; stdout: ; stderr: E: dpkg was interrupted, you must manually run 'dpkg --configure -a' to correct the problem.
dpkg: error processing archive /var/lib/ambari-agent/cache/stacks/HDP/3.0/services/SMARTSENSE/package/files/deb/*.deb (--install):
cannot access archive: No such file or directory Thats the reason later at Step9 the services are failing to start because smartsense service binaries (due to package installation failure) are not present. INFO 2019-09-24 16:06:03,584 ComponentStatusExecutor.py:172 - Status command for HST_AGENT failed:
Failed to execute command: /usr/sbin/hst agent-status; Exit code: 127; stdout: ; stderr: /bin/sh: 1: /usr/sbin/hst: not found Better to skip and proceed the Step9 by clicking Next/Proceed/OK/Complete kind of button in UI and then later verify on the Host where the SmartSense package is supposed to be install and failing to install. Check if the repo is fine and if you are manually able to install the SmartSesne binary on that host? It might be some ambari repo access issue on that node where the SmartSense installation failed. Better to check and share the exact OS version and the ambari repo version. Like based on the ambari version please get the correct repo something like: # wget -O /etc/apt/sources.list.d/ambari.list <a href="http://public-repo-1.hortonworks.com/ambari/XXXXXXXXXXXXXX/updates/2.7.3.0/ambari.list" target="_blank">http://public-repo-1.hortonworks.com/ambari/XXXXXXXXXXXXXX/updates/2.7.3.0/ambari.list</a>
# apt-get clean all
# apt-get update You can get the correct ambari REPO URL from the following kind of links: https://docs.cloudera.com/HDPDocuments/Ambari-2.7.3.0/bk_ambari-upgrade-major/content/upgrade_ambari.html . .
... View more
09-25-2019
06:38 PM
@irfangk1 It is really too less information to comment anything on this . Or to guess what might be happening. Can you please provide more detailed information about your issue? 1. When are you noticing such error? 2. In which Log you see this message ? Can you share the complete log? 3. The product that you are using and the Product version like Ambari version / HDP version ...etc 4. A full stackTrace of the error.
... View more
09-23-2019
10:16 PM
@irfangk1 Can you please share the files: /var/lib/ambari-agent/data/output-423.txt
/var/lib/ambari-agent/data/errors-423.txt And if possible then the ambari-agent.log from the cluster node where the above files are generated. You can find the host details where the operation failed by looking at the ambari UI operational logs.
... View more