Member since
03-14-2016
4721
Posts
1111
Kudos Received
874
Solutions
My Accepted Solutions
| Title | Views | Posted |
|---|---|---|
| 2826 | 04-27-2020 03:48 AM | |
| 5497 | 04-26-2020 06:18 PM | |
| 4678 | 04-26-2020 06:05 PM | |
| 3709 | 04-13-2020 08:53 PM | |
| 5615 | 03-31-2020 02:10 AM |
06-11-2019
09:50 AM
@Adil BAKKOURI For changing file/dir permission you can use standard Unix/Linux commands something like following: # chown -R hdfs:hadoop /hadoop/hdfs/namenode/current/
(OR)
# chown -R hdfs:hadoop /hadoop/hdfs/namenode .
... View more
06-11-2019
08:57 AM
@Adil BAKKOURI Thank you for sharing the NameNode logs. Base don the logs we can see that your NameNode is not starting successfully because of the following error: 2019-06-07 10:29:46,758 WARN namenode.FSNamesystem (FSNamesystem.java:loadFromDisk(716)) - Encountered exception loading fsimage
java.io.FileNotFoundException: /hadoop/hdfs/namenode/current/VERSION (Permission denied)
at java.io.RandomAccessFile.open0(Native Method)
at java.io.RandomAccessFile.open(RandomAccessFile.java:316)
at java.io.RandomAccessFile.<init>(RandomAccessFile.java:243) . Hence please check what is the permission set for various files and directories of your Hadoop installation. Ideally they should be owned by "hdfs:hadoop" something like following: [root@newhwx1 ~]# ls -lart /hadoop/hdfs/namenode/current/VERSION
-rw-r--r--. 1 hdfs hadoop 206 Jun 6 06:13 /hadoop/hdfs/namenode/current/VERSION . So i am suspecting thet you might have mistakenly started your NameNode with some other user (like root user or some other user) and hence your installation files permissions might got changed. Please fix those file permissions and then try to restart the NameNode again. Please check the permissions of all the directory contents: Are these directories permission are same as the user who is running the HDFS NameNode? (ideally in HDP installation they are owned by "hdfs:hadoop" # ls -lart /hadoop/hdfs/namenode/current/
# ls -ld /hadoop/hdfs/namenode/current/
# ls -ld /hadoop/hdfs/namenode
# ls -ld /hadoop/hdfs
# ls -ld /hadoop .
... View more
06-11-2019
06:35 AM
1 Kudo
@Alampally Vinith May be you can invoke the Ambari API call to find the current HDFS Configs and then grep the configs that you want. Example Finding DataNode Http Port. # curl -s -u admin:admin -H "X-Requested-By:ambari" -X GET "http://$AMBARI_HOSTNAME:8080/api/v1/clusters/$CLUSTER_NAME/configurations/service_config_versions?service_name=HDFS%26is_current=true" | grep "dfs.datanode.http.address" | awk -F"\"" '{print $4}' Example Finding NameNode Http Port. # curl -s -u admin:admin -H "X-Requested-By:ambari" -X GET "http://$AMBARI_HOSTNAME:8080/api/v1/clusters/$CLUSTER_NAME/configurations/service_config_versions?service_name=HDFS%26is_current=true" | grep "dfs.namenode.http-address" | awk -F"\"" '{print $4}' . Also if you have the filesystem access then you can get the configs properties values from the following file: # grep -A1 'dfs.namenode.http-address' /etc/hadoop/conf/hdfs-site.xml
# grep -A1 'dfs.datanode.http.address' /etc/hadoop/conf/hdfs-site.xml . Another option will be to get the output of the following commands: # hdfs getconf -confKey "dfs.datanode.http.address" .
... View more
06-11-2019
04:24 AM
@Monalisa Tripathy Did that answer your query? If yes, then please mark this thread as answered by clicking on the "Accept" button .. If you have any additional query then please post back.
... View more
06-11-2019
04:21 AM
@Rohit Sharma Did you find that the below query returned any record in your Ambari DB ? If, yes then that explains about the issue and the above shared article should help in getting it fixed. select * from alert_current where history_id not in (select alert_id from alert_history); .
... View more
06-11-2019
04:19 AM
@John Are you still getting the same error? Did it resolve the issue?
... View more
06-11-2019
04:12 AM
@Nani Bigdata Did that answer your query? It will be a good community practice to mark the answer as "Accept" if it answers your query or Post back if you have any additional query.
... View more
06-10-2019
02:30 PM
1 Kudo
@Matas Mockus Alert notification is not related with the Service Auto Start feature. Those features will work separately. So if you have configured any notification like Email Alert Notification then once the component goes down the alert will still be triggered normally based ont he alert trigger interval set for those individual alerts telling that the component went down (Service Auto Start feature will work independently).
... View more
06-10-2019
02:12 PM
1 Kudo
@Matas Mockus Auto Start of components should work if the following conditions are met: 1. The components were not gracefully stopped (via Ammari API calls or via UI). Means the components were abruptly killed/terminated due to Host reboot or due to some errors in those componentes. 2. As soon as the Host comes up at least Ambari Agent should be running as a service so that as soon as the host reboots the Ambari Agent comes up automatically. This is needed because the Ambari Agent sends the current state info of the components present in that host to Ambari Server and then Ambari checks the "desired state" of the components with the "actual State" of those components sent by the ambari agent. If the desired state of those component does not match (support in ambari DB the desired state is "STARTED" but agent says that those components are actually Down) then Ambari Server will send a recovery instruction to agents due to the AutoStart Setting.
... View more
06-10-2019
01:50 PM
@Rohit Sharma Your recent error indicates that there is some inconsistency in your Ambari DB. Due to this inconsistency the Ambari UI for Alerts page is not showing any alert details. Error Processing URI: /api/v1/clusters/cluster-name/alerts - (java.lang.NullPointerException) null . You can follow the below article to get this issue fixed. Please make sure to take a fresh Amabri DB dump for backup purpose before following the below article. https://community.hortonworks.com/content/supportkb/174817/ambari-alert-page-is-invisible-on-ambari-screen.html After performing the steps mentioned in the above article please do not forget to restart Ambari Server.
... View more