Member since
03-14-2016
4721
Posts
1111
Kudos Received
874
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
2455 | 04-27-2020 03:48 AM | |
4896 | 04-26-2020 06:18 PM | |
3980 | 04-26-2020 06:05 PM | |
3226 | 04-13-2020 08:53 PM | |
4935 | 03-31-2020 02:10 AM |
01-18-2019
05:35 AM
@hardik desai Is there any specific reason you are using IP Address instead of Hostnames ? Using Hostnames instead of IP address is always recommended. . Also the error shows Failed to connect to /192.168.20.8:50010 . So from the machine where you are running the HDFS fetch commands are you able to access the mentioned DataNode host & port? # telnet 192.168.20.8 50010
(OR)
# nc -v 192.168.20.8 50010 . It might be either Port blocking issue / like firewall issue. Or the DataNode on the mentioned IPAddress / port might not be listening. So please SSH to the DataNode host "192.168.20.8" and check if the port is opened and listening on 50010 ? # netstat -tnlpa | grep -i DataNode . If you see that port is not opened OR if it is not bind to the intended network interface (ip address) then please fix it or share the DataNode logs to see if there are any errors
... View more
01-15-2019
09:54 PM
1 Kudo
@Michael Bronson Regarding your query: "the option Selected hosts isn't active ( in spite I see it )" Here are the steps: 1. When you click on "Hosts" tab then a page opens with the list of hosts. 2. You will need to click on the "Checkbox" just in front of the hostnames mentioned in hosts page. 3. Then click on "Actions" --> "Selected Hosts" (you should see the number of hosts which you checked in step2) 4. Now you should be able to do: Ambari UI -->Hosts(Tab)-->"Actions"(Drop down)--> Select the Host that you want --> then click on "Selected Hosts" --> DataNode --> Decommission .
... View more
01-15-2019
12:29 PM
@Michael Bronson Correction: Replace "Filtered Host" with "Selected Hosts" option in my previous update.
... View more
01-15-2019
12:27 PM
@Michael Bronson You can select the host which you want and has DataNode (Please use "Selected Hosts" option) Ambari UI -->Hosts(Tab)-->"Actions"(Drop down)--> Select the Host that you want --> then click on "Selected Hosts" --> DataNode --> Decommission . This will ensure that the operations should be only performed to the list of host which you have selected using " Selected Hosts" option.
... View more
01-15-2019
12:15 PM
1 Kudo
@Michael Bronson (This is just partial answer to your last update) Decommissioning DataNodes can be done in the following way for Ambari 2.6.1 Ambari UI --> Hosts (Tab) --> "Actions" (Drop down) --> All Hosts / Filtered Hosts (choose based on your need) --> Choose "DataNode" option --> Decommission .
... View more
01-15-2019
11:51 AM
1 Kudo
@Michael Bronson Step1). You can get all the Hostnames where the DataNode is present using the following API call: # curl --user admin:admin -H 'X-Requested-By: ambari' -X GET "http://newhwx1.example.com:8080/api/v1/clusters/NewCluster/services/HDFS/components/DATANODE?fields=host_components/HostRoles/host_name" | grep host_name | awk '{print $NF}' | awk -F'"' '{print $2}'
. Step2). Once you have the list of the hosts where the Datanode is installed (using above API call) then you can use it to make the following API call using some shell script to replace the $HOST with the hostname. # curl --user admin:admin -H 'X-Requested-By: ambari' -X POST -d '{"RequestInfo":{"command":"RESTART","context":"Restart all components on $HOST","operation_level":{"level":"HOST","cluster_name":"NewCluster"}},"Requests/resource_filters":[{"service_name":"HDFS","component_name":"DATANODE","hosts":"$HOST"}, {"service_name":"YARN","component_name":"NODEMANAGER","hosts":"$HOST"}, {"service_name":"AMBARI_METRICS","component_name":"METRICS_MONITOR","hosts":"$HOST"} ]}' http://ambariserver.example.com:8080/api/v1/clusters/NewCluster/requests . NOTE: In the above call please make sure to replace the $HOST with the hostname one by one (using some shell script Loop iteration) which we retrieved from the previous API call. Also please replace the "NewCluster" with your own cluster name. Also please replace "ambariserver.example.com" with your ambari hostname and credentials accordingly.
... View more
01-15-2019
07:17 AM
@abbas mohammadnejad 1. How are you updating the blueprint? 2. After upgrading the blueprint where actually checking the values for "cluster-env" ? Usually we export the blueprint setting of an existing cluster with the following API call. # curl --user admin:admin -i -H 'X-Requested-By: ambari' -X GET "http://$AMBARI_HOST:8080/api/v1/clusters/$CLUSTER_NAME?format=blueprint" -o /tmp/cluster_blueprint.json . In the exported blueprint "/tmp/cluster_blueprint.json" you will find the current cluster information. Also you will find the "cluster-env" properties there inside the same "/tmp/cluster_blueprint.json" file. So if you want to make any changes to the blueprint then you can either edit the same "/tmp/cluster_blueprint.json" file with your own values as you mentioned above. and then use the ambari API call to POST the same edited blueprint back to ambari. NOTE: However the blueprint will be used to create a new cluster. It is not used to modify the settings/configurations of an existing cluster. The other option will be to make the changes in "cluster-env" settings of your current cluster usijng utilities like "config.py" and then export the blueprint freshly using the same API call. # curl --user admin:admin -i -H 'X-Requested-By: ambari' -X GET "http://$AMBARI_HOST:8080/api/v1/clusters/$CLUSTER_NAME?format=blueprint" -o /tmp/cluster_blueprint_new.json . Making changes in cluster-env using config.py then exporting blueprint: You can make the changes in the "cluster-env" configuration of current cluster using the following kind of commands from ambari server host: # /var/lib/ambari-server/resources/scripts/configs.py --user=admin --password=admin --port=8080 --action=set --host=localhost --cluster=KerLatest --config-type=cluster-env -k "recovery_lifetime_max_count" -v "1024"
#
/var/lib/ambari-server/resources/scripts/configs.py --user=admin --password=admin --port=8080 --action=set --host=localhost --cluster=KerLatest --config-type=cluster-env -k "recovery_enabled" -v "true" NOTE: Please make sure to change the cluster name "CLUSTER_NAME" (example: KerLatest is my cluster name) here to your existing clustername. Then export the blueprint of this cluster again.
# curl --user admin:admin -i -H 'X-Requested-By: ambari' -X GET "http://$AMBARI_HOST:8080/api/v1/clusters/$CLUSTER_NAME?format=blueprint" -o /tmp/cluster_blueprint_new_1.json .
... View more
01-15-2019
04:51 AM
@Magical Jelly Good to know that the issue is resolved. It will be wonderful if you can mark this HCC thread as Answered by clicking on the "Accept" link then other HCC users can quickly find the answered threads.
... View more
01-14-2019
10:34 AM
1 Kudo
@Magical Jelly Please let us know which ambari version are you using? There seems to be some issue reported for Ambari 2.6 and prior version of Ambari Widgets where the Widget formula contained "Subtract" operator. Something similar you can find here: https://issues.apache.org/jira/browse/AMBARI-23309 Code Changes: https://github.com/apache/ambari/pull/738/files So if you can make the same changes as mentioned in the Pull request inside the "/usr/lib/ambari-server/web/javascripts/app.js" (after taking a backup of this file) then it should start working after hard reset of browser. . Or try the same in Ambari 2.7.0 or later and then see if it works.
... View more
01-14-2019
08:24 AM
1 Kudo
@Enrique Benito Casado Yes, if any other process is using port 8080 then Sandbox provided Ambari will not able to use the same port. So the best option will be to find the process which is using Port 8080 and then either stop that (Or change the port of that process) then restart the Sandbox. Example: Some of the following command you can use to find the PID which tomcat and using port 8080 # ps -ef | grep -i tomcat
# netstat -tnlpa | grep 8080 .
... View more