Member since
08-08-2017
1652
Posts
30
Kudos Received
11
Solutions
My Accepted Solutions
| Title | Views | Posted |
|---|---|---|
| 1944 | 06-15-2020 05:23 AM | |
| 15801 | 01-30-2020 08:04 PM | |
| 2092 | 07-07-2019 09:06 PM | |
| 8166 | 01-27-2018 10:17 PM | |
| 4639 | 12-31-2017 10:12 PM |
09-04-2018
04:44 AM
@Jay , this is what we got: ( so this is like 88% used ) , and regarding my question , how it can be 88% when disk are ~50%
... View more
09-03-2018
05:05 PM
hi all we have ambari cluster version 2.6.1 & HDP version 2.6.4 from the dashboard we can see that HDFS DISK Usage is almost 90% but all data-node disk are around 90% so why HDFS show 90% , while datanode disk are only 50% /dev/sdc 20G 11G 8.7G 56% /data/sdc
/dev/sde 20G 11G 8.7G 56% /data/sde
/dev/sdd 20G 11G 9.0G 55% /data/sdd
/dev/sdb 20G 8.9G 11G 46% /data/sdb is it problem of fine-tune ? or else we also performed re-balance from the ambari GUI but this isn't help
... View more
Labels:
09-03-2018
04:06 PM
@Jonathan Sneep thank you so much
... View more
09-03-2018
02:28 PM
dear hortonworks colleges in the past before 3 month , I used the script as described in the article https://community.hortonworks.com/articles/16846/how-to-identify-what-is-consuming-space-in-hdfs.html but today I see that the script in the article change and and cant be run I guess because some edit in the post that change also the script can someone help to recover the script as was before 3 month ?
... View more
Labels:
09-03-2018
10:34 AM
@Jay, as you know we run the API that restart all req services, and what we mean is that we want to capture only
the last status from restart action , ( so the req ID should be only the last )
, for example , if now the last req id is 187 ,
then on the next restart it will be 188 , so we want to capture only the status
of req id - 188 ( fail / ok ) but as I mentioned my syntax is give this curl -sH "X-Requested-By: ambari" -u admin:admin -i http://$SERVER:8080/api/v1/clusters/$cluster_name/requests?fields=Requests/request_status | awk '/request_status/' | tail -1 | egrep -iq "FAILED|ABORTED"
[[ $? -eq 0 ]] && echo fail || echo ok
... View more
09-03-2018
09:42 AM
@Jay see also what are the real latest restart status "href" : "http://master:8080/api/v1/clusters/HDP/requests/186",
"Requests" : {
"cluster_name" : "HDP",
"id" : 186,
"request_context" : "Restart all components for ZooKeeper",
"request_status" : "ABORTED"
}
},
{
"href" : "http://master:8080/api/v1/clusters/HDP/requests/187",
"Requests" : {
"cluster_name" : "HDP",
"id" : 187,
"request_context" : "Restart all components for Kafka",
"request_status" : "COMPLETED"
}
},
{
"href" : "http://master:8080/api/v1/clusters/HDP/requests/188",
"Requests" : {
"cluster_name" : "HDP",
"id" : 188,
"request_context" : "Restart all components for Kafka",
"request_status" : "COMPLETED"
}
}
]
... View more
09-03-2018
09:00 AM
@Jay in my case we get the following and the expected results should be only the last line ( last restart results ) curl -sH "X-Requested-By: ambari" -u admin:admin -X GET http://$server:8080/api/v1/clusters/$cluster/requests?fields=Requests/id,Requests/request_status,Requests/request_context | grep -A2 -B3 "Restart all required services" | grep 'request_status' "request_status" : "COMPLETED"
"request_status" : "COMPLETED"
"request_status" : "COMPLETED"
"request_status" : "FAILED"
"request_status" : "COMPLETED"
... View more
09-03-2018
08:11 AM
@Jay I think the following syntax is more fit for my case curl -sH "X-Requested-By: ambari" -u admin:admin -i http://$SERVER:8080/api/v1/clusters/$cluster_name/requests?fields=Requests/request_status | awk '/request_status/' | tail -1 | egrep -iq "FAILED|ABORTED" it will capture the last status , and if this fail or abort then the status is fail what you think?
... View more
09-02-2018
05:24 PM
with the following API I restart all services in ambari that required restart curl -sH "X-Requested-By: ambari" -u USER:$PASSWD -i http://$SERVER:8080/api/v1/clusters/$CLUSTER_NAME/requests?fields=Requests/request_status how to know if API succeeded to restart all services ? for example we get true in case all services restart succsfuly we get false when one or more services are failed
... View more
Labels:
08-30-2018
01:52 PM
actually we think on tool that should installed on each linux machines , like the atop , the check_mk control the OS from WIN machines , and what we want is tool that give the info from the OS itself and runs on each OS itself
... View more