Member since
08-08-2017
1652
Posts
30
Kudos Received
11
Solutions
My Accepted Solutions
| Title | Views | Posted |
|---|---|---|
| 1970 | 06-15-2020 05:23 AM | |
| 16069 | 01-30-2020 08:04 PM | |
| 2108 | 07-07-2019 09:06 PM | |
| 8247 | 01-27-2018 10:17 PM | |
| 4674 | 12-31-2017 10:12 PM |
11-13-2017
06:30 PM
we see the system log on one of the worker machine ( dmesg ) and from the log we saw that: (sdc): warning: mounting fs with errors, running
e2fsck is recommended disk - sdc include the HDFS folder - hdfs files df | grep sdc /dev/sdc 1922721048 1560852 1921143812 1% /grop/sdc
ls /grop/sdc/hadoop/
hdfs yarn so is it safe to run the following ( as OS logs recommended ) , <in spite disk include HDFS files , is it risky?> e2fsck -y /dev/sdc
... View more
Labels:
- Labels:
-
Apache Ambari
-
Apache Hadoop
11-13-2017
05:22 AM
in our system we have more then 35 workers machines , we notice yesterday that one of the disk became write protected and the solution was to remount during remount we see OS logs ( dmesg ) that fsck is needed on the disk /dev/sdc because that , we want to know if some function in ambari cluster can verify or check the amari cluster machine and notify about this problem ( fsck is needed ) please advice how we can avoid such this cases and how ambari cluster can notify us about correpted disks
... View more
Labels:
- Labels:
-
Apache Ambari
-
Apache Hadoop
11-12-2017
09:03 AM
hi Aditya , just to be clear the status for now is that , from ambari GUI when I go to actions --> add service , then I see the Knox service but it is uncheck in the checkbox ! , so what are the steps from here ? , do we need in this case to do ( add service and install service ? )
... View more
11-11-2017
07:23 PM
here is how I check the service name curl -k -u xxxxx:xxxx -H "X-Requested-By:ambari" -i -X GET http://182.243.5.12 :8080/api/v1/clusters/HDP101/stack_versions/1/repository_versions/1 | grep display_name | grep -i knox % Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed
100 11316 100 11316 0 0 603k 0 --:--:-- --:--:-- --:--:-- 613k
"display_name" : "Knox",
... View more
11-11-2017
07:09 PM
hi aditya , everything was great until I intend to install the service for this example we try to install the service - Knox I try this: curl -u xxxx:xxxx -i -X PUT -d '{"ServiceInfo": {"state" : "INSTALLED"}}' http://182.243.5.12 :8080/api/v1/clusters/HDP101/services/Knox HTTP/1.1 400 Bad Request
X-Frame-Options: DENY
X-XSS-Protection: 1; mode=block
X-Content-Type-Options: nosniff
Cache-Control: no-store
Pragma: no-cache
Set-Cookie: AMBARISESSIONID=13q980rkix8lh1ewku7n3xlhfh;Path=/;HttpOnly
Expires: Thu, 01 Jan 1970 00:00:00 GMT
User: admin
Content-Type: text/plain
Content-Length: 107
Server: Jetty(8.1.19.v20160209)
... View more
11-10-2017
01:14 PM
another remark if I set this value to 1 it mean that HDFS will start up in spite the volume is bad ? or not in use ,
... View more
11-10-2017
01:09 PM
yes sure thank you so much
... View more
11-10-2017
01:07 PM
hi aditye , can you give me real example for the first API second how to get these values ? stack_versions {stack-version-no} repository_versions {repository-version-no}
... View more
11-10-2017
12:59 PM
hi aditye regarding the - http://{ambari-server}:{port}/api/v1/clusters/{clustername}/services. , can you show me please the full approach ( full syntax )
... View more
11-10-2017
12:56 PM
hi Jay , I have idea but not sure about this so I need your advice , on the problematic worker we have extra volume - sdg , and the bad volume is sdf , so maybe we need to umount the sdf and mount the volume sdg in place sdf , and change the DataNode directories from ambari GUI from sdf to sdg - and then restart the component HDFS on the worker , what you think ?
... View more