Member since
07-30-2019
453
Posts
112
Kudos Received
80
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
1510 | 04-12-2023 08:58 PM | |
3562 | 04-04-2023 11:48 PM | |
1058 | 04-02-2023 10:24 PM | |
2716 | 07-05-2019 08:38 AM | |
2778 | 05-13-2019 06:21 AM |
08-18-2019
09:29 PM
Hi @Koffi , yarn.nodemanager.log-dirs is where User Jobs Containers write the stdout, stderr and syslogs. Yarn has log aggregation which copies the log files from NodeManager local directory to HDFS and remove them. In yarn-site.xml look for below property in yarn configs in ambari (the below is from my property) <property> <name>yarn.nodemanager.log-dirs</name> <value>/var/log/hadoop/yarn/log</value> </property> And make sure dedicated disk is allocated. And one more chance of disks getting full is if more parallel containers running on a NodeManager and writing too much of intermediate data. The most common cause of log-dirs are bad is due to available disk space on the node exceeding yarn's max-disk-utilization-per-disk-percentage default value of 90.0%. Either clean up the disk that the unhealthy node is running on, or increase the threshold in yarn-site.xml. if you are more interested, please read : https://blog.cloudera.com/resource-localization-in-yarn-deep-dive/
... View more
08-14-2019
07:24 AM
well written article , For those who are using oracle database, we need to commit the transaction done after this changes.
... View more
07-19-2019
04:05 AM
Hi @CarlosHS, inorder to perform CURL/REST APi with Nifi, you might need a access token , as per blog : following command will get you the access token curl 'https://nifi-host:port/nifi-api/access/token' -H 'Content-Type: application/x-www-form-urlencoded; charset=UTF-8' --data 'username=ldap-username&password=ldap-password' --compressed —insecure Later this token need to be reused for all operations like : curl -k ’https://nifi-host:port/nifi-api/flow/process-groups/root/status' -H “Authorization: Bearer $token” hope this helps
... View more
07-05-2019
08:38 AM
2 Kudos
Hi @Narendra Neerukonda, As the Article Says : Note: You can add comma separated inputs if you need any inputs for the script. you can actually pass the parameters to the script like this : curl -u <username>:<password> -X POST -H 'X-Requested-By:ambari' -d'{"RequestInfo":{"context":"Execute my action", "action":"my_action", "parameters" : {"my_input" : "value"}}, "Requests/resource_filters":[{"service_name":"", "component_name":"", "hosts":"<comma_separated_host_names>"}]' http://<ambari_host>:<port>/api/v1/clusters/<cluster_name>/requests Where "my_input" is paramter name and "value" is the value to be passed. Hope this helps. Please accept answer and vote up if it did.
... View more
05-22-2019
03:41 AM
Helpfull Article to update Repo URLS incase manage version UI is not loading.
... View more
05-13-2019
07:36 AM
1 Kudo
its not suggested to delete the Intermediate files of hbase directory directly. follow this : if you are ok with data erasing : https://cwiki.apache.org/confluence/display/AMBARI/Cleaning+up+Ambari+Metrics+System+Data
... View more
05-13-2019
07:32 AM
1 Kudo
you should be copying the directory structure as it is . Create folder hbase and hbase in /data_metrics/lib/ambari-metrics-collector/ and copy the contents from other place as it is.
... View more
05-13-2019
06:24 AM
2 Kudos
Hi @Michael Bronson , If you want to preserve the metrics data of AMS , please follow the steps here : https://community.hortonworks.com/questions/246159/ambari-metrics-change-the-path-of-hbaserootdir-bec.html If you dont want to preserve the data of AMS and just want to clean it up : please refer to : https://cwiki.apache.org/confluence/display/AMBARI/Cleaning+up+Ambari+Metrics+System+Data Refer to this blog if you are more interested in reading blogs : https://community.hortonworks.com/articles/144318/identifying-and-tackling-scale-problems-in-ambari.html Please accept answer if this Helps 🙂
... View more
05-13-2019
06:21 AM
1 Kudo
HI @Michael Bronson , Referring to your doubt of Changing the hbase.rootdir Please follow the following steps and let me know if this helps ( I am assuming that you need to preserve all the Previously collected metrics ) Steps 1)Stop ambari-metrics 2) Copy the contents of /var/lib/ambari-metrics-collector/ to the New directory you want to set as new for ex : cd /var/lib/ambari-metrics-collector/
mv hbase hbase-tmp/ /tmp/ambari-metrics-collector/ 3) go to ambari-ui->services->ambari-metrics->config -> search for hbase.rootdir and hbase.tmpdir and change it accordingly as per new Folder sctructure. 4) Start ambari-metrics collector 5) you can see AMS has successfully using the new Hbase dir and also the old matrics are preserved Let me know if this helps. Please accept the answer if it did.
... View more
03-25-2019
03:55 AM
This is so informative :). Helps alot as there is no bulk delete operation via UI
... View more