About amarn_ucs2014

amarn_ucs2014 · ‎09-20-2018

How do I integrate Keycloak as identity and access management tool instead of Apache Knox for ambari? Ambari uses AD for external authentication.

TarunParimi · ‎09-07-2018

@naveen r The amount of resource a Yarn application will request is completely dependent on the type of Application. For MapReduce, it is generally based on the inputsplit/no. of reducers configured and the memory/vcores configured per mapper/reducer in the JobConf. To check how much Resources are currently being used by a single application, you can use the following Rest API and check the fields "allocatedMB","allocatedVCores" and "runningContainers" GET http://<rm http address:port>/ws/v1/cluster/apps/<applicationId>

ssubhas · ‎08-29-2018

@naveen r Run Hive query would be running a YARN application and when the queue resource is utilized, then the performance of the query would be affected with respect to container allocation. Wrt HDFS, Hive query would be writing intermediate results, join data spills on the user's temporary directory on HDFS. Less or no storage would be lead to query failures.

amarn_ucs2014 · ‎08-29-2018

I'm getting bad request as response with message "Attempted to add unknown hosts to a cluster. These hosts have not been registered with the server"

rtheron · ‎08-17-2018

try to manually ssh between the ambari host and new host using the private/public key pair via terminal, in some cases a first time connection needs to be established to add the host to the known hosts file

JonathanSneep · ‎08-14-2018

There are a variety of options for memory. I just tried the same for my cluster and using for example fields=metrics/memory/Use._avg[1534235091,1534235391,15] worked well. Further options quoted from the source code; /clusters/{clusterName}/?fields=metrics/memory/Buffer._avg[{fromSeconds},{toSeconds},{stepSeconds}],metrics/memory/Cache._avg[{fromSeconds},{toSeconds},{stepSeconds}],metrics/memory/Share._avg[{fromSeconds},{toSeconds},{stepSeconds}],metrics/memory/Swap._avg[{fromSeconds},{toSeconds},{stepSeconds}], metrics/memory/Total._avg[{fromSeconds},{toSeconds},{stepSeconds}], metrics/memory/Use._avg[{fromSeconds},{toSeconds},{stepSeconds}]',

akhilsnaik · ‎08-07-2018

Hi i @amarnath v, I assume the question is for creating a customer ambari alert . what do you mean by new job running . is it the yarn job or any operations that ambari performs. You can create Custom ambari alerts following the link: https://community.hortonworks.com/articles/38149/how-to-create-and-register-custom-ambari-alerts.html If you would like to configure email notification for every ambari alert. you can follow this link : https://docs.hortonworks.com/HDPDocuments/Ambari-2.6.2.2/bk_ambari-operations/content/creating_or_editing_notifications.html If you would like to know about the yarn jobs status you can refer to Ambari metrics collector and Grafana dashboards available : https://docs.hortonworks.com/HDPDocuments/Ambari-2.6.2.0/bk_ambari-operations/content/grafana_yarn_queues.html Not sure which is your version of ambari. you can find docs.hortonworks.com of coresponding version for ambari metrics collector.

Online	Offline
Last Visited	‎11-07-2018 12:41 PM

Date Registered	‎08-07-2018 12:54 PM
Last Visited	‎11-07-2018 12:41 PM
Total Messages Posted	10

Ambari SSO with Keycloak

Re: how much resource a yarn application requests ...

Re: How Apache Hive queries are affected when HDFS...

Re: ambari agent installation with api fails

Re: Adding new host(VM) to cluster failed

Re: How do I get information of CPU & memory used ...

Re: How to create a custom ambari alert for every ...