Member since
09-20-2017
9
Posts
0
Kudos Received
0
Solutions
03-10-2018
10:24 PM
@Leonardo Apolonio Ambari Metrics collector allows the user to send metrics to it in a particular format as described in the : https://cwiki.apache.org/confluence/display/AMBARI/Metrics+Collector+API+Specification So you can write a custom script on every host to run regularly and provide the JSON like this: Example: {
"metrics": [{
"metricname": "test.diskstat_Metric",
"appid": "testdiskstate",
"hostname": "host1.example.com",
"timestamp": 1520720082573,
"starttime": 1520720082000,
"metrics": {
"1520720082573": 315
}
}]
} Here you will need your custom script to produce the above kind of JSON format data and then post it to Abari Metrics Collector using http POST method. Please review the following blog for similar implementation: AMSSMOKETESTFAKE https://bryanbende.com/development/2015/07/31/ambari-metrics-part1-metrics-collector .
... View more
03-10-2018
09:59 PM
@Leonardo Apolonio Unfortunately there is no out of the box metrics available which can plot the average number of exceptions in amabri metrics. However you might want to see the Ambari Metrics Collector specification to know how it works and it allows users to create and register custom metrics as well. https://cwiki.apache.org/confluence/display/AMBARI/Metrics+Collector+API+Specification
... View more
03-08-2018
09:30 AM
1 Kudo
@Leonardo Apolonio You might be using Ambari 2.6.1.3 The "HostCleanup.py" script is moved to the following location: # ls -l /usr/lib/ambari-agent/lib/ambari_agent/HostCleanup.py
-rwxr-xr-x. 1 root root 22464 Feb 6 13:03 /usr/lib/ambari-agent/lib/ambari_agent/HostCleanup.py . For the change details review please refer to: https://issues.apache.org/jira/browse/AMBARI-22830 Changes can be seen here: https://github.com/apache/ambari/pull/229/files
... View more
03-06-2018
11:05 PM
@Leonardo Apolonio Either you will need to run ambari server azs "root" user. (OR) You will need to configure the non root user "hydra" in the "sudoer" list. . Regarding your query: "Does ambari-server user need sudo privileges?" If using non root user then yes, ambari server's user needs to be configured as sudo user. Please refer to the following docs: (Ambari server Sudoer config) 1. https://docs.hortonworks.com/HDPDocuments/Ambari-2.6.1.3/bk_ambari-security/content/sudo_defaults_server.html 2. https://docs.hortonworks.com/HDPDocuments/Ambari-2.6.1.3/bk_ambari-security/content/sudoer_configuration_server.html 3. List of commands: https://docs.hortonworks.com/HDPDocuments/Ambari-2.6.1.3/bk_ambari-security/content/commands_server.html 4. Sudo Defaults for Ambari Server: https://docs.hortonworks.com/HDPDocuments/Ambari-2.6.1.3/bk_ambari-security/content/sudo_defaults_server.html .
... View more
03-04-2018
07:13 AM
1 Kudo
@Leonardo Apolonio We see the error as conflict between packages: file /usr/lib/python2.6/site-packages from install of ambari-agent-2.6.1.0-143.x86_64 conflicts with file from package ambari-server-2.6.1.0-0.x86_64 . This error indicates that you have AmbariServer package of version 2.6.1.0.0 but trying to install Ambari-Agent of version 2.6.1.0-143 (slightly higher). Which is causing the conflict. . Please check if you have duplicate ambari repos like (2.6.1.0-143 as well as 2.6.1.0.0 both) on the same host? In that case remove the Old unwanted ambari repo from the mentioned dir and then perform a yum clean. # grep baseurl /etc/yum.repos.d/* | grep ambari So can you please try this: # yum clean all . Then retry the agent installation or try the "yum upgrade ambari-server" first and then upgrade the agent. # sudo yum upgrade ambari-server
# sudo yum upgrade ambari-agent .
... View more
10-13-2017
09:28 PM
https://spark.apache.org/docs/1.6.2/monitoring.html This is old but still useful. http://hadooptutorial.info/yarn-web-ui/ I know you can get the info from the RM UI. You should be able to get it from the Spark History UI through curl commands as well. The information could then be fed into Ganglia.
... View more