Support Questions
Find answers, ask questions, and share your expertise

List of parameters reported by Ambari Agent to Ambari Server

List of parameters reported by Ambari Agent to Ambari Server

Hi All,

I am looking for the list of system parameters that amabri agent reports to the ambari

server. Any help is deeply appreciated.

Thanks,

Sakshi

1 REPLY 1

Re: List of parameters reported by Ambari Agent to Ambari Server

Expert Contributor
@sakshi chourasiaFollowing python files are used while collecting system related information on the host by ambari:

https://github.com/apache/ambari/blob/trunk/ambari-agent/src/main/python/ambari_agent/HostInfo.py

https://github.com/apache/ambari/blob/trunk/ambari-agent/src/main/python/ambari_agent/Facter.py

When ambari-agent resgisters with ambari-server, json blob reported by ambari-agent look like following:

{'hardwareProfile': {'kernel': 'Linux', 'domain': 'twcable.com', 'physicalprocessorcount': 24, 'kernelrelease': '2.6.32-431.el6.x86_64', 'uptime_days': '253', 'memorytotal': 132119088, 'swapfree': '15.99 GB', 'memorysize': 132119088, 'osfamily': 'redhat', 'swapsize': '16.00 GB', 'processorcount': 24, 'netmask': '255.255.255.0', 'timezone': 'EST', 'hardwareisa': 'x86_64', 'memoryfree': 125668248, 'operatingsystem': 'redhat', 'kernelmajversion': '2.6', 'kernelversion': '2.6.32', 'macaddress': 'A0:D3:C1:FB:61:E5', 'operatingsystemrelease': '6.5', 'ipaddress': '10.64.193.239', 'hostname': 'hdpdedge02', 'uptime_hours': '6089', 'fqdn': 'hdpdedge02.twcable.com', 'id': 'root', 'architecture': 'x86_64', 'selinux': False, 'mounts': [{'available': '4253556', 'used': '7502756', 'percent': '64%', 'device': '/dev/mapper/vg_root-lv_root', 'mountpoint': '/', 'type': 'ext4', 'size': '12385456'}, {'available': '66059396', 'used': '148', 'percent': '1%', 'device': 'tmpfs', 'mountpoint': '/dev/shm', 'type': 'tmpfs', 'size': '66059544'}, {'available': '414292', 'used': '75536', 'percent': '16%', 'device': '/dev/sda1', 'mountpoint': '/boot', 'type': 'ext3', 'size': '516040'}, {'available': '6606020', 'used': '1231504', 'percent': '16%', 'device': '/dev/mapper/vg_root-lv_export', 'mountpoint': '/export', 'type': 'ext4', 'size': '8256952'}, {'available': '7871164', 'used': '3885148', 'percent': '34%', 'device': '/dev/mapper/vg_root-lv_opt', 'mountpoint': '/opt', 'type': 'ext4', 'size': '12385456'}, {'available': '2877288', 'used': '1041448', 'percent': '27%', 'device': '/dev/mapper/vg_root-lv_tmp', 'mountpoint': '/tmp', 'type': 'ext4', 'size': '4128448'}, {'available': '7428368', 'used': '409156', 'percent': '6%', 'device': '/dev/mapper/vg_root-lv_var', 'mountpoint': '/var', 'type': 'ext4', 'size': '8256952'}, {'available': '3214473752', 'used': '397069656', 'percent': '11%', 'device': '/dev/mapper/vg_workspace-lv_workspace', 'mountpoint': '/product/ssrt_workspace', 'type': 'ext4', 'size': '3804817056'}, {'available': '97777324', 'used': '192116', 'percent': '1%', 'device': '/dev/mapper/vg_root-lv_hdptmp', 'mountpoint': '/hdptmp', 'type': 'ext4', 'size': '103212320'}, {'available': '10201972', 'used': '4493436', 'percent': '31%', 'device': '/dev/mapper/vg_root-lv_usrhdp', 'mountpoint': '/usr/hdp', 'type': 'ext4', 'size': '15481840'}, {'available': '28894904', 'used': '495940', 'percent': '2%', 'device': '/dev/mapper/vg_root-lv_varlog', 'mountpoint': '/var/log', 'type': 'ext4', 'size': '30963708'}, {'available': '95557412', 'used': '2412028', 'percent': '3%', 'device': '/dev/mapper/vg_root-lv_product', 'mountpoint': '/product/software', 'type': 'ext4', 'size': '103212320'}, {'available': '314251264', 'used': '321536', 'percent': '1%', 'device': 'ncemcorpcifs03.itss.twcable.com:/ifs/data/hdpdedge_app_code', 'mountpoint': '/product/app_code', 'type': 'nfs', 'size': '314572800'}, {'available': '2867454464', 'used': '1212764672', 'percent': '30%', 'device': 'ncemcorpcifs03.itss.twcable.com:/ifs/data/hdpdedge_app_data', 'mountpoint': '/product/app_data', 'type': 'nfs', 'size': '4080219136'}], 'hardwaremodel': 'x86_64', 'uptime_seconds': '21920401', 'interfaces': 'bond0,bond1,eth0,eth1,eth2,eth3,eth5,lo'}, 'currentPingPort': 8670, 'prefix': '/var/lib/ambari-agent/data', 'agentVersion': '2.2.1.0', 'agentEnv': {'transparentHugePage': 'never', 'hostHealth': {'agentTimeStampAtReporting': 1457381979545, 'activeJavaProcs': [{'command': '/opt/tidal/jre1.6.0_29/bin/java -cp /opt/tidal/Agent/lib/agutil.jar:/opt/tidal/Agent/lib/TAgent.jar -Xms16m -Xmx48m JAgent agent=agent_hdpdedge02 port=7105 logdays=7 OSLnk.InActTimeout=600 path=/opt/tidal/Agent bin=/opt/tidal/Agent/lib/LINUX stdout=n jobstoptree=y jobkilltree=y agplatform=LINUX calccpuload=y encryptonly=n sslvldcrt=y sslvldhst= sslvldhstpw= sshvldhst= jobexec64=n multftpstd=y', 'pid': 45319, 'hadoop': False, 'user': 'twcsched'}, {'command': '/usr/jdk64/jdk1.7.0_67/bin/java -Xmx1024m -Dhdp.version=2.2.6.0-2800 -Djava.net.preferIPv4Stack=true -Dhdp.version=2.2.6.0-2800 -Dhadoop.log.dir=/var/log/hadoop/eimetlusr -Dhadoop.log.file=hadoop.log -Dhadoop.home.dir=/usr/hdp/2.2.6.0-2800/hadoop -Dhadoop.id.str=eimetlusr -Dhadoop.root.logger=INFO,console -Djava.library.path=:/usr/hdp/2.2.6.0-2800/hadoop/lib/native/Linux-amd64-64:/usr/hdp/2.2.6.0-2800/hadoop/lib/native -Dhadoop.policy.file=hadoop-policy.xml -Djava.net.preferIPv4Stack=true -Xmx1024m -XX:MaxPermSize=512m -Dhadoop.security.logger=INFO,NullAppender org.apache.sqoop.Sqoop import --direct --connect jdbc:netezza://10.136.199.55:5480/data_fm --username ********** --password ********** --table MIGRATION_FACT --split-by CUST_ACCT_KEY -m 10 --target-dir /apps/hive/warehouse/lab_test/MIGRATION_FACT --input-fields-terminated-by \xed', 'pid': 48256, 'hadoop': True, 'user': 'eimetlusr'}], 'liveServices': [{'status': 'Healthy', 'name': 'ntpd', 'desc': ''}]}, 'reverseLookup': True, 'alternatives': [], 'umask': '18', 'firewallName': 'iptables', 'stackFoldersAndFiles': [{'type': 'directory', 'name': '/etc/hadoop'}, {'type': 'directory', 'name': '/etc/hive'}, {'type': 'directory', 'name': '/etc/oozie'}, {'type': 'directory', 'name': '/etc/sqoop'}, {'type': 'directory', 'name': '/etc/zookeeper'}, {'type': 'directory', 'name': '/etc/storm'}, {'type': 'directory', 'name': '/etc/hive-hcatalog'}, {'type': 'directory', 'name': '/etc/tez'}, {'type': 'directory', 'name': '/etc/falcon'}, {'type': 'directory', 'name': '/etc/hive-webhcat'}, {'type': 'directory', 'name': '/etc/slider'}, {'type': 'directory', 'name': '/etc/storm-slider-client'}, {'type': 'directory', 'name': '/etc/spark'}, {'type': 'directory', 'name': '/etc/pig'}, {'type': 'directory', 'name': '/etc/ambari-metrics-monitor'}, {'type': 'directory', 'name': '/var/run/hadoop'}, {'type': 'directory', 'name': '/var/run/hive'}, {'type': 'directory', 'name': '/var/run/oozie'}, {'type': 'directory', 'name': '/var/run/zookeeper'}, {'type': 'directory', 'name': '/var/run/storm'}, {'type': 'directory', 'name': '/var/run/falcon'}, {'type': 'directory', 'name': '/var/run/webhcat'}, {'type': 'directory', 'name': '/var/run/hadoop-yarn'}, {'type': 'directory', 'name': '/var/run/hadoop-mapreduce'}, {'type': 'directory', 'name': '/var/run/spark'}, {'type': 'directory', 'name': '/var/run/ambari-metrics-monitor'}, {'type': 'directory', 'name': '/var/log/hadoop'}, {'type': 'directory', 'name': '/var/log/hive'}, {'type': 'directory', 'name': '/var/log/oozie'}, {'type': 'directory', 'name': '/var/log/sqoop'}, {'type': 'directory', 'name': '/var/log/zookeeper'}, {'type': 'directory', 'name': '/var/log/storm'}, {'type': 'directory', 'name': '/var/log/falcon'}, {'type': 'directory', 'name': '/var/log/hadoop-yarn'}, {'type': 'directory', 'name': '/var/log/hadoop-mapreduce'}, {'type': 'directory', 'name': '/var/log/spark'}, {'type': 'directory', 'name': '/var/log/ambari-metrics-monitor'}, {'type': 'directory', 'name': '/usr/lib/hadoop'}, {'type': 'directory', 'name': '/usr/lib/flume'}, {'type': 'directory', 'name': '/usr/lib/storm'}, {'type': 'directory', 'name': '/var/lib/hive'}, {'type': 'directory', 'name': '/var/lib/oozie'}, {'type': 'directory', 'name': '/var/lib/hadoop-hdfs'}, {'type': 'directory', 'name': '/var/lib/hadoop-yarn'}, {'type': 'directory', 'name': '/var/lib/hadoop-mapreduce'}, {'type': 'directory', 'name': '/var/lib/spark'}], 'existingUsers': [{'status': 'Available', 'name': 'hive', 'homeDir': '/home/hive'}, {'status': 'Available', 'name': 'oozie', 'homeDir': '/home/oozie'}, {'status': 'Available', 'name': 'ambari-qa', 'homeDir': '/home/ambari-qa'}, {'status': 'Available', 'name': 'flume', 'homeDir': '/home/flume'}, {'status': 'Available', 'name': 'hdfs', 'homeDir': '/home/hdfs'}, {'status': 'Available', 'name': 'knox', 'homeDir': '/home/knox'}, {'status': 'Available', 'name': 'storm', 'homeDir': '/home/storm'}, {'status': 'Available', 'name': 'spark', 'homeDir': '/home/spark'}, {'status': 'Available', 'name': 'mapred', 'homeDir': '/home/mapred'}, {'status': 'Available', 'name': 'tez', 'homeDir': '/home/tez'}, {'status': 'Available', 'name': 'zookeeper', 'homeDir': '/home/zookeeper'}, {'status': 'Available', 'name': 'kafka', 'homeDir': '/home/kafka'}, {'status': 'Available', 'name': 'falcon', 'homeDir': '/home/falcon'}, {'status': 'Available', 'name': 'sqoop', 'homeDir': '/home/sqoop'}, {'status': 'Available', 'name': 'yarn', 'homeDir': '/home/yarn'}, {'status': 'Available', 'name': 'hcat', 'homeDir': '/home/hcat'}, {'status': 'Available', 'name': 'ams', 'homeDir': '/home/ams'}, {'status': 'Available', 'name': 'ranger', 'homeDir': '/home/ranger'}], 'firewallRunning': False}, 'timestamp': 1457381979468, 'hostname': 'hdpdedge02.twcable.com', 'responseId': -1, 'publicHostname': 'c6401.ambari.apache.org'}

some of these host related information is also exposed by ambri-server RESTful API via host resource endpoint:

http://localhost:8080/api/v1/clusters/c1/hosts/c6401.ambari.apache.org

Above API will return c6401.ambari.apache.org host information like disk info, memory, os family, etc