https://community.cloudera.com/t5/Archives-of-Support-Questions/in-HDP-2-6-1-ambari-metrics-store-data-in-hbase/m-p/184245#M70986 <P>Hello All,</P><P>We were using following query to get cpu details in hdp 2.3.4 from hbase via poenix, but I do not see any tables or schema for ambari metrics in hdp2.6.1. So do we still have this information in hbase or it is moved to some other components ? Or I am doing something wrong. </P><P>select * from METRIC_RECORD where METRIC_NAME like 'cpu%' ;</P> Wed, 08 Nov 2017 20:01:45 GMT SK1 2017-11-08T20:01:45Z https://community.cloudera.com/t5/Archives-of-Support-Questions/in-HDP-2-6-1-ambari-metrics-store-data-in-hbase/m-p/184245#M70986 <P>Hello All,</P><P>We were using following query to get cpu details in hdp 2.3.4 from hbase via poenix, but I do not see any tables or schema for ambari metrics in hdp2.6.1. So do we still have this information in hbase or it is moved to some other components ? Or I am doing something wrong. </P><P>select * from METRIC_RECORD where METRIC_NAME like 'cpu%' ;</P> Wed, 08 Nov 2017 20:01:45 GMT https://community.cloudera.com/t5/Archives-of-Support-Questions/in-HDP-2-6-1-ambari-metrics-store-data-in-hbase/m-p/184245#M70986 SK1 2017-11-08T20:01:45Z https://community.cloudera.com/t5/Archives-of-Support-Questions/in-HDP-2-6-1-ambari-metrics-store-data-in-hbase/m-p/184246#M70987 <P><A rel="user" href="https://community.cloudera.com/users/2273/saurabhmcakiet.html" nodeid="2273"></A><A rel="user" href="https://community.cloudera.com/users/2273/saurabhmcakiet.html" nodeid="2273">@Saurabh<BR /></A></P><P>It works in HDP 2.6.1 as well. The AMS collector (Binaries) actually comes from Ambari repo so it basically depends on your Ambari Version.<BR /><BR /><STRONG>Example:</STRONG> </P><PRE># /usr/lib/ambari-metrics-collector/bin/sqlline.py amb25102.example.com:61181/ams-hbase-unsecure 0: jdbc:phoenix:amb25102.example.com:61181/am&gt; !tables 0: jdbc:phoenix:amb25102.example.com:61181/am&gt; select * from METRIC_RECORD where METRIC_NAME like 'cpu%' ;</PRE><P>.</P><P><STRONG>Example Output:<BR />================ (From HDP 2.6.1 and Ambari 2.5.1)</STRONG></P><PRE> 0: jdbc:phoenix:amb25102.example.com:61181/am&gt; !tables +------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+-------------------+ | TABLE_CAT | TABLE_SCHEM | TABLE_NAME | TABLE_TYPE | REMARKS | TY | +------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+-------------------+ | | SYSTEM | CATALOG | SYSTEM TABLE | | | | | SYSTEM | FUNCTION | SYSTEM TABLE | | | | | SYSTEM | SEQUENCE | SYSTEM TABLE | | | | | SYSTEM | STATS | SYSTEM TABLE | | | | | | CONTAINER_METRICS | TABLE | | | | | | HOSTED_APPS_METADATA | TABLE | | | | | | INSTANCE_HOST_METADATA | TABLE | | | | | | METRICS_METADATA | TABLE | | | | | | METRIC_AGGREGATE | TABLE | | | | | | METRIC_AGGREGATE_DAILY | TABLE | | | | | | METRIC_AGGREGATE_HOURLY | TABLE | | | | | | METRIC_AGGREGATE_MINUTE | TABLE | | | | | | METRIC_RECORD | TABLE | | | | | | METRIC_RECORD_DAILY | TABLE | | | | | | METRIC_RECORD_HOURLY | TABLE | | | | | | METRIC_RECORD_MINUTE | TABLE | | | | | ACTIVITY | ACTIVITY_QUEUE | TABLE | | | | | ACTIVITY | CONFIG | TABLE | | | | | ACTIVITY | COUNTER | TABLE | | | | | ACTIVITY | FAILED_ACTIVITY | TABLE | | | | | ACTIVITY | HDFS_FILES | TABLE | | | | | ACTIVITY | HDFS_USER_FILE_SUMMARY | TABLE | | | | | ACTIVITY | JOB | TABLE | | | | | ACTIVITY | RECOMMENDATION | TABLE | | | | | ACTIVITY | SCHEMA_INFO | TABLE | | | | | ACTIVITY | TASK | TABLE | | | | | ACTIVITY | YARN_APPLICATION | TABLE | | | +------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+-------------------+ 0: jdbc:phoenix:amb25102.example.com:61181/am&gt; select * from METRIC_RECORD where METRIC_NAME like 'cpu%' ; +------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+-------------------+ | METRIC_NAME | HOSTNAME | SERVER_TIME | APP_ID | INSTANCE_ID | ST | +------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+-------------------+ | cpu_idle | amb25101.example.com | 1510056657199 | HOST | | 1510056595545 | | cpu_idle | amb25101.example.com | 1510056717578 | HOST | | 1510056655559 | | cpu_idle | amb25101.example.com | 1510056778195 | HOST | | 1510056715570 | | cpu_idle | amb25101.example.com | 1510056838608 | HOST | | 1510056775637 |</PRE><P>.</P><P><A rel="user" href="https://community.cloudera.com/users/2273/saurabhmcakiet.html" nodeid="2273"></A><A rel="user" href="https://community.cloudera.com/users/2273/saurabhmcakiet.html" nodeid="2273"></A> </P> Wed, 08 Nov 2017 20:14:05 GMT https://community.cloudera.com/t5/Archives-of-Support-Questions/in-HDP-2-6-1-ambari-metrics-store-data-in-hbase/m-p/184246#M70987 jsensharma 2017-11-08T20:14:05Z https://community.cloudera.com/t5/Archives-of-Support-Questions/in-HDP-2-6-1-ambari-metrics-store-data-in-hbase/m-p/184247#M70988 <P><A rel="user" href="https://community.cloudera.com/users/2273/saurabhmcakiet.html" nodeid="2273">@Saurabh<BR /></A></P><P>Regarding your Query "in HDP 2.6.1 ambari metrics store data in hbase ?"</P><P>AMS stores data inside HBase. </P><P>AMS collector can be configured in two ways "Embedded" (Where it stores data in to local filesystem inside the HBase DB.</P><P>In case of "Distributed" mode the Data is stored in HDFS. But HBase is used in both cases.</P><P><A href="https://cwiki.apache.org/confluence/display/AMBARI/AMS+-+distributed+mode" target="_blank">https://cwiki.apache.org/confluence/display/AMBARI/AMS+-+distributed+mode</A></P><P>.</P><P><BR /><A rel="user" href="https://community.cloudera.com/users/2273/saurabhmcakiet.html" nodeid="2273"></A> </P> Wed, 08 Nov 2017 20:17:05 GMT https://community.cloudera.com/t5/Archives-of-Support-Questions/in-HDP-2-6-1-ambari-metrics-store-data-in-hbase/m-p/184247#M70988 jsensharma 2017-11-08T20:17:05Z https://community.cloudera.com/t5/Archives-of-Support-Questions/in-HDP-2-6-1-ambari-metrics-store-data-in-hbase/m-p/184248#M70989 <P><A rel="user" href="https://community.cloudera.com/users/2273/saurabhmcakiet.html" nodeid="2273">@Saurabh<BR /></A></P><P>Following are some very good PPT on Ambari Metrics Collector:</P><P>1). <A target="_blank" href="https://www.slideshare.net/AravindanVijayan/ambari-metrics-system-apache-ambari-meetup-dataworks-summit-2017">Ambari metrics system - Apache ambari meetup (DataWorks Summit 2017)</A></P><P>2). <A target="_blank" href="https://www.slideshare.net/prajrao/apache-ambari-meetup-ams-grafana">Apache Ambari Meetup - AMS &amp; Grafana</A><A rel="user" href="https://community.cloudera.com/users/2273/saurabhmcakiet.html" nodeid="2273"></A> </P> Wed, 08 Nov 2017 20:24:02 GMT https://community.cloudera.com/t5/Archives-of-Support-Questions/in-HDP-2-6-1-ambari-metrics-store-data-in-hbase/m-p/184248#M70989 jsensharma 2017-11-08T20:24:02Z https://community.cloudera.com/t5/Archives-of-Support-Questions/in-HDP-2-6-1-ambari-metrics-store-data-in-hbase/m-p/184249#M70990 <P>Thanks a lot <A rel="user" href="https://community.cloudera.com/users/3418/jsensharma.html" nodeid="3418">@Jay Kumar SenSharma</A></P> Wed, 08 Nov 2017 20:25:48 GMT https://community.cloudera.com/t5/Archives-of-Support-Questions/in-HDP-2-6-1-ambari-metrics-store-data-in-hbase/m-p/184249#M70990 SK1 2017-11-08T20:25:48Z