Cloudera Data Analytics (CDA) Articles

Announcements
Welcome to the upgraded Community! Read this blog to see What’s New!
avatar
Cloudera Employee

Keyword Search

  • Deploy Cloudera Manager Dashboards
  • Free Manager Dashboards
  • Cloudera Manager Troubleshooting
  • Monitor CDP Cluster
  • Proactively resolve Cloudera Manager alerts
  • Cloudera Manager Monitoring
  • JSON
  • Health monitoring
  • Impala health monitoring
  • YARN health monitoring
  • HBase tuning
  • HDFS caching
  • Datanode health monitoring
  • HDFS NN & JN health monitoring
  • Hive health monitoring
  • Impala monitor coordinators
  • Infra-Solr health monitoring
  • Solr health monitoring
  • HDFS JVM GC Sizing
  • YARN JVM GC Sizing
  • MGMT Cluster JVM GC Sizing
  • ZK JVM GC Sizing
  • Oozie JVM GC Sizing
  • Hive JVM GC Sizing

Summary

Out of the box, Cloudera Manager provides plenty of valuable health checks to highlight platform and service issues that may need to be addressed along with an intuitive interface for troubleshooting issues. Nevertheless, the greater the quantity of pipelines and processes the platform supports (especially at peak loads/times), the higher the probability that you would benefit from additional visibility into overall cluster performance. To that end, we’re offering you JSON files of custom Cloudera Manager dashboards to import into your CM ’managed cluster:

Here are the links (Change this to Snapshots) to the dashboards we will preview below:

image4.png

NOTE - you must change the user ID that is within each JSON file from ‘mbush’ to a suitable admin user account within your own environment, prior to uploading them in Cloudera Manager.

 

image3.png

 

Three Daily Dashboards

We recommend using the following dashboards every day:

  • MB - Overall Health
  • MB - Impala Health
  • MB - YARN Health

The Overall Health dashboard depicts a mix of insights across the entire cluster to identify abnormalities affecting any node when it comes to CPU, memory, etc.

 

NOTE: the ‘Time Series’ in the top right corner of every screenshot which shows the monitoring time period. The longer the time period set, the more skewed the statistics can become within the CM dashboard due to metric aggregation.

 

 MB - Overall Health (screenshots)

image15.png

 

 image17.png

image14.png

In any CDP cluster, it is important to verify that the Impala service is healthy. It is common to see that ETL-style workloads have been deployed within the Impala service, where Hive, Spark, or YARN would have been more suitable. The 3 dashboards depicted below can help analyze workload balance and provide valuable insights you can use to begin migrating those workloads from Impala to YARN.

 

MB - Impala Health (screenshots)

image26.png

 

image12.png

image24.png

MB - YARN Health (screenshots)

image32.png

image20.png

Seven Weekly Dashboards

We recommend using the following dashboards weekly, or more frequently to identify unexpected behavior or instability within your cluster:

  • MB - HBase Tuning
  • HDFS Caching & Datanode Health
  • MB - HDFS NN & JN Health
  • MB - Hive Health
  • MB - Impala Monitor Co-ordinators
  • MB - Infra-Solr Health
  • MB - Solr Health

MB - HBase Tuning (screenshots)

image31.png

 image30.png

image5.png

HDFS Caching & Datanode Health (screenshots)

image33.png

image23.png

image1.png

MB - HDFS NN & JN Health (screenshots)

image29.png

image18.png

MB - Hive Health (screenshots)

image10.png

MB - Impala Monitor Co-ordinators (screenshots)

image2.png

MB - Infra-Solr Health (screenshots)

image25.png

image27.png

image28.png

MB - Solr Health (screenshots)

image9.png

image22.png

Three Monthly Dashboards

As with the Weekly Used Dashboards, these dashboards can quite often be used daily if identifying unexpected behavior or instability within the cluster but we recommend using them at least monthly to proactively identify that service/role heap sizing is in a healthy state:

  • MB - HDFS & YARN - JVM GC Sizing
  • MB - MGMT Cluster - JVM GC Sizing
  • MB - ZK, Oozie & Hive - JVM GC Sizing

MB - HDFS & YARN - JVM GC Sizing (screenshots)

image14.png

image8.png

image11.png

MB - MGMT Cluster - JVM GC Sizing (screenshots)

image19.png

image6.png

image13.png

MB - ZK, Oozie & Hive - JVM GC Sizing (screenshots)

image21.png

100 Views
0 Kudos