Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Mysql Tables decription - for all users

Mysql Tables decription - for all users

Explorer

Hi,

      I have installed cloudera for 60 days trail using Path B Installation (CDH Version 5.9).

 

     We have many mysql tables as follows:

 

| scm | AUDITS | BASE TABLE | |
| scm | CLIENT_CONFIGS | BASE TABLE | |
| scm | CLIENT_CONFIGS_TO_HOSTS | BASE TABLE | |
| scm | CLUSTERS | BASE TABLE | |
| scm | CLUSTERS_AUD | BASE TABLE | |
| scm | CLUSTER_ACTIVATED_RELEASES | BASE TABLE | |
| scm | CLUSTER_ACTIVATED_RELEASES_AUD | BASE TABLE | |
| scm | CLUSTER_MANAGED_RELEASES | BASE TABLE | |
| scm | CLUSTER_UNDISTRIBUTED_RELEASES | BASE TABLE | |
| scm | CM_PEERS | BASE TABLE | |
| scm | CM_VERSION | BASE TABLE | |
| scm | COMMANDS | BASE TABLE | |
| scm | COMMAND_SCHEDULES | BASE TABLE | |
| scm | CONFIGS | BASE TABLE | |
| scm | CONFIGS_AUD | BASE TABLE | |
| scm | CONFIG_CONTAINERS | BASE TABLE | |
| scm | CREDENTIALS | BASE TABLE | |
| scm | DIAGNOSTICS_EVENTS | BASE TABLE | |
| scm | EXTERNAL_ACCOUNTS | BASE TABLE | |
| scm | EXTERNAL_ACCOUNTS_AUD | BASE TABLE | |
| scm | GLOBAL_SETTINGS | BASE TABLE | |
| scm | HOSTS | BASE TABLE | |
| scm | HOSTS_AUD | BASE TABLE | |
| scm | HOST_TEMPLATES | BASE TABLE | |
| scm | HOST_TEMPLATE_TO_ROLE_CONF_GRP | BASE TABLE | |
| scm | METRICS | BASE TABLE | |
| scm | PARCELS | BASE TABLE | |
| scm | PARCEL_COMPONENTS | BASE TABLE | |
| scm | PROCESSES | BASE TABLE | |
| scm | PROCESS_ACTIVE_RELEASES | BASE TABLE | |
| scm | RELEASES | BASE TABLE | |
| scm | RELEASES_AUD | BASE TABLE | |
| scm | REVISIONS | BASE TABLE | |
| scm | ROLES | BASE TABLE | |
| scm | ROLES_AUD | BASE TABLE | |
| scm | ROLE_CONFIG_GROUPS | BASE TABLE | |
| scm | ROLE_CONFIG_GROUPS_AUD | BASE TABLE | |
| scm | ROLE_STALENESS_STATUS | BASE TABLE | |
| scm | SCHEMA_VERSION | BASE TABLE | |
| scm | SERVICES | BASE TABLE | |
| scm | SERVICES_AUD | BASE TABLE | |
| scm | SNAPSHOT_POLICIES | BASE TABLE | |
| scm | USERS | BASE TABLE | |
| scm | USER_ROLES | BASE TABLE | |
| scm | USER_SETTINGS | BASE TABLE | |



Is there any document for these tables??? like whats stored in each table???

Thanks & Regards,

Akki

4 REPLIES 4
Highlighted

Re: Mysql Tables decription - for all users

Explorer

Hi... Any help from anyone????

Re: Mysql Tables decription - for all users

Rising Star

Hi,

There is no documentation available for the Cloudera Manager database schema. Typically this is not something you would want to interact with directly, perhaps you could outline what it is you are trying to do? Any changes that you would like to make ought to be done using either the Cloudera Manager web interface or via the Cloudera Manager API.

 

Regards,

Jim

Re: Mysql Tables decription - for all users

Explorer

Hi jim,

 

         We are trying to look into in detail on Metadata. And we are checking whether it satisfy our application requirement, like statatistics on:
              * Largest table in Hive/Impala/Spark
              * Which query is taking high CPU etc...

         But we don't know these informations are captured in which tables.

Thanks & Regards,
Akshath Hegde

Re: Mysql Tables decription - for all users

Rising Star

Hi,
You will probably not find what you're looking for by going straight to the Cloudera Manager database. The database mostly contains configuration information about the cluster and not metadata and usage statistics.

 

  • Hive statistics are best gathered from within Hive itself. The Cloudera documentation link below on Hive statistics should prove useful.

https://www.cloudera.com/documentation/enterprise/latest/topics/impala_perf_stats.html

 

  • Cloudera Manager metrics can be searched using the web UI. Under the YARN service the Applications tab provides an interface for faceted search on the jobs that have been run on your cluster. There is a similar interface for examining Impala queries.
  • The Cloudera Manager API provides a way access this data from outside of the web UI if you need to integrate these metrics with external tools. This is a much better approach than trying to reverse engineer the database storage to achieve the same goal.

 

Regards,
Jim