Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Cluster/Database setup: unable to connect to MySQL database

Re: Cluster/Database setup: unable to connect to MySQL database

Explorer

I then go in and manually delete the cluster via the web manager and restart the whole process. I get back to the database setup page and get the exact error as before: Cant locate template for uri 'supervisee.conf'

 

2016-07-01 11:55:30,800 INFO CommandPusher:com.cloudera.cmf.service.AbstractOneOffHostCommand: Unsuccessful 'AmonTestDatabaseConnection'
2016-07-01 11:55:30,802 INFO CommandPusher:com.cloudera.cmf.service.AbstractDbConnectionTestCommand: Command exited with code: -1
2016-07-01 11:55:30,802 INFO CommandPusher:com.cloudera.cmf.service.AbstractDbConnectionTestCommand: Error found before invoking supervisord: Cant locate template for uri 'supervisee.conf'
2016-07-01 11:55:30,803 INFO CommandPusher:com.cloudera.cmf.model.DbCommand: Command 138(AmonTestDatabaseConnection) has completed. finalstate:FINISHED, success:false, msg:Unexpected error. Unable to verify database connection.
2016-07-01 11:55:30,815 INFO CommandPusher:com.cloudera.cmf.service.AbstractOneOffHostCommand: Unsuccessful 'HiveTestDatabaseConnection'
2016-07-01 11:55:30,815 INFO CommandPusher:com.cloudera.cmf.service.AbstractDbConnectionTestCommand: Command exited with code: -1
2016-07-01 11:55:30,815 INFO CommandPusher:com.cloudera.cmf.service.AbstractDbConnectionTestCommand: Error found before invoking supervisord: Cant locate template for uri 'supervisee.conf'
2016-07-01 11:55:30,815 INFO CommandPusher:com.cloudera.cmf.model.DbCommand: Command 139(HiveTestDatabaseConnection) has completed. finalstate:FINISHED, success:false, msg:Unexpected error. Unable to verify database connection.
2016-07-01 11:55:30,827 INFO CommandPusher:com.cloudera.cmf.service.AbstractOneOffHostCommand: Unsuccessful 'OozieTestDatabaseConnection'
2016-07-01 11:55:30,827 INFO CommandPusher:com.cloudera.cmf.service.AbstractDbConnectionTestCommand: Command exited with code: -1
2016-07-01 11:55:30,827 INFO CommandPusher:com.cloudera.cmf.service.AbstractDbConnectionTestCommand: Error found before invoking supervisord: Cant locate template for uri 'supervisee.conf'
2016-07-01 11:55:30,827 INFO CommandPusher:com.cloudera.cmf.model.DbCommand: Command 140(OozieTestDatabaseConnection) has completed. finalstate:FINISHED, success:false, msg:Unexpected error. Unable to verify database connection.

Re: Cluster/Database setup: unable to connect to MySQL database

Explorer

Any help would be appreciated, I've been struggling with this for two weeks now. 

Re: Cluster/Database setup: unable to connect to MySQL database

Super Guru

The errors seem to indicate that you are not adding the agent on the hosts so that the agents cannot run the db tests to verify connectivity on the hosts where the roles will run.  You might need to clearly outline all the steps you are using to get to this point as the error itself is quite unusual.

Re: Cluster/Database setup: unable to connect to MySQL database

Explorer

To start with a clean install I ran on the Cloudera Manager host

 

> sudo service cloudera-scm-server stop
> sudo service cloudera-scm-agent stop
> sudo apt-get remove avro-tools crunch flume-ng hadoop-hdfs-fuse hadoop-hdfs-nfs3 hadoop-httpfs hadoop-kms hbase-solr hive-hbase hive-webhcat hue-beeswax hue-hbase hue-impala hue-pig hue-plugins hue-rdbms hue-search hue-spark hue-sqoop hue-zookeeper impala impala-shell kite llama mahout oozie pig pig-udf-datafu search sentry solr-mapreduce spark-core spark-master spark-worker spark-history-server spark-python sqoop sqoop2 whirr
> sudo apt-get remove cloudera-manager-agent cloudera-manager-daemons
> sudo apt-get install cloudera-manager-daemons cloudera-manager-server
> sudo apt-get remove oracle-j2sdk1.7
> sudo apt-get update

and then on every host I ran

 

> sudo service cloudera-scm-agent stop
> sudo apt-get remove avro-tools crunch flume-ng hadoop-hdfs-fuse hadoop-hdfs-nfs3 hadoop-httpfs hadoop-kms hbase-solr hive-hbase hive-webhcat hue-beeswax hue-hbase hue-impala hue-pig hue-plugins hue-rdbms hue-search hue-spark hue-sqoop hue-zookeeper impala impala-shell kite llama mahout oozie pig pig-udf-datafu search sentry solr-mapreduce spark-core spark-master spark-worker spark-history-server spark-python sqoop sqoop2 whirr
> sudo apt-get remove cloudera-manager-agent cloudera-manager-daemons
> sudo apt-get update

 

Then, following the instructions here, I am restarting from step Install Cloudera Manager Server Software. On the Cloudera Manager host I run 

sudo apt-get install cloudera-manager-daemons cloudera-manager-server

and then on every host I install Oracle JDK via

  • download tar
  • extract tar in /usr/java/jdk1.7.0_80/
  • set JAVA_HOME in /etc/default/cloudera-scm-server on all hosts

 Then on every host I run the following 

sudo apt-get install cloudera-manager-agent cloudera-manager-daemons
sudo service cloudera-scm-agent start
sudo dpkg -i ~/cdh5-repository_1.0_all.deb
curl -s https://archive.cloudera.com/cdh5/ubuntu/trusty/amd64/cdh/archive.key | sudo apt-key add -
sudo apt-get update
sudo apt-get install avro-tools crunch flume-ng hadoop-hdfs-fuse hadoop-hdfs-nfs3 hadoop-httpfs hadoop-kms hbase-solr hive-hbase hive-webhcat hue-beeswax hue-hbase hue-impala hue-pig hue-plugins hue-rdbms hue-search hue-spark hue-sqoop hue-zookeeper impala impala-shell kite llama mahout oozie pig pig-udf-datafu search sentry solr-mapreduce spark-core spark-master spark-worker spark-history-server spark-python sqoop sqoop2 whirr
sudo service cloudera-scm-agent start

I configure /etc/cloudera-scm-agent/config.ini on every host with the IP of the Cloudera Manager host. Finally, I run 

sudo service cloudera-scm-server start

go to the web installer, run through the first few screens and get to Cluster Setup / Database Setup, type in the Host Name, Database Name, Username and Password (as set in my first post), and hit Test Connection (while monitoring the log). Output from /var/log/cloudera-scm-server/cloudera-scm-server.log:

 

2016-07-06 12:36:30,462 INFO CommandPusher:com.cloudera.cmf.model.DbCommand: Command 187(OozieTestDatabaseConnection) has completed. finalstate:FINISHED, success:false, msg:Unexpected error. Unable to v
erify database connection.
2016-07-06 12:36:36,510 INFO metric-schema-updater:com.cloudera.cmon.components.MetricSchemaManager: Updating schema...
2016-07-06 12:36:36,510 INFO metric-schema-updater:com.cloudera.cmon.components.MetricSchemaManager: Reading persisted metrics...
2016-07-06 12:36:38,671 INFO metric-schema-updater:com.cloudera.cmon.components.MetricSchemaManager: Retreived 25288 metrics.
2016-07-06 12:36:38,671 INFO metric-schema-updater:com.cloudera.cmon.components.MetricSchemaManager: Registering work aggregates...
2016-07-06 12:36:40,103 INFO metric-schema-updater:com.cloudera.cmon.components.MetricSchemaUpdate: persisting 0 new metrics
2016-07-06 12:36:40,103 INFO metric-schema-updater:com.cloudera.cmon.components.MetricSchemaUpdate: persisting 0 updated metrics
2016-07-06 12:36:40,104 INFO metric-schema-updater:com.cloudera.cmon.components.MetricSchemaManager: Work aggregates processed.
2016-07-06 12:36:41,520 INFO metric-schema-updater:com.cloudera.cmon.components.MetricSchemaManager: Metric schema updated in PT5.010S.
2016-07-06 12:36:42,288 INFO metric-schema-updater:com.cloudera.cmon.MetricSchema: Switching metrics schema from IIRB7tPg7b9TNX_Xya-3_vT1xww to IIRB7tPg7b9TNX_Xya-3_vT1xww
2016-07-06 12:37:39,699 INFO StaleEntityEviction:com.cloudera.cmf.command.components.CommandManager: Deleting batch of 1 commands and its children.
2016-07-06 12:37:39,710 INFO StaleEntityEviction:com.cloudera.server.cmf.StaleEntityEvictionThread: Reaped total of 1 deleted commands
2016-07-06 12:37:39,736 INFO StaleEntityEviction:com.cloudera.server.cmf.StaleEntityEvictionThread: Found no commands older than 2014-07-07T16:37:39.711Z to reap.
2016-07-06 12:37:39,737 INFO StaleEntityEviction:com.cloudera.server.cmf.StaleEntityEvictionThread: Wizard is active, not reaping scanners or configurators
2016-07-06 12:37:49,054 INFO 972192419@scm-web-9:com.cloudera.cmf.service.ServiceHandlerRegistry: Executing host command AmonTestDatabaseConnection BasicCmdArgs{args=[hadoop2.wwbp.org, mysql, hadoop2.wwbp.org, amon, amon, amon_password]}.  Host: DbHost{id=4, hostId=a8907bf3-baac-4e11-a9cd-68c90475ca6e, hostName=hadoop2.wwbp.org}
2016-07-06 12:37:49,065 INFO 972192419@scm-web-9:com.cloudera.cmf.service.ServiceHandlerRegistry: Executing host command HiveTestDatabaseConnection BasicCmdArgs{args=[hadoop2.wwbp.org, mysql, hadoop2.wwbp.org, metastore, hive, hive_password]}.  Host: DbHost{id=4, hostId=a8907bf3-baac-4e11-a9cd-68c90475ca6e, hostName=hadoop2.wwbp.org}
2016-07-06 12:37:49,071 INFO 972192419@scm-web-9:com.cloudera.cmf.service.ServiceHandlerRegistry: Executing host command OozieTestDatabaseConnection BasicCmdArgs{args=[hadoop2.wwbp.org, mysql, hadoop2.wwbp.org, oozie, oozie, oozie_password]}.  Host: DbHost{id=4, hostId=a8907bf3-baac-4e11-a9cd-68c90475ca6e, hostName=hadoop2.wwbp.org}
2016-07-06 12:37:49,165 WARN 1370151897@agentServer-8:com.cloudera.server.cmf.AgentProtocolImpl: Received Process Heartbeat for unknown (or duplicate) process. Ignoring. This is expected to happen once after old process eviction or process deletion (as happens in restarts). id=11 name=null host=a8907bf3-baac-4e11-a9cd-68c90475ca6e/hadoop2.wwbp.org
2016-07-06 12:37:49,166 WARN 1370151897@agentServer-8:com.cloudera.server.cmf.AgentProtocolImpl: Received Process Heartbeat for unknown (or duplicate) process. Ignoring. This is expected to happen once after old process eviction or process deletion (as happens in restarts). id=12 name=null host=a8907bf3-baac-4e11-a9cd-68c90475ca6e/hadoop2.wwbp.org
2016-07-06 12:37:49,166 WARN 1370151897@agentServer-8:com.cloudera.server.cmf.AgentProtocolImpl: Received Process Heartbeat for unknown (or duplicate) process. Ignoring. This is expected to happen once after old process eviction or process deletion (as happens in restarts). id=13 name=null host=a8907bf3-baac-4e11-a9cd-68c90475ca6e/hadoop2.wwbp.org
2016-07-06 12:38:04,225 INFO CommandPusher:com.cloudera.cmf.service.AbstractOneOffHostCommand: Unsuccessful 'AmonTestDatabaseConnection'
2016-07-06 12:38:04,225 INFO CommandPusher:com.cloudera.cmf.service.AbstractDbConnectionTestCommand: Command exited with code: -1
2016-07-06 12:38:04,225 INFO CommandPusher:com.cloudera.cmf.service.AbstractDbConnectionTestCommand: Error found before invoking supervisord: Cant locate template for uri 'supervisee.conf'
2016-07-06 12:38:04,225 INFO CommandPusher:com.cloudera.cmf.model.DbCommand: Command 188(AmonTestDatabaseConnection) has completed. finalstate:FINISHED, success:false, msg:Unexpected error. Unable to verify database connection.
2016-07-06 12:38:04,237 INFO CommandPusher:com.cloudera.cmf.service.AbstractOneOffHostCommand: Unsuccessful 'HiveTestDatabaseConnection'
2016-07-06 12:38:04,237 INFO CommandPusher:com.cloudera.cmf.service.AbstractDbConnectionTestCommand: Command exited with code: -1
2016-07-06 12:38:04,237 INFO CommandPusher:com.cloudera.cmf.service.AbstractDbConnectionTestCommand: Error found before invoking supervisord: Cant locate template for uri 'supervisee.conf'
2016-07-06 12:38:04,237 INFO CommandPusher:com.cloudera.cmf.model.DbCommand: Command 189(HiveTestDatabaseConnection) has completed. finalstate:FINISHED, success:false, msg:Unexpected error. Unable to verify database connection.
2016-07-06 12:38:04,247 INFO CommandPusher:com.cloudera.cmf.service.AbstractOneOffHostCommand: Unsuccessful 'OozieTestDatabaseConnection'
2016-07-06 12:38:04,247 INFO CommandPusher:com.cloudera.cmf.service.AbstractDbConnectionTestCommand: Command exited with code: -1
2016-07-06 12:38:04,247 INFO CommandPusher:com.cloudera.cmf.service.AbstractDbConnectionTestCommand: Error found before invoking supervisord: Cant locate template for uri 'supervisee.conf'
2016-07-06 12:38:04,247 INFO CommandPusher:com.cloudera.cmf.model.DbCommand: Command 190(OozieTestDatabaseConnection) has completed. finalstate:FINISHED, success:false, msg:Unexpected error. Unable to verify database connection.
2016-07-06 12:47:39,753 INFO StaleEntityEviction:com.cloudera.server.cmf.StaleEntityEvictionThread: Reaped total of 0 deleted commands
2016-07-06 12:47:39,755 INFO StaleEntityEviction:com.cloudera.server.cmf.StaleEntityEvictionThread: Found no commands older than 2014-07-07T16:47:39.753Z to reap.
2016-07-06 12:47:39,756 INFO StaleEntityEviction:com.cloudera.server.cmf.StaleEntityEvictionThread: Wizard is active, not reaping scanners or configurators
2016-07-06 12:57:39,759 INFO StaleEntityEviction:com.cloudera.cmf.model.HeartbeatStore: Reaped 3 process heartbeats
2016-07-06 12:57:39,769 INFO StaleEntityEviction:com.cloudera.server.cmf.StaleEntityEvictionThread: Reaped total of 0 deleted commands
2016-07-06 12:57:39,771 INFO StaleEntityEviction:com.cloudera.server.cmf.StaleEntityEvictionThread: Found no commands older than 2014-07-07T16:57:39.770Z to reap.
2016-07-06 12:57:39,772 INFO StaleEntityEviction:com.cloudera.server.cmf.StaleEntityEvictionThread: Wizard is active, not reaping scanners or configurators

 So it's the same error as before Error found before invoking supervisord: Cant locate template for uri 'supervisee.conf' despite the files being installed: 

 

find /usr/ -name supervisee.conf        
> /usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/cmf-5.7.1-py2.7.egg/cmf/templates/supervisee.conf
> /usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/cmf-5.7.0_SNAPSHOT-py2.7.egg/cmf/templates/supervisee.conf

 

Re: Cluster/Database setup: unable to connect to MySQL database

Super Guru

Thanks for supplying all that information... great stuff and it looks like you are nailing the install.

I took a deeper dive into the python responsible for locating the supervisee.conf looks for the supervisee.conf in the "cmf" directory where the agent is running.  Perhaps the agent is not running in the python or in the location we expect.

 

Let's collect the following:

 

1- output of the following:

 

ps aux |grep py

 

2- the /var/log/cloudera-scm-agent/cloudera-scm-agent.log from the time when the error occurs when doing the db test.

 

If the file is where we expect it, then it stands to reason that the agent may be looking in the wrong place.

 

Re: Cluster/Database setup: unable to connect to MySQL database

Explorer

Here is the output of ps aux | grep py

clouder+   829  3.3  2.7 11183396 1792420 ?    Ssl  12:26   6:11 /usr/java/jdk.1.7.0_80/bin/java -cp .:lib/*:/usr/share/java/mysql-connector-java.jar:/usr/share/java/oracle-connector-java.jar -server -Dlog4j.configuration=file:/etc/cloudera-scm-server/log4j.properties -Dfile.encoding=UTF-8 -Dcmf.root.logger=INFO,LOGFILE -Dcmf.log.dir=/var/log/cloudera-scm-server -Dcmf.log.file=cloudera-scm-server.log -Dcmf.jetty.threshhold=WARN -Dcmf.schema.dir=/usr/share/cmf/schema -Djava.awt.headless=true -Djava.net.preferIPv4Stack=true -Dpython.home=/usr/share/cmf/python -XX:+UseConcMarkSweepGC -XX:+UseParNewGC -XX:+HeapDumpOnOutOfMemoryError -Xmx2G -XX:MaxPermSize=256m -XX:+HeapDumpOnOutOfMemoryError -XX:HeapDumpPath=/tmp -XX:OnOutOfMemoryError=kill -9 %p com.cloudera.server.cmf.Main
root      1620  2.0  0.1 2867308 95336 ?       Ssl  Apr07 2678:58 /usr/lib/cmf/agent/build/env/bin/python /usr/lib/cmf/agent/src/cmf/agent.py --package_dir /usr/lib/cmf/service --agent_dir /var/run/cloudera-scm-agent --lib_dir /var/lib/cloudera-scm-agent --logfile /var/log/cloudera-scm-agent/cloudera-scm-agent.log
root      1655  0.0  0.0  65696 19108 ?        Ss   Apr07 120:04 /usr/lib/cmf/agent/src/cmf/../../build/env/bin/python /usr/lib/cmf/agent/src/cmf/../../build/env/bin/supervisord
root      1656  0.0  0.0  47780 15108 ?        S    Apr07   0:00 /usr/lib/cmf/agent/build/env/bin/python /usr/lib/cmf/agent/src/cmf/supervisor_listener.py -l /var/log/cloudera-scm-agent/cmf_listener.log /run/cloudera-scm-agent/events

and here is the output from the log /var/log/cloudera-scm-agent/cloudera-scm-agent.log

 

[06/Jul/2016 15:29:46 +0000] 1620 DnsResolutionMonitor throttling_logger INFO     (59 skipped) DnsTest return=1
stdout=
stderr=Error: Could not find or load main class com.cloudera.cmon.agent.DnsTest

[06/Jul/2016 15:31:27 +0000] 1620 MainThread version_detector INFO     Identified java component java7 with full version JAVA_HOME=/usr/lib/jvm/default-java java version "1.7.0_101" OpenJDK Runtime Environ
ment (IcedTea 2.6.6) (7u101-2.6.6-0ubuntu0.14.04.1) OpenJDK 64-Bit Server VM (build 24.95-b01, mixed mode)  for requested version misc.
[06/Jul/2016 15:31:27 +0000] 1620 MainThread version_detector INFO     Identified java component java6 with full version JAVA_HOME=/usr/lib/jvm/j2sdk1.6-oracle java version "1.6.0_31" Java(TM) SE Runtime E
nvironment (build 1.6.0_31-b04) Java HotSpot(TM) 64-Bit Server VM (build 20.6-b01, mixed mode)  for requested version 6.
[06/Jul/2016 15:31:27 +0000] 1620 MainThread version_detector INFO     Identified java component java7 with full version JAVA_HOME=/usr/lib/jvm/java-7-oracle-cloudera java version "1.7.0_67" Java(TM) SE Ru
ntime Environment (build 1.7.0_67-b01) Java HotSpot(TM) 64-Bit Server VM (build 24.65-b04, mixed mode)  for requested version 7.
[06/Jul/2016 15:33:27 +0000] 1620 MainThread version_detector INFO     Identified java component java7 with full version JAVA_HOME=/usr/lib/jvm/default-java java version "1.7.0_101" OpenJDK Runtime Environ
ment (IcedTea 2.6.6) (7u101-2.6.6-0ubuntu0.14.04.1) OpenJDK 64-Bit Server VM (build 24.95-b01, mixed mode)  for requested version misc.
[06/Jul/2016 15:33:27 +0000] 1620 MainThread version_detector INFO     Identified java component java6 with full version JAVA_HOME=/usr/lib/jvm/j2sdk1.6-oracle java version "1.6.0_31" Java(TM) SE Runtime E
nvironment (build 1.6.0_31-b04) Java HotSpot(TM) 64-Bit Server VM (build 20.6-b01, mixed mode)  for requested version 6.
[06/Jul/2016 15:33:28 +0000] 1620 MainThread version_detector INFO     Identified java component java7 with full version JAVA_HOME=/usr/lib/jvm/java-7-oracle-cloudera java version "1.7.0_67" Java(TM) SE Ru
ntime Environment (build 1.7.0_67-b01) Java HotSpot(TM) 64-Bit Server VM (build 24.65-b04, mixed mode)  for requested version 7.
[06/Jul/2016 15:34:46 +0000] 1620 CP Server Thread-4 _cplogging   INFO     192.168.30.22 - - [06/Jul/2016:15:34:46] "GET /heartbeat HTTP/1.1" 200 2 "" "NING/1.0"
[06/Jul/2016 15:34:46 +0000] 1620 MainThread util         INFO     Using generic audit plugin for process MGMT.ACTIVITYMONITOR-test-db-connection
[06/Jul/2016 15:34:46 +0000] 1620 MainThread util         INFO     Creating metadata plugin for process MGMT.ACTIVITYMONITOR-test-db-connection
[06/Jul/2016 15:34:46 +0000] 1620 MainThread util         INFO     Using specific metadata plugin for process MGMT.ACTIVITYMONITOR-test-db-connection
[06/Jul/2016 15:34:46 +0000] 1620 MainThread util         INFO     Using generic metadata plugin for process MGMT.ACTIVITYMONITOR-test-db-connection
[06/Jul/2016 15:34:46 +0000] 1620 MainThread agent        WARNING  Not creating a monitor for 17-MGMT.ACTIVITYMONITOR-test-db-connection: MonitorDaemon not created yet
[06/Jul/2016 15:34:46 +0000] 1620 MainThread agent        INFO     First time to activate the process [17-MGMT.ACTIVITYMONITOR-test-db-connection].
[06/Jul/2016 15:34:46 +0000] 1620 MainThread agent        INFO     Created /run/cloudera-scm-agent/process/17-MGMT.ACTIVITYMONITOR-test-db-connection
[06/Jul/2016 15:34:46 +0000] 1620 MainThread agent        INFO     Chowning /run/cloudera-scm-agent/process/17-MGMT.ACTIVITYMONITOR-test-db-connection to root (0) root (0)
[06/Jul/2016 15:34:46 +0000] 1620 MainThread agent        INFO     Chmod'ing /run/cloudera-scm-agent/process/17-MGMT.ACTIVITYMONITOR-test-db-connection to 0751
[06/Jul/2016 15:34:46 +0000] 1620 MainThread parcel       INFO     prepare_environment begin: {}, [], []
[06/Jul/2016 15:34:46 +0000] 1620 MainThread parcel       INFO     No parcels activated for use
[06/Jul/2016 15:34:46 +0000] 1620 MainThread util         INFO     Extracted 1 files and 0 dirs to /run/cloudera-scm-agent/process/17-MGMT.ACTIVITYMONITOR-test-db-connection.
[06/Jul/2016 15:34:46 +0000] 1620 MainThread agent        INFO     Created /run/cloudera-scm-agent/process/17-MGMT.ACTIVITYMONITOR-test-db-connection/logs
[06/Jul/2016 15:34:46 +0000] 1620 MainThread agent        INFO     Chowning /run/cloudera-scm-agent/process/17-MGMT.ACTIVITYMONITOR-test-db-connection/logs to root (0) root (0)
[06/Jul/2016 15:34:46 +0000] 1620 MainThread agent        INFO     Chmod'ing /run/cloudera-scm-agent/process/17-MGMT.ACTIVITYMONITOR-test-db-connection/logs to 0751
[06/Jul/2016 15:34:46 +0000] 1620 MainThread agent        ERROR    Failed to activate {u'refresh_files': [], u'config_generation': 0, u'auto_restart': False, u'running': True, u'required_tags': [], u'user'
: u'root', u'special_file_info': [], u'group': u'root', u'id': 17, u'status_links': {}, u'name': u'MGMT.ACTIVITYMONITOR-test-db-connection', u'extra_groups': [], u'run_generation': 1, u'environment': {}, u
'optional_tags': [], u'program': u'dbconnection/test_db_connection.sh', u'arguments': [u'db.properties'], u'parcels': {}, u'resources': [], u'one_off': True}
Traceback (most recent call last):
  File "/usr/lib/cmf/agent/src/cmf/agent.py", line 1435, in handle_heartbeat_processes
  File "/usr/lib/cmf/agent/src/cmf/agent.py", line 2836, in activate
  File "/usr/lib/cmf/agent/src/cmf/agent.py", line 3025, in write_conf
  File "/usr/lib/cmf/agent/src/cmf/template_util.py", line 25, in render_text
  File "/usr/lib/cmf/agent/src/cmf/template_util.py", line 31, in render
  File "/usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/Mako-0.3.4-py2.7.egg/mako/lookup.py", line 114, in get_template
    "Cant locate template for uri %r" % uri)
TopLevelLookupException: Cant locate template for uri 'supervisee.conf'
[06/Jul/2016 15:34:46 +0000] 1620 MainThread util         INFO     Using generic audit plugin for process OOZIE.OOZIE_SERVER-test-db-connection
[06/Jul/2016 15:34:46 +0000] 1620 MainThread util         INFO     Creating metadata plugin for process OOZIE.OOZIE_SERVER-test-db-connection
[06/Jul/2016 15:34:46 +0000] 1620 MainThread util         INFO     Using specific metadata plugin for process OOZIE.OOZIE_SERVER-test-db-connection
[06/Jul/2016 15:34:46 +0000] 1620 MainThread util         INFO     Using generic metadata plugin for process OOZIE.OOZIE_SERVER-test-db-connection
[06/Jul/2016 15:34:46 +0000] 1620 MainThread agent        WARNING  Not creating a monitor for 19-OOZIE.OOZIE_SERVER-test-db-connection: MonitorDaemon not created yet
[06/Jul/2016 15:34:46 +0000] 1620 MainThread agent        INFO     First time to activate the process [19-OOZIE.OOZIE_SERVER-test-db-connection].
[06/Jul/2016 15:34:46 +0000] 1620 MainThread agent        INFO     Created /run/cloudera-scm-agent/process/19-OOZIE.OOZIE_SERVER-test-db-connection
[06/Jul/2016 15:34:46 +0000] 1620 MainThread agent        INFO     Chowning /run/cloudera-scm-agent/process/19-OOZIE.OOZIE_SERVER-test-db-connection to root (0) root (0)
[06/Jul/2016 15:34:46 +0000] 1620 MainThread agent        INFO     Chmod'ing /run/cloudera-scm-agent/process/19-OOZIE.OOZIE_SERVER-test-db-connection to 0751
[06/Jul/2016 15:34:46 +0000] 1620 MainThread parcel       INFO     prepare_environment begin: {}, [], []
[06/Jul/2016 15:34:46 +0000] 1620 MainThread parcel       INFO     No parcels activated for use
[06/Jul/2016 15:34:46 +0000] 1620 MainThread util         INFO     Extracted 1 files and 0 dirs to /run/cloudera-scm-agent/process/19-OOZIE.OOZIE_SERVER-test-db-connection.
[06/Jul/2016 15:34:46 +0000] 1620 MainThread agent        INFO     Created /run/cloudera-scm-agent/process/19-OOZIE.OOZIE_SERVER-test-db-connection/logs
[06/Jul/2016 15:34:46 +0000] 1620 MainThread agent        INFO     Chowning /run/cloudera-scm-agent/process/19-OOZIE.OOZIE_SERVER-test-db-connection/logs to root (0) root (0)
[06/Jul/2016 15:34:46 +0000] 1620 MainThread agent        INFO     Chmod'ing /run/cloudera-scm-agent/process/19-OOZIE.OOZIE_SERVER-test-db-connection/logs to 0751
[06/Jul/2016 15:34:46 +0000] 1620 MainThread agent        ERROR    Failed to activate {u'refresh_files': [], u'config_generation': 0, u'auto_restart': False, u'running': True, u'required_tags': [], u'user': u'root', u'special_file_info': [], u'group': u'root', u'id': 19, u'status_links': {}, u'name': u'OOZIE.OOZIE_SERVER-test-db-connection', u'extra_groups': [], u'run_generation': 1, u'environment': {}, u'optional_tags': [], u'program': u'dbconnection/test_db_connection.sh', u'arguments': [u'db.properties'], u'parcels': {}, u'resources': [], u'one_off': True}
Traceback (most recent call last):
  File "/usr/lib/cmf/agent/src/cmf/agent.py", line 1435, in handle_heartbeat_processes
  File "/usr/lib/cmf/agent/src/cmf/agent.py", line 2836, in activate
  File "/usr/lib/cmf/agent/src/cmf/agent.py", line 3025, in write_conf
  File "/usr/lib/cmf/agent/src/cmf/template_util.py", line 25, in render_text
  File "/usr/lib/cmf/agent/src/cmf/template_util.py", line 31, in render
  File "/usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/Mako-0.3.4-py2.7.egg/mako/lookup.py", line 114, in get_template
    "Cant locate template for uri %r" % uri)
TopLevelLookupException: Cant locate template for uri 'supervisee.conf'
[06/Jul/2016 15:34:46 +0000] 1620 MainThread util         INFO     Using generic audit plugin for process HIVE-test-db-connection
[06/Jul/2016 15:34:46 +0000] 1620 MainThread util         INFO     Creating metadata plugin for process HIVE-test-db-connection
[06/Jul/2016 15:34:46 +0000] 1620 MainThread util         INFO     Using specific metadata plugin for process HIVE-test-db-connection
[06/Jul/2016 15:34:46 +0000] 1620 MainThread util         INFO     Using generic metadata plugin for process HIVE-test-db-connection
[06/Jul/2016 15:34:46 +0000] 1620 MainThread agent        WARNING  Not creating a monitor for 18-HIVE-test-db-connection: MonitorDaemon not created yet
[06/Jul/2016 15:34:46 +0000] 1620 MainThread agent        INFO     First time to activate the process [18-HIVE-test-db-connection].
[06/Jul/2016 15:34:46 +0000] 1620 MainThread agent        INFO     Created /run/cloudera-scm-agent/process/18-HIVE-test-db-connection
[06/Jul/2016 15:34:46 +0000] 1620 MainThread agent        INFO     Chowning /run/cloudera-scm-agent/process/18-HIVE-test-db-connection to root (0) root (0)
[06/Jul/2016 15:34:46 +0000] 1620 MainThread agent        INFO     Chmod'ing /run/cloudera-scm-agent/process/18-HIVE-test-db-connection to 0751
[06/Jul/2016 15:34:46 +0000] 1620 MainThread parcel       INFO     prepare_environment begin: {}, [], []
[06/Jul/2016 15:34:46 +0000] 1620 MainThread parcel       INFO     No parcels activated for use
[06/Jul/2016 15:34:46 +0000] 1620 MainThread util         INFO     Extracted 1 files and 0 dirs to /run/cloudera-scm-agent/process/18-HIVE-test-db-connection.
[06/Jul/2016 15:34:46 +0000] 1620 MainThread agent        INFO     Created /run/cloudera-scm-agent/process/18-HIVE-test-db-connection/logs
[06/Jul/2016 15:34:46 +0000] 1620 MainThread agent        INFO     Chowning /run/cloudera-scm-agent/process/18-HIVE-test-db-connection/logs to root (0) root (0)
[06/Jul/2016 15:34:46 +0000] 1620 MainThread agent        INFO     Chmod'ing /run/cloudera-scm-agent/process/18-HIVE-test-db-connection/logs to 0751
[06/Jul/2016 15:34:46 +0000] 1620 MainThread agent        ERROR    Failed to activate {u'refresh_files': [], u'config_generation': 0, u'auto_restart': False, u'running': True, u'required_tags': [], u'user': u'root', u'special_file_info': [], u'group': u'root', u'id': 18, u'status_links': {}, u'name': u'HIVE-test-db-connection', u'extra_groups': [], u'run_generation': 1, u'environment': {}, u'optional_tags': [], u'program': u'dbconnection/test_db_connection.sh', u'arguments': [u'db.properties'], u'parcels': {}, u'resources': [], u'one_off': True}
Traceback (most recent call last):
  File "/usr/lib/cmf/agent/src/cmf/agent.py", line 1435, in handle_heartbeat_processes
  File "/usr/lib/cmf/agent/src/cmf/agent.py", line 2836, in activate
  File "/usr/lib/cmf/agent/src/cmf/agent.py", line 3025, in write_conf
  File "/usr/lib/cmf/agent/src/cmf/template_util.py", line 25, in render_text
  File "/usr/lib/cmf/agent/src/cmf/template_util.py", line 31, in render
  File "/usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/Mako-0.3.4-py2.7.egg/mako/lookup.py", line 114, in get_template
    "Cant locate template for uri %r" % uri)
TopLevelLookupException: Cant locate template for uri 'supervisee.conf'
[06/Jul/2016 15:35:31 +0000] 1620 MainThread version_detector INFO     Identified java component java7 with full version JAVA_HOME=/usr/lib/jvm/default-java java version "1.7.0_101" OpenJDK Runtime Environment (IcedTea 2.6.6) (7u101-2.6.6-0ubuntu0.14.04.1) OpenJDK 64-Bit Server VM (build 24.95-b01, mixed mode)  for requested version misc.
[06/Jul/2016 15:35:31 +0000] 1620 MainThread version_detector INFO     Identified java component java6 with full version JAVA_HOME=/usr/lib/jvm/j2sdk1.6-oracle java version "1.6.0_31" Java(TM) SE Runtime Environment (build 1.6.0_31-b04) Java HotSpot(TM) 64-Bit Server VM (build 20.6-b01, mixed mode)  for requested version 6.
[06/Jul/2016 15:35:31 +0000] 1620 MainThread version_detector INFO     Identified java component java7 with full version JAVA_HOME=/usr/lib/jvm/java-7-oracle-cloudera java version "1.7.0_67" Java(TM) SE Runtime Environment (build 1.7.0_67-b01) Java HotSpot(TM) 64-Bit Server VM (build 24.65-b04, mixed mode)  for requested version 7.

Re: Cluster/Database setup: unable to connect to MySQL database

Explorer

Sorry, I'm not sure how to interpret that output.