Reply
Master
Posts: 377
Registered: ‎07-01-2015

CDH6 via cloudera director

Cloudera director (2.8) fails to deploy a CDH6 template, there is some issue with metadata database connectivity, the CM server has an empty db.properties and thus fails to start:

 

2018-09-06 10:43:31,415 INFO main:com.cloudera.server.cmf.Main: ================================================================================
2018-09-06 10:43:31,422 INFO main:com.cloudera.server.cmf.Main: Starting SCM Server. JVM Args: [-Dlog4j.configuration=file:/etc/cloudera-scm-server/log4j.properties, -Dfile.encoding=UTF-8, -Dcmf.root.logger=INFO,LOGFILE, -Dcmf.log.dir=/var/log/cloudera-scm-server, -Dcmf.log.file=cloudera-scm-server.log, -Dcmf.jetty.threshhold=WARN, -Dcmf.schema.dir=/opt/cloudera/cm/schema, -Djava.awt.headless=true, -Djava.net.preferIPv4Stack=true, -Dpython.home=/opt/cloudera/cm/python, -XX:+UseConcMarkSweepGC, -XX:+UseParNewGC, -XX:+HeapDumpOnOutOfMemoryError, -Xmx2G, -XX:MaxPermSize=256m, -XX:+HeapDumpOnOutOfMemoryError, -XX:HeapDumpPath=/tmp, -XX:OnOutOfMemoryError=kill -9 %p], Args: [], Version: 6.0.0 (#530873 built by jenkins on 20180814-2228 git: 032212268b4c12344a7ba0cba6e2269163ff8dee)
2018-09-06 10:43:31,568 INFO main:org.springframework.context.support.ClassPathXmlApplicationContext: Refreshing org.springframework.context.support.ClassPathXmlApplicationContext@3e57cd70: startup date [Thu Sep 06 10:43:31 CEST 2018]; root of context hierarchy
2018-09-06 10:43:31,618 INFO main:org.springframework.beans.factory.xml.XmlBeanDefinitionReader: Loading XML bean definitions from class path resource [webapp/WEB-INF/spring/beanRefFactory.xml]
2018-09-06 10:43:31,931 INFO main:org.springframework.context.support.GenericApplicationContext: Refreshing org.springframework.context.support.GenericApplicationContext@6e509ffa: startup date [Thu Sep 06 10:43:31 CEST 2018]; root of context hierarchy
2018-09-06 10:43:31,992 INFO main:com.cloudera.enterprise.CommonMain: Reading database properties from /etc/cloudera-scm-server/db.properties
2018-09-06 10:43:31,995 INFO main:com.cloudera.enterprise.CommonMain: Statistics not enabled, c3p0 JMX disabled
2018-09-06 10:43:33,711 INFO main:com.mchange.v2.log.MLog: MLog clients using log4j logging.
2018-09-06 10:43:33,756 INFO main:com.mchange.v2.c3p0.C3P0Registry: Initializing c3p0-0.9.2.1 [built 20-March-2013 10:47:27 +0000; debug? true; trace: 10]
2018-09-06 10:43:33,811 INFO main:com.mchange.v2.c3p0.impl.AbstractPoolBackedDataSource: Initializing c3p0 pool... com.mchange.v2.c3p0.PoolBackedDataSource@c9b3228d [ connectionPoolDataSource -> com.mchange.v2.c3p0.WrapperConnectionPoolDataSource@315f1f70 [ acquireIncrement -> 3, acquireRetryAttempts -> 5, acquireRetryDelay -> 1000, autoCommitOnClose -> false, automaticTestTable -> null, breakAfterAcquireFailure -> false, checkoutTimeout -> 20000, connectionCustomizerClassName -> null, connectionTesterClassName -> com.mchange.v2.c3p0.impl.DefaultConnectionTester, debugUnreturnedConnectionStackTraces -> false, factoryClassLocation -> null, forceIgnoreUnresolvedTransactions -> false, identityToken -> 2zkskg9x1cajn501kf0xky|72725ee1, idleConnectionTestPeriod -> 300, initialPoolSize -> 5, maxAdministrativeTaskTime -> 0, maxConnectionAge -> 0, maxIdleTime -> 0, maxIdleTimeExcessConnections -> 0, maxPoolSize -> 50, maxStatements -> 2500, maxStatementsPerConnection -> 0, minPoolSize -> 5, nestedDataSource -> com.mchange.v2.c3p0.DriverManagerDataSource@9eb2cc70 [ description -> null, driverClass -> null, factoryClassLocation -> null, identityToken -> 2zkskg9x1cajn501kf0xky|173797f0, jdbcUrl -> jdbc:mysql://null/null?useUnicode=true&characterEncoding=UTF-8, properties -> {} ], preferredTestQuery -> null, propertyCycle -> 0, statementCacheNumDeferredCloseThreads -> 0, testConnectionOnCheckin -> false, testConnectionOnCheckout -> false, unreturnedConnectionTimeout -> 0, usesTraditionalReflectiveProxies -> false; userOverrides: {} ], dataSourceName -> null, factoryClassLocation -> null, identityToken -> 2zkskg9x1cajn501kf0xky|2954b5ea, numHelperThreads -> 3 ]
2018-09-06 10:43:38,922 WARN C3P0PooledConnectionPoolManager[identityToken->2zkskg9x1cajn501kf0xky|2954b5ea]-HelperThread-#2:com.mchange.v2.resourcepool.BasicResourcePool: com.mchange.v2.resourcepool.BasicResourcePool$ScatteredAcquireTask@4d390f79 -- Acquisition Attempt Failed!!! Clearing pending acquires. While trying to acquire a needed new resource, we failed to succeed more than the maximum number of allowed acquisition attempts (5). Last acquisition attempt exception:
com.mysql.jdbc.exceptions.jdbc4.CommunicationsException: Communications link failure

The last packet sent successfully to the server was 0 milliseconds ago. The driver has not received any packets from the server.

 

The db.properties:

# Copyright (c) 2012 Cloudera, Inc. All rights reserved.
#
# This file describes the database connection.
#

# The database type
# Currently 'mysql', 'postgresql' and 'oracle' are valid databases.
com.cloudera.cmf.db.type=mysql

# The database host
# If a non standard port is needed, use 'hostname:port'
#com.cloudera.cmf.db.host=localhost

# The database name
#com.cloudera.cmf.db.name=cmf

# The database user
#com.cloudera.cmf.db.user=cmf

# The database user's password
#com.cloudera.cmf.db.password=

# The db setup type
# After fresh install it is set to INIT
# and will be changed post config.
# If scm-server uses Embedded DB then it is set to EMBEDDED
# If scm-server uses External DB then it is set to EXTERNAL
com.cloudera.cmf.db.setupType=INIT

 Any hints what to change in template or what are the specifics for CDH6 deployments? Thanks

Cloudera Employee
Posts: 71
Registered: ‎02-18-2014

Re: CDH6 via cloudera director

Hi Tomas79,

 

Cloudera Director 2.8 doesn't support working with Cloudera Manager 6.0 or CDH 6.0. It supports only up through CM 5.15.x and CDH 5.15.x at this time. Usually, Cloudera Director can't support versions of CM or CDH that lie in the future at the time of Director's release.

 

However, we're working on CM / CDH 6 support, so look for news in the near future. :)

Master
Posts: 377
Registered: ‎07-01-2015

Re: CDH6 via cloudera director

Thanks for the update, is the near future in days, weeks or months :-) ?
Can't wait to test it out
T
Announcements