Ambari 2.6 cluster install failing

[#1]

Hi, I'm trying to install Ambari 2.6 on CentOS7 x64. I have HDP 2.6 already installed. These versions are compatible to each other per Horton Support Matrix.

When trying to create a cluster through wizard, the host registration is failing, below is the log error and I've also tried all common troubleshooting I could find online

= stop, reset, start server

= change hostname

= disable firewall

= change python code (https://community.cloudera.com/t5/Support-Questions/Ambari-server-host-register-failed/td-p/233413)

None of it seems to help. Looking forward to any help.

06 Jan 2020 22:53:19,011 INFO [Thread-23] AbstractPoolBackedDataSource:212 - Initializing c3p0 pool... com.mchange.v2.c3p0.ComboPooledDataSource [ acquireIncrement -> 3, acquireRetryAttempts -> 30, acquireRetryDelay -> 1000, autoCommitOnClose -> false, automaticTestTable -> null, breakAfterAcquireFailure -> false, checkoutTimeout -> 0, connectionCustomizerClassName -> null, connectionTesterClassName -> com.mchange.v2.c3p0.impl.DefaultConnectionTester, contextClassLoaderSource -> caller, dataSourceName -> z8kflta7ydcr45yfqwns|4abb4041, debugUnreturnedConnectionStackTraces -> false, description -> null, driverClass -> org.postgresql.Driver, extensions -> {}, factoryClassLocation -> null, forceIgnoreUnresolvedTransactions -> false, forceSynchronousCheckins -> false, forceUseNamedDriverClass -> false, identityToken -> z8kflta7ydcr45yfqwns|4abb4041, idleConnectionTestPeriod -> 50, initialPoolSize -> 3, jdbcUrl -> jdbc:postgresql://localhost/ambari, maxAdministrativeTaskTime -> 0, maxConnectionAge -> 0, maxIdleTime -> 0, maxIdleTimeExcessConnections -> 0, maxPoolSize -> 5, maxStatements -> 0, maxStatementsPerConnection -> 120, minPoolSize -> 1, numHelperThreads -> 3, preferredTestQuery -> select 0, privilegeSpawnedThreads -> false, properties -> {user=******, password=******}, propertyCycle -> 0, statementCacheNumDeferredCloseThreads -> 0, testConnectionOnCheckin -> true, testConnectionOnCheckout -> false, unreturnedConnectionTimeout -> 0, userOverrides -> {}, usesTraditionalReflectiveProxies -> false ]
06 Jan 2020 22:53:19,442 INFO [Thread-23] JobStoreTX:861 - Freed 0 triggers from 'acquired' / 'blocked' state.
06 Jan 2020 22:53:19,551 INFO [Thread-23] JobStoreTX:871 - Recovering 0 jobs that were in-progress at the time of the last shut-down.
06 Jan 2020 22:53:19,551 INFO [Thread-23] JobStoreTX:884 - Recovery complete.
06 Jan 2020 22:53:19,552 INFO [Thread-23] JobStoreTX:891 - Removed 0 'complete' triggers.
06 Jan 2020 22:53:19,554 INFO [Thread-23] JobStoreTX:896 - Removed 0 stale fired job entries.
06 Jan 2020 22:53:19,564 INFO [Thread-23] QuartzScheduler:575 - Scheduler ExecutionScheduler_$_NON_CLUSTERED started.
06 Jan 2020 22:56:19,341 INFO [pool-18-thread-1] MetricsServiceImpl:65 - Attempting to initialize metrics sink
06 Jan 2020 22:56:19,344 INFO [pool-18-thread-1] MetricsServiceImpl:81 - ********* Configuring Metric Sink **********
06 Jan 2020 22:56:19,345 INFO [pool-18-thread-1] AmbariMetricSinkImpl:95 - No clusters configured.
06 Jan 2020 23:01:19,347 INFO [pool-18-thread-1] MetricsServiceImpl:65 - Attempting to initialize metrics sink
06 Jan 2020 23:01:19,347 INFO [pool-18-thread-1] MetricsServiceImpl:81 - ********* Configuring Metric Sink **********
06 Jan 2020 23:01:19,348 INFO [pool-18-thread-1] AmbariMetricSinkImpl:95 - No clusters configured.
06 Jan 2020 23:06:19,348 INFO [pool-18-thread-1] MetricsServiceImpl:65 - Attempting to initialize metrics sink
06 Jan 2020 23:06:19,348 INFO [pool-18-thread-1] MetricsServiceImpl:81 - ********* Configuring Metric Sink **********
06 Jan 2020 23:06:19,349 INFO [pool-18-thread-1] AmbariMetricSinkImpl:95 - No clusters configured.
06 Jan 2020 23:11:19,393 INFO [pool-18-thread-1] MetricsServiceImpl:65 - Attempting to initialize metrics sink
06 Jan 2020 23:11:19,394 INFO [pool-18-thread-1] MetricsServiceImpl:81 - ********* Configuring Metric Sink **********
06 Jan 2020 23:11:19,394 INFO [pool-18-thread-1] AmbariMetricSinkImpl:95 - No clusters configured.

[#2]

@md88 

Are you trying to install Ambari on an existing 2.6 cluster or you are upgrading Ambari? If you have already installed HDP 2.6 as you stated how is the registration of the host failing?

Here are the steps to help resolve your issue.

Can you please rephrase your question because personally I can't understand !

[#3]

Hi @Shelton , here are further details:

- I'm using CentOS7 virtual machine

- I installed Hadoop 2.6 on it as per url: https://www.vultr.com/docs/how-to-install-hadoop-in-stand-alone-mode-on-centos-7 (this is same steps as official Hadoop installation doc)

- Then I proceeded to install Ambari as per url guide: https://cwiki.apache.org/confluence/display/AMBARI/Installation+Guide+for+Ambari+2.6.2

- After Ambari server and Ambari agent are downloaded, I did an ambari-server setup.

- Logged in to ambari on localhost:8080 and proceeded with "install cluster wizard". 

- Wherein it asks for hostname I entered localhost.localdomain (checked in hostname -f and in /etc also this is correct). 

- Selected option to manually setup host and not use SSH password. Clicked on Next and this is where it gives above error and fails to register host.

Hope this info helps, please let me know if else needed. I have tried official Hadoop and Ambari installation guide several times but no help. Infact last time with same steps i was able to go to review page in cluster installation, but this time its failing earlier to that only.

Thanks in advance.

[#4 · Accepted solution]

@md88 

I was just wondering why you have chosen to go down a very difficult road to deploy unpackaged Hadoop when you have a simplified way using Cloudera see HDP 3.1.4 deployment  this is a well-documented procedure that is relatively straight forward especially when you are new to Hadoop. In your initial thread, you said you had  HDP 2.6 already installed but the document you are referencing isn't a Cloudera documentation !!

Please refer to the earlier link I shared above that thoroughly documents the installation of the HDP ecosystem  below are some of the components  which have been tested and integrated which gives you other tools  to be more productive i.e  Security, Streaming, ETL,one-stop notebook Zeppelin etc

Official Apache component versions for HDP 3.1.4:

• Apache Accumulo 1.7.0

• Apache Atlas 1.1.0

• Apache Calcite 1.16.0

• Apache DataFu 1.3.0

• Apache Druid 0.12.1 (incubating)

• Apache Hadoop 3.1.1

• Apache HBase 2.0.2

• Apache Hive 3.1.0

• Apache Kafka 2.0.0

• Apache Knox 1.0.0

• Apache Livy 0.5.0

• Apache Oozie 4.3.1

• Apache Phoenix 5.0.0

• Apache Pig 0.16.0

• Apache Ranger 1.2.0

• Apache Spark 2.3.2

• Apache Sqoop 1.4.7

• Apache Storm 1.2.1

• Apache TEZ 0.9.1

• Apache Zeppelin 0.8.0

• Apache ZooKeeper 3.4.6

Having said if you want Ambari to manage your standalone Hadoop cluster you will have to walk in uncharted waters because that process is called Ambari take-over is not well documented and hence quite frustrating for a newbie.

Here is a link to Ryba is an open-source project. You will have to be proficient in Python the challenge will be to give Apache Ambari full knowledge of your clusters’ topologies which services are running and where they are running.

Please let me know if you need more help.

[#5]

Thank you @Shelton for your help

And thanks for sharing the take-over url, very interesting read.