Mr. Harsh, would you please have a look at my reply, please?   thanks  ... View more

More information: The following is the "/tmp/scm_prepare_node.vQZe0yDf/scm_prepare_node.log" on the failing host:   using SSH_CLIENT to get the SCM hostname: 10.4.34.22 37758 22 opening logging file descriptor ###CLOUDERA_SCM### SCRIPT_START ###CLOUDERA_SCM### TAKE_LOCK BEGIN flock 4 END (0) ###CLOUDERA_SCM### DETECT_ROOT effective UID is 1000 BEGIN which pbrun END (1) BEGIN sudo -S id uid=0(root) gid=0(root) groups=0(root) END (0) Using 'sudo ' to acquire root privileges ###CLOUDERA_SCM### DETECT_DISTRO BEGIN grep 'Ubuntu' /etc/lsb-release DISTRIB_ID=Ubuntu DISTRIB_DESCRIPTION="Ubuntu 16.04.1 LTS" END (0) BEGIN grep DISTRIB_CODENAME /etc/lsb-release DISTRIB_CODENAME=xenial END (0) BEGIN echo DISTRIB_CODENAME=xenial | cut -d = -f 2 xenial END (0) ###CLOUDERA_SCM### DETECT_SCM BEGIN host -t PTR 10.4.34.22 Host 22.34.4.10.in-addr.arpa. not found: 3(NXDOMAIN) END (1) BEGIN which python /usr/bin/python END (0) BEGIN python -c 'import socket; import sys; s = socket.socket(socket.AF_INET); s.settimeout(5.0); s.connect((sys.argv[1], int(sys.argv[2]))); s.close();' 10.4.34.22 7182 END (0) BEGIN which wget /usr/bin/wget END (0) BEGIN wget -qO- -T 1 -t 1 http://169.254.169.254/latest/meta-data/public-hostname && /bin/echo END (4) ###CLOUDERA_SCM### REPO_INSTALL Checking https://archive.cloudera.com/cm6/6.2.0/ubuntu1604/apt/dists/ Checking https://archive.cloudera.com/cm6/6.2.0/dists/ Using installing repository file /tmp/scm_prepare_node.vQZe0yDf/repos/ubuntu_xenial/cloudera-manager.list repository file /tmp/scm_prepare_node.vQZe0yDf/repos/ubuntu_xenial/cloudera-manager.list installed installing apt keys BEGIN sudo apt-key add /tmp/scm_prepare_node.vQZe0yDf/customGPG OK END (0) installing priority file /tmp/scm_prepare_node.vQZe0yDf/ubuntu_xenial priority file /tmp/scm_prepare_node.vQZe0yDf/ubuntu_xenial installed ###CLOUDERA_SCM### REFRESH_METADATA BEGIN sudo apt-get update Hit:1 http://security.ubuntu.com/ubuntu xenial-security InRelease Hit:2 http://us.archive.ubuntu.com/ubuntu xenial InRelease Hit:3 http://us.archive.ubuntu.com/ubuntu xenial-updates InRelease Hit:4 http://us.archive.ubuntu.com/ubuntu xenial-backports InRelease Reading package lists... END (0) BEGIN sudo apt-get update Hit:1 http://us.archive.ubuntu.com/ubuntu xenial InRelease Hit:2 http://security.ubuntu.com/ubuntu xenial-security InRelease Hit:3 http://us.archive.ubuntu.com/ubuntu xenial-updates InRelease Hit:4 http://us.archive.ubuntu.com/ubuntu xenial-backports InRelease Reading package lists... END (0) ###CLOUDERA_SCM### PACKAGE_INSTALL cloudera-manager-agent BEGIN sudo dpkg -l cloudera-manager-agent | grep -E '^ii[[:space:]]*cloudera-manager-agent[[:space:]]*' dpkg-query: no packages found matching cloudera-manager-agent END (1) BEGIN sudo apt-cache show cloudera-manager-agent E: No packages found END (100) cloudera-manager-agent must have Version=6.2.0 and Build=968826, exiting closing logging file descriptor   and this is what I have under "/tmp/scm_prepare_node.vQZe0yDf/" folder: ... View more

Mr. Harsh, please find the following as requested : using SSH_CLIENT to get the SCM hostname: 10.4.34.22 37758 22 opening logging file descriptor ###CLOUDERA_SCM### SCRIPT_START ###CLOUDERA_SCM### TAKE_LOCK BEGIN flock 4 END (0) ###CLOUDERA_SCM### DETECT_ROOT effective UID is 1000 BEGIN which pbrun END (1) BEGIN sudo -S id uid=0(root) gid=0(root) groups=0(root) END (0) Using 'sudo ' to acquire root privileges ###CLOUDERA_SCM### DETECT_DISTRO BEGIN grep 'Ubuntu' /etc/lsb-release DISTRIB_ID=Ubuntu DISTRIB_DESCRIPTION="Ubuntu 16.04.1 LTS" END (0) BEGIN grep DISTRIB_CODENAME /etc/lsb-release DISTRIB_CODENAME=xenial END (0) BEGIN echo DISTRIB_CODENAME=xenial | cut -d = -f 2 xenial END (0) ###CLOUDERA_SCM### DETECT_SCM BEGIN host -t PTR 10.4.34.22 Host 22.34.4.10.in-addr.arpa. not found: 3(NXDOMAIN) END (1) BEGIN which python /usr/bin/python END (0) BEGIN python -c 'import socket; import sys; s = socket.socket(socket.AF_INET); s.settimeout(5.0); s.connect((sys.argv[1], int(sys.argv[2]))); s.close();' 10.4.34.22 7182 END (0) BEGIN which wget /usr/bin/wget END (0) BEGIN wget -qO- -T 1 -t 1 http://169.254.169.254/latest/meta-data/public-hostname && /bin/echo END (4) ###CLOUDERA_SCM### REPO_INSTALL Checking https://archive.cloudera.com/cm6/6.2.0/ubuntu1604/apt/dists/ Checking https://archive.cloudera.com/cm6/6.2.0/dists/ Using installing repository file /tmp/scm_prepare_node.vQZe0yDf/repos/ubuntu_xenial/cloudera-manager.list repository file /tmp/scm_prepare_node.vQZe0yDf/repos/ubuntu_xenial/cloudera-manager.list installed installing apt keys BEGIN sudo apt-key add /tmp/scm_prepare_node.vQZe0yDf/customGPG OK END (0) installing priority file /tmp/scm_prepare_node.vQZe0yDf/ubuntu_xenial priority file /tmp/scm_prepare_node.vQZe0yDf/ubuntu_xenial installed ###CLOUDERA_SCM### REFRESH_METADATA BEGIN sudo apt-get update Hit:1 http://security.ubuntu.com/ubuntu xenial-security InRelease Hit:2 http://us.archive.ubuntu.com/ubuntu xenial InRelease Hit:3 http://us.archive.ubuntu.com/ubuntu xenial-updates InRelease Hit:4 http://us.archive.ubuntu.com/ubuntu xenial-backports InRelease Reading package lists... END (0) BEGIN sudo apt-get update Hit:1 http://us.archive.ubuntu.com/ubuntu xenial InRelease Hit:2 http://security.ubuntu.com/ubuntu xenial-security InRelease Hit:3 http://us.archive.ubuntu.com/ubuntu xenial-updates InRelease Hit:4 http://us.archive.ubuntu.com/ubuntu xenial-backports InRelease Reading package lists... END (0) ###CLOUDERA_SCM### PACKAGE_INSTALL cloudera-manager-agent BEGIN sudo dpkg -l cloudera-manager-agent | grep -E '^ii[[:space:]]*cloudera-manager-agent[[:space:]]*' dpkg-query: no packages found matching cloudera-manager-agent END (1) BEGIN sudo apt-cache show cloudera-manager-agent E: No packages found END (100) cloudera-manager-agent must have Version=6.2.0 and Build=968826, exiting closing logging file descriptor  and this is what I have under "/tmp/scm_prepare_node.vQZe0yDf/" folder: ... View more

Hello Harsh J,   I am having similler or same issue.   Trying to add a new host ...actually it is the first host (after the CM) to a new cluster.   But I am ending with this error  "Command 30(GlobalHostInstall) has completed. finalstate:FINISHED, success:false, msg:Failed to complete installation"   The following is the "/var/log/cloudera-scm-server/cloudera-scm-server.log" since I started the process.   10:58:25.348 AM INFO ServiceHandlerRegistry Executing command GlobalHostInstall GlobalHostInstallCommandArgs{sshPort=22, userName=butmah, password=REDACTED, passphrase=REDACTED, privateKey=REDACTED, parallelInstallCount=10, cmRepoUrl=null, gpgKeyCustomUrl=null, gpgKeyOverrideBundle=<none>, unlimitedJCE=false, javaInstallStrategy=NONE, agentUserMode=ROOT, cdhVersion=-1, cdhRelease=NONE, cdhRepoUrl=null, buildCertCommand=, sslCertHostname=null, reqId=25, skipPackageInstall=false, skipCloudConfig=false, proxyProtocol=HTTP, proxyServer=10.4.32.3, proxyPort=8080, proxyUserName=null, proxyPassword=REDACTED, hosts=[node1, node2, node3, node4, node5], existingHosts=[]}. 10:58:25.349 AM INFO CmdStep Executing command work: Execute 1 steps in sequence 10:58:25.349 AM INFO CmdStep Executing command work: Install on 1 hosts. 10:58:25.349 AM INFO CmdStep Executing command work: Install on node5. 10:58:25.350 AM INFO NodeConfiguratorService Adding password-based configurator for node5 10:58:25.350 AM INFO NodeConfiguratorService Submitted configurator for node5 with id 30 10:58:25.357 AM INFO NodeConfiguratorProgress node5: Transitioning from INIT (PT0.008S) to CONNECT 10:58:25.359 AM INFO TransportImpl Client identity string: SSH-2.0-SSHJ_0_14_0 10:58:25.361 AM INFO JavaMelodyFacade Exiting HTTP Operation: Method:POST, Path:/add-hosts-wizard/installretry.json, Status:200 10:58:25.368 AM INFO TransportImpl Server identity string: SSH-2.0-OpenSSH_7.2p2 Ubuntu-4ubuntu2.8 10:58:25.422 AM INFO NodeConfiguratorProgress node5: Transitioning from CONNECT (PT0.065S) to AUTHENTICATE 10:58:25.474 AM INFO NodeConfiguratorProgress node5: Transitioning from AUTHENTICATE (PT0.052S) to MAKE_TEMP_DIR 10:58:25.616 AM INFO NodeConfigurator Executing mktemp -d /tmp/scm_prepare_node.XXXXXXXX on node5 10:58:25.620 AM INFO NodeConfiguratorProgress node5: Transitioning from MAKE_TEMP_DIR (PT0.146S) to COPY_FILES 10:58:25.719 AM INFO NodeConfigurator Using key bundle from URL: https://archive.cloudera.com/cm6/6.2.0/allkeys.asc 10:58:26.063 AM INFO NodeConfiguratorProgress node5: Transitioning from COPY_FILES (PT0.443S) to CHMOD 10:58:26.068 AM INFO NodeConfigurator Executing chmod a+x /tmp/scm_prepare_node.vQZe0yDf/scm_prepare_node.sh on node5 10:58:26.074 AM INFO NodeConfiguratorProgress node5: Transitioning from CHMOD (PT0.011S) to EXECUTE_SCRIPT 10:58:26.142 AM INFO NodeConfigurator Executing bash -c 'bash /tmp/scm_prepare_node.vQZe0yDf/scm_prepare_node.sh --server_version 6.2.0 --server_build 968826 --packages /tmp/scm_prepare_node.vQZe0yDf/packages.scm --always /tmp/scm_prepare_node.vQZe0yDf/always_install.scm --x86_64 /tmp/scm_prepare_node.vQZe0yDf/x86_64_packages.scm --certtar /tmp/scm_prepare_node.vQZe0yDf/cert.tar --unlimitedJCE false --javaInstallStrategy NONE --agentUserMode ROOT --cm https://archive.cloudera.com/cm6/6.2.0 --skipCloudConfig false | tee /tmp/scm_prepare_node.vQZe0yDf/scm_prepare_node.log; exit ${PIPESTATUS[0]}' on node5 10:58:27.145 AM INFO NodeConfiguratorProgress node5: Transitioning from EXECUTE_SCRIPT (PT1.071S) to SCRIPT_START 10:58:27.145 AM INFO NodeConfiguratorProgress node5: Transitioning from SCRIPT_START (PT0S) to TAKE_LOCK 10:58:27.145 AM INFO NodeConfiguratorProgress node5: Transitioning from TAKE_LOCK (PT0S) to DETECT_ROOT 10:58:27.145 AM INFO NodeConfiguratorProgress node5: Transitioning from DETECT_ROOT (PT0S) to DETECT_DISTRO 10:58:27.145 AM INFO NodeConfiguratorProgress node5: Transitioning from DETECT_DISTRO (PT0S) to DETECT_SCM 10:58:28.146 AM INFO NodeConfiguratorProgress node5: Transitioning from DETECT_SCM (PT1.001S) to REPO_INSTALL 10:58:28.146 AM INFO NodeConfiguratorProgress node5: Transitioning from REPO_INSTALL (PT0S) to REFRESH_METADATA 10:58:30.354 AM INFO JavaMelodyFacade Entering HTTP Operation: Method:POST, Path:/add-hosts-wizard/installprogressdata.json 10:58:30.355 AM INFO JavaMelodyFacade Exiting HTTP Operation: Method:POST, Path:/add-hosts-wizard/installprogressdata.json, Status:200 10:58:32.079 AM INFO AgentAvroServlet (3 skipped) AgentAvroServlet: heartbeat processing stats: average=2ms, min=1ms, max=34ms. 10:58:32.150 AM INFO NodeConfiguratorProgress node5: Transitioning from REFRESH_METADATA (PT4.004S) to PACKAGE_INSTALL cloudera-manager-agent 10:58:32.160 AM WARN NodeConfigurator Command bash -c 'bash /tmp/scm_prepare_node.vQZe0yDf/scm_prepare_node.sh --server_version 6.2.0 --server_build 968826 --packages /tmp/scm_prepare_node.vQZe0yDf/packages.scm --always /tmp/scm_prepare_node.vQZe0yDf/always_install.scm --x86_64 /tmp/scm_prepare_node.vQZe0yDf/x86_64_packages.scm --certtar /tmp/scm_prepare_node.vQZe0yDf/cert.tar --unlimitedJCE false --javaInstallStrategy NONE --agentUserMode ROOT --cm https://archive.cloudera.com/cm6/6.2.0 --skipCloudConfig false | tee /tmp/scm_prepare_node.vQZe0yDf/scm_prepare_node.log; exit ${PIPESTATUS[0]}' on node5 finished with exit status 1 10:58:32.160 AM INFO NodeConfiguratorProgress node5: Setting PACKAGE_INSTALL cloudera-manager-agent as failed and done state 10:58:32.160 AM INFO TransportImpl Disconnected - BY_APPLICATION 10:58:35.363 AM INFO JavaMelodyFacade Entering HTTP Operation: Method:POST, Path:/add-hosts-wizard/installprogressdata.json 10:58:35.364 AM INFO JavaMelodyFacade Exiting HTTP Operation: Method:POST, Path:/add-hosts-wizard/installprogressdata.json, Status:200 10:58:35.369 AM INFO JavaMelodyFacade Entering HTTP Operation: Method:POST, Path:/express-wizard/updateHostsState 10:58:35.370 AM INFO JavaMelodyFacade Exiting HTTP Operation: Method:POST, Path:/express-wizard/updateHostsState, Status:200 10:58:35.375 AM ERROR WorkOutputs CMD id: 30 Failed to complete installation on host node5. 10:58:35.375 AM ERROR DbCommand Command 30(GlobalHostInstall) has completed. finalstate:FINISHED, success:false, msg:Failed to complete installation. ... View more

First I would like to note that with the default my.cnf that comes with the fresh installation of MySQL the login works fine. Now to answer your question, this is what I have pasted in “my.cnf” as recommended by Cloudera guide, and I cannot see any bind-address option: [mysqld] datadir=/var/lib/mysql socket=/var/lib/mysql/mysql.sock transaction-isolation = READ-COMMITTED # Disabling symbolic-links is recommended to prevent assorted security risks; # to do so, uncomment this line: symbolic-links = 0 key_buffer_size = 32M max_allowed_packet = 32M thread_stack = 256K thread_cache_size = 64 query_cache_limit = 8M query_cache_size = 64M query_cache_type = 1 max_connections = 550 #expire_logs_days = 10 #max_binlog_size = 100M #log_bin should be on a disk with enough free space. #Replace '/var/lib/mysql/mysql_binary_log' with an appropriate path for your #system and chown the specified folder to the mysql user. log_bin=/var/lib/mysql/mysql_binary_log #In later versions of MySQL, if you enable the binary log and do not set #a server_id, MySQL will not start. The server_id must be unique within #the replicating group. server_id=1 binlog_format = mixed read_buffer_size = 2M read_rnd_buffer_size = 16M sort_buffer_size = 8M join_buffer_size = 8M # InnoDB settings innodb_file_per_table = 1 innodb_flush_log_at_trx_commit = 2 innodb_log_buffer_size = 64M innodb_buffer_pool_size = 4G innodb_thread_concurrency = 8 innodb_flush_method = O_DIRECT innodb_log_file_size = 512M [mysqld_safe] log-error=/var/log/mysqld.log pid-file=/var/run/mysqld/mysqld.pid sql_mode=STRICT_ALL_TABLES ... View more

For  apt list oracle-j2sdk1.8 I got   tmah@masternode:~$ apt list oracle-j2sdk1.8 Listing... Done oracle-j2sdk1.8/unknown,now 1.8.0+update181-1 amd64 [installed]     And for  dpkg-query -L oracle-j2sdk1.8   I got a lot! The following are the last 20 lines   .... .... .... /usr/lib/jvm/java-8-oracle-cloudera/include /usr/lib/jvm/java-8-oracle-cloudera/include/jdwpTransport.h /usr/lib/jvm/java-8-oracle-cloudera/include/linux /usr/lib/jvm/java-8-oracle-cloudera/include/linux/jawt_md.h /usr/lib/jvm/java-8-oracle-cloudera/include/linux/jni_md.h /usr/lib/jvm/java-8-oracle-cloudera/include/classfile_constants.h /usr/lib/jvm/java-8-oracle-cloudera/include/jni.h /usr/lib/jvm/java-8-oracle-cloudera/include/jvmticmlr.h /usr/lib/jvm/java-8-oracle-cloudera/include/jawt.h /usr/lib/jvm/java-8-oracle-cloudera/include/jvmti.h /usr/lib/jvm/java-8-oracle-cloudera/THIRDPARTYLICENSEREADME-JAVAFX.txt /usr/lib/jvm/java-8-oracle-cloudera/LICENSE /usr/lib/jvm/java-8-oracle-cloudera/release /usr/share /usr/share/doc /usr/share/doc/oracle-j2sdk1.8 /usr/share/doc/oracle-j2sdk1.8/changelog.gz /usr/lib/jvm/java-8-oracle-cloudera/jre/bin/ControlPanel /usr/lib/jvm/java-8-oracle-cloudera/jre/lib/amd64/server/libjsig.so /usr/lib/jvm/java-8-oracle-cloudera/bin/ControlPanel /usr/lib/jvm/java-8-oracle-cloudera/man/ja Thanks  ... View more