Reply
Highlighted
New Contributor
Posts: 5
Registered: ‎08-13-2017

Installation failed. Failed to receive heartbeat from agent.

[ Edited ]

I am trying to install Hue, but I get this error message in the cluster installation step:

Installation failed. Failed to receive heartbeat from agent.
Ensure that the host's hostname is configured properly.
Ensure that port 7182 is accessible on the Cloudera Manager Server (check firewall rules).
Ensure that ports 9000 and 9001 are not in use on the host being added.
Check agent logs in /var/log/cloudera-scm-agent/ on the host being added. (Some of the logs can be found in the installation details).
If Use TLS Encryption for Agents is enabled in Cloudera Manager (Administration -> Settings -> Security), ensure that /etc/cloudera-scm-agent/config.ini has use_tls=1 on the host being added. Restart the corresponding agent and click the Retry link here.

I've seen all the topics here regarding this problem but nothing helped.

Here's the hosts file in my machine (in which I am running the setup wizard):

 

127.0.0.1	localhost
127.0.1.1	mahmoud-yusuf
172.16.16.53	connect
172.16.16.167	cluster

# The following lines are desirable for IPv6 capable hosts
::1     ip6-localhost ip6-loopback
fe00::0 ip6-localnet
ff00::0 ip6-mcastprefix
ff02::1 ip6-allnodes
ff02::2 ip6-allrouters

and here's the hosts file at the "cluster" machine which I entered as the host to install all the things:

127.0.0.1    localhost
127.0.1.1    cluster
172.16.16.53    mahmoud-yusuf
# The following lines are desirable for IPv6 capable hosts
::1     ip6-localhost ip6-loopback
fe00::0 ip6-localnet
ff00::0 ip6-mcastprefix
ff02::1 ip6-allnodes
ff02::2 ip6-allrouters

when I do "ping cluster" from my machine it works well. when I do also "ping mahmoud-yusuf" from the cluster machine it also works well.

It has been two days now and I'm still stuck with this error message.

 

This is the details log

/tmp/scm_prepare_node.xCqkRQeC 
using SSH_CLIENT to get the SCM hostname: 172.16.16.53 33758 22 
opening logging file descriptor 
Starting installation script...

Acquiring installation lock...

BEGIN flock 4 
END (0) 
Detecting root privileges...

effective UID is 1000 
BEGIN which pbrun 
END (1) 
BEGIN sudo -S id 
uid=0(root) gid=0(root) groups=0(root) 
END (0) 
Using 'sudo ' to acquire root privileges 
Detecting distribution...

BEGIN grep 'Ubuntu' /etc/lsb-release 
END (0) 
DISTRIB_ID=Ubuntu 
DISTRIB_DESCRIPTION="Ubuntu 16.04.3 LTS" 
BEGIN grep DISTRIB_CODENAME /etc/lsb-release 
END (0) 
DISTRIB_CODENAME=xenial 
BEGIN echo DISTRIB_CODENAME=xenial | cut -d = -f 2 
END (0) 
xenial 
Detecting Cloudera Manager Server...

BEGIN host -t PTR 172.16.16.53 
Host 53.16.16.172.in-addr.arpa. not found: 3(NXDOMAIN) 
END (1) 
BEGIN which python 
END (0) 
BEGIN python -c 'import socket; import sys; s = socket.socket(socket.AF_INET); s.settimeout(5.0); s.connect((sys.argv[1], int(sys.argv[2]))); s.close();' 172.16.16.53 7182 
/usr/bin/python 
END (0) 
BEGIN which wget 
END (0) 
/usr/bin/wget 
BEGIN wget -qO- -T 1 -t 1 http://169.254.169.254/latest/meta-data/public-hostname && /bin/echo 
END (4) 
Installing package repositories...

validating format of repository file /tmp/scm_prepare_node.xCqkRQeC/repos/ubuntu_xenial/cloudera-manager.list 
installing repository file /tmp/scm_prepare_node.xCqkRQeC/repos/ubuntu_xenial/cloudera-manager.list 
repository file /tmp/scm_prepare_node.xCqkRQeC/repos/ubuntu_xenial/cloudera-manager.list installed 
BEGIN sudo apt-key add /tmp/scm_prepare_node.xCqkRQeC/archive.key 
OK 
END (0) 
installing priority file /tmp/scm_prepare_node.xCqkRQeC/priorities/ubuntu_xenial/cloudera.pref 
priority file /tmp/scm_prepare_node.xCqkRQeC/priorities/ubuntu_xenial/cloudera.pref installed 
Refreshing package metadata...

BEGIN sudo apt-get update 
Hit:1 http://eg.archive.ubuntu.com/ubuntu xenial InRelease 
Hit:2 https://archive.cloudera.com/cm5/ubuntu/xenial/amd64/cm xenial-cm5.12.0 InRelease 
Get:3 http://security.ubuntu.com/ubuntu xenial-security InRelease [102 kB] 
Get:4 http://eg.archive.ubuntu.com/ubuntu xenial-updates InRelease [102 kB] 
Get:5 http://eg.archive.ubuntu.com/ubuntu xenial-backports InRelease [102 kB] 
Fetched 306 kB in 3s (93.8 kB/s) 
Reading package lists... 
W: https://archive.cloudera.com/cm5/ubuntu/xenial/amd64/cm/dists/xenial-cm5.12.0/InRelease: Signature by key F36A89E33CC1BD0F71079007327574EE02A818DD uses weak digest algorithm (SHA1) 
END (0) 
BEGIN sudo apt-get update 
Hit:1 http://eg.archive.ubuntu.com/ubuntu xenial InRelease 
Hit:2 https://archive.cloudera.com/cm5/ubuntu/xenial/amd64/cm xenial-cm5.12.0 InRelease 
Get:3 http://eg.archive.ubuntu.com/ubuntu xenial-updates InRelease [102 kB] 
Get:4 http://security.ubuntu.com/ubuntu xenial-security InRelease [102 kB] 
Get:5 http://eg.archive.ubuntu.com/ubuntu xenial-backports InRelease [102 kB] 
Fetched 306 kB in 3s (92.7 kB/s) 
Reading package lists... 
W: https://archive.cloudera.com/cm5/ubuntu/xenial/amd64/cm/dists/xenial-cm5.12.0/InRelease: Signature by key F36A89E33CC1BD0F71079007327574EE02A818DD uses weak digest algorithm (SHA1) 
END (0) 
Installing oracle-j2sdk1.6 package...

BEGIN sudo dpkg -l oracle-j2sdk1.6 | grep -E '^ii[[:space:]]*oracle-j2sdk1.6[[:space:]]*' 
ii oracle-j2sdk1.6 1.6.0+update31 amd64 Java(TM) JDK, Standard Edition, Oracle(TM) 
END (0) 
BEGIN echo oracle-j2sdk1.6 oracle-j2sdk1.7 cloudera-manager-agent cloudera-manager-daemons | grep oracle-j2sdk1.6 
END (0) 
oracle-j2sdk1.6 oracle-j2sdk1.7 cloudera-manager-agent cloudera-manager-daemons 
BEGIN sudo apt-cache show oracle-j2sdk1.6 
Package: oracle-j2sdk1.6 
Version: 1.6.0+update31 
Architecture: amd64 
Maintainer: Debian Java Maintainers <pkg-java-maintainers@lists.alioth.debian.org> 
Installed-Size: 224994 
Depends: libasound2 (>= 1.0.16), libc6 (>= 2.2.5), libx11-6, libxext6, libxi6, libxt6, libxtst6 
Recommends: netbase, libgtk1.2, libstdc++5 
Replaces: oracle-j2sdk1.6debian 
Provides: j2re1.6, j2sdk1.6, java-browser-plugin, java-compiler, java-runtime, java-runtime-headless, java-sdk, java-virtual-machine, java2-compiler, java2-runtime, java2-runtime-headless, java2-sdk 
Priority: optional 
Section: non-free/devel 
Filename: pool/contrib/o/oracle-j2sdk1.6/oracle-j2sdk1.6_1.6.0+update31_amd64.deb 
Size: 96896162 
SHA256: e3af578020ca3d595fbf1da7f006dde783fa10ace7e147ea135e5d09a8ad32b9 
SHA1: 4b4cd040b2b71f1b754180d89c8e69f5940d27a5 
MD5sum: 183149f3ddc42fcc03e137bea41cf85e 
Description: Java(TM) JDK, Standard Edition, Oracle(TM) 
The Java(TM) 2 SDK is a development environment for building 
applications, applets, and components that can be deployed on the 
Java(TM) platform. 
. 
The Java(TM) 2 SDK software includes tools useful for developing and 
testing programs written in the Java programming language and running 
on the Java platform. These tools are designed to be used from the 
command line. Except for appletviewer, these tools do not provide a 
graphical user interface. 
. 
This package has been automatically created with java-package (0.50). 
Description-md5: 62076f1aba3f5baa8ad532d753bd2313 

END (0) 
BEGIN sudo apt-get -o Dpkg::Options::=--force-confdef -o Dpkg::Options::=--force-confold -y install oracle-j2sdk1.6 
Reading package lists... 
Building dependency tree... 
Reading state information... 
oracle-j2sdk1.6 is already the newest version (1.6.0+update31). 
0 upgraded, 0 newly installed, 0 to remove and 52 not upgraded. 
END (0) 
remote package oracle-j2sdk1.6 installed 
Installing oracle-j2sdk1.7 package...

BEGIN sudo dpkg -l oracle-j2sdk1.7 | grep -E '^ii[[:space:]]*oracle-j2sdk1.7[[:space:]]*' 
ii oracle-j2sdk1.7 1.7.0+update67-1 amd64 no description given 
END (0) 
BEGIN echo oracle-j2sdk1.6 oracle-j2sdk1.7 cloudera-manager-agent cloudera-manager-daemons | grep oracle-j2sdk1.7 
END (0) 
oracle-j2sdk1.6 oracle-j2sdk1.7 cloudera-manager-agent cloudera-manager-daemons 
BEGIN sudo apt-cache show oracle-j2sdk1.7 
Package: oracle-j2sdk1.7 
Version: 1.7.0+update67-1 
License: unknown 
Vendor: root@rpmslave.ent.cloudera.com 
Architecture: amd64 
Maintainer: <scm-users@cloudera.org> 
Installed-Size: 285587 
Provides: java 
Homepage: http://example.com/no-uri-given 
Priority: extra 
Section: default 
Filename: pool/contrib/o/oracle-j2sdk1.7/oracle-j2sdk1.7_1.7.0+update67-1_amd64.deb 
Size: 142448292 
SHA256: b998f4aa8ff8e58ee1d7d55e409330034c8963dbdab07f164fe7baf2025f863e 
SHA1: 2f03993be2d96a6b2abf2259e77bd21ef1a2bbe4 
MD5sum: f7e1bc66703c986be480001ddd087135 
Description: no description given 
Description-md5: c0af8b65ef8df63b3bfb124d96da1778 

END (0) 
BEGIN sudo apt-get -o Dpkg::Options::=--force-confdef -o Dpkg::Options::=--force-confold -y install oracle-j2sdk1.7 
Reading package lists... 
Building dependency tree... 
Reading state information... 
oracle-j2sdk1.7 is already the newest version (1.7.0+update67-1). 
0 upgraded, 0 newly installed, 0 to remove and 52 not upgraded. 
END (0) 
remote package oracle-j2sdk1.7 installed 
Installing cloudera-manager-agent package...

BEGIN sudo dpkg -l cloudera-manager-agent | grep -E '^ii[[:space:]]*cloudera-manager-agent[[:space:]]*' 
ii cloudera-manager-agent 5.12.0-1.cm5120.p0.120~xenial-cm5 amd64 The Cloudera Manager Agent 
END (0) 
BEGIN echo oracle-j2sdk1.6 oracle-j2sdk1.7 cloudera-manager-agent cloudera-manager-daemons | grep cloudera-manager-agent 
END (0) 
BEGIN sudo apt-cache show cloudera-manager-agent 
oracle-j2sdk1.6 oracle-j2sdk1.7 cloudera-manager-agent cloudera-manager-daemons 
Package: cloudera-manager-agent 
Source: enterprise 
Version: 5.12.0-1.cm5120.p0.120~xenial-cm5 
Architecture: amd64 
Maintainer: Cloudera Inc. <https://issues.cloudera.org> 
Installed-Size: 44039 
Depends: libc6 (>= 2.17), libcomerr2 (>= 1.01), libgcc1 (>= 1:3.0), libgssapi-krb5-2 (>= 1.10+dfsg~), libkrb5-3 (>= 1.6.dfsg.2), libssl1.0.0 (>= 1.0.2~beta3), libstdc++6 (>= 5.2), zlib1g (>= 1:1.2.0), lsb-base, psmisc, bash, libsasl2-modules, libsasl2-modules-gssapi-mit, libxslt1.1, libsqlite3-0, openssl, libssl-dev, libfuse2, fuse-utils | fuse, rpcbind, cloudera-manager-daemons (= 5.12.0-1.cm5120.p0.120~xenial-cm5), perl, python-psycopg2, python-mysqldb, apache2, iproute2 
Homepage: http://www.cloudera.com 
Priority: extra 
Section: misc 
Filename: pool/contrib/e/enterprise/cloudera-manager-agent_5.12.0-1.cm5120.p0.120~xenial-cm5_amd64.deb 
Size: 11186376 
SHA256: 69618949fb10d631ac301f21f62ecab0a3631eec456b6de43ef9c6a17c107498 
SHA1: 6b137a4328780d56f964403ff8c56fe7577935a0 
MD5sum: f7c9fc2b393b6d61563ea34ca15b6e61 
Description: The Cloudera Manager Agent 
The Agent is deployed to machines running services managed by Cloudera Manager. 
Description-md5: 482a592ee859d31443f58aa3e48fe303 

END (0) 
Version: 5.12.0-1.cm5120.p0.120~xenial-cm5 
BEGIN sudo apt-get -o Dpkg::Options::=--force-confdef -o Dpkg::Options::=--force-confold -y install cloudera-manager-agent 
Reading package lists... 
Building dependency tree... 
Reading state information... 
cloudera-manager-agent is already the newest version (5.12.0-1.cm5120.p0.120~xenial-cm5). 
0 upgraded, 0 newly installed, 0 to remove and 52 not upgraded. 
END (0) 
remote package cloudera-manager-agent installed 
Installing cloudera-manager-daemons package...

BEGIN sudo dpkg -l cloudera-manager-daemons | grep -E '^ii[[:space:]]*cloudera-manager-daemons[[:space:]]*' 
ii cloudera-manager-daemons 5.12.0-1.cm5120.p0.120~xenial-cm5 all Provides daemons for monitoring Hadoop and related tools. 
END (0) 
BEGIN echo oracle-j2sdk1.6 oracle-j2sdk1.7 cloudera-manager-agent cloudera-manager-daemons | grep cloudera-manager-daemons 
END (0) 
BEGIN sudo apt-cache show cloudera-manager-daemons 
oracle-j2sdk1.6 oracle-j2sdk1.7 cloudera-manager-agent cloudera-manager-daemons 
Package: cloudera-manager-daemons 
Source: enterprise 
Version: 5.12.0-1.cm5120.p0.120~xenial-cm5 
Architecture: all 
Maintainer: Cloudera Inc. <https://issues.cloudera.org> 
Installed-Size: 869404 
Depends: perl 
Homepage: http://www.cloudera.com 
Priority: extra 
Section: misc 
Filename: pool/contrib/e/enterprise/cloudera-manager-daemons_5.12.0-1.cm5120.p0.120~xenial-cm5_all.deb 
Size: 737883268 
SHA256: cf168ac13387bef54c61034e7cfef49539b1616cfb876f91db5dfe458d237780 
SHA1: a18ed00de131d0c358411104fb3d886e0c211101 
MD5sum: 47813b5493281f58b36ca33868229394 
Description: Provides daemons for monitoring Hadoop and related tools. 
Provides daemons for monitoring Hadoop and related tools. 
Description-md5: 35bb5bc8fc2f296f791c3bda9e345340 

END (0) 
Version: 5.12.0-1.cm5120.p0.120~xenial-cm5 
BEGIN sudo apt-get -o Dpkg::Options::=--force-confdef -o Dpkg::Options::=--force-confold -y install cloudera-manager-daemons 
Reading package lists... 
Building dependency tree... 
Reading state information... 
cloudera-manager-daemons is already the newest version (5.12.0-1.cm5120.p0.120~xenial-cm5). 
0 upgraded, 0 newly installed, 0 to remove and 52 not upgraded. 
END (0) 
remote package cloudera-manager-daemons installed 
Installing Unlimited Strength Encryption policy files.

Installation not requested. Step will be skipped. 
Configuring Cloudera Manager Agent...

BEGIN grep server_host=172.16.16.53 /etc/cloudera-scm-agent/config.ini 
END (0) 
scm agent is already configured 
Starting Cloudera Manager Agent...

BEGIN /usr/sbin/service cloudera-scm-agent status 
server_host=172.16.16.53 
* cloudera-scm-agent.service - LSB: Cloudera SCM Agent 
Loaded: loaded (/etc/init.d/cloudera-scm-agent; bad; vendor preset: enabled) 
Active: active (exited) since ح 2017-08-13 12:22:05 EET; 15min ago 
Docs: man:systemd-sysv-generator(8) 
Process: 11732 ExecStop=/etc/init.d/cloudera-scm-agent stop (code=exited, status=0/SUCCESS) 
Process: 11756 ExecStart=/etc/init.d/cloudera-scm-agent start (code=exited, status=0/SUCCESS) 

أغس 13 12:22:05 cluster systemd[1]: Stopped LSB: Cloudera SCM Agent. 
أغس 13 12:22:05 cluster systemd[1]: Starting LSB: Cloudera SCM Agent... 
أغس 13 12:22:05 cluster su[11776]: Successful su for root by root 
أغس 13 12:22:05 cluster su[11776]: + ??? root:root 
أغس 13 12:22:05 cluster su[11776]: pam_unix(su:session): session opened for user root by (uid=0) 
أغس 13 12:22:05 cluster cloudera-scm-agent[11756]: Starting cloudera-scm-agent: * cloudera-scm-agent started 
أغس 13 12:22:05 cluster systemd[1]: Started LSB: Cloudera SCM Agent. 
END (0) 
BEGIN sudo /usr/sbin/service cloudera-scm-agent restart 
END (0) 
agent logs: 
BEGIN sudo tail -n 50 /var/log/cloudera-scm-agent//cloudera-scm-agent.out | sed 's/^/>>/' 
>>/usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/cmf-5.12.0-py2.7.egg/cmf/redaction.py:260: SyntaxWarning: name 'REDACTOR' is assigned to before global declaration 
>> global REDACTOR 
>>/usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/cmf-5.12.0-py2.7.egg/cmf/redaction.py:261: SyntaxWarning: name 'NOP_REDACTOR' is assigned to before global declaration 
>> global NOP_REDACTOR 
>>[13/Aug/2017 11:49:51 +0000] 7233 MainThread agent INFO SCM Agent Version: 5.12.0 
>>[13/Aug/2017 11:49:51 +0000] 7233 MainThread agent WARNING Expected mode 0751 for /run/cloudera-scm-agent but was 0755 
>>[13/Aug/2017 11:49:51 +0000] 7233 MainThread agent INFO Re-using pre-existing directory: /run/cloudera-scm-agent 
>>[13/Aug/2017 11:54:05 +0000] 8486 MainThread agent INFO SCM Agent Version: 5.12.0 
>>[13/Aug/2017 11:54:05 +0000] 8486 MainThread agent WARNING Expected mode 0751 for /run/cloudera-scm-agent but was 0755 
>>[13/Aug/2017 11:54:05 +0000] 8486 MainThread agent INFO Re-using pre-existing directory: /run/cloudera-scm-agent 
>>[13/Aug/2017 11:56:13 +0000] 9583 MainThread agent INFO SCM Agent Version: 5.12.0 
>>[13/Aug/2017 11:56:13 +0000] 9583 MainThread agent WARNING Expected mode 0751 for /run/cloudera-scm-agent but was 0755 
>>[13/Aug/2017 11:56:13 +0000] 9583 MainThread agent INFO Re-using pre-existing directory: /run/cloudera-scm-agent 
>>[13/Aug/2017 12:22:05 +0000] 11792 MainThread agent INFO SCM Agent Version: 5.12.0 
>>[13/Aug/2017 12:22:05 +0000] 11792 MainThread agent WARNING Expected mode 0751 for /run/cloudera-scm-agent but was 0755 
>>[13/Aug/2017 12:22:05 +0000] 11792 MainThread agent INFO Re-using pre-existing directory: /run/cloudera-scm-agent 
>>[13/Aug/2017 12:37:11 +0000] 13044 MainThread agent INFO SCM Agent Version: 5.12.0 
>>[13/Aug/2017 12:37:11 +0000] 13044 MainThread agent WARNING Expected mode 0751 for /run/cloudera-scm-agent but was 0755 
>>[13/Aug/2017 12:37:11 +0000] 13044 MainThread agent INFO Re-using pre-existing directory: /run/cloudera-scm-agent 
>>/usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/cmf-5.12.0-py2.7.egg/cmf/redaction.py:260: SyntaxWarning: name 'REDACTOR' is assigned to before global declaration 
>> global REDACTOR 
>>/usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/cmf-5.12.0-py2.7.egg/cmf/redaction.py:261: SyntaxWarning: name 'NOP_REDACTOR' is assigned to before global declaration 
>> global NOP_REDACTOR 
>>[13/Aug/2017 11:49:51 +0000] 7233 MainThread agent INFO SCM Agent Version: 5.12.0 
>>[13/Aug/2017 11:49:51 +0000] 7233 MainThread agent WARNING Expected mode 0751 for /run/cloudera-scm-agent but was 0755 
>>[13/Aug/2017 11:49:51 +0000] 7233 MainThread agent INFO Re-using pre-existing directory: /run/cloudera-scm-agent 
>>[13/Aug/2017 11:54:05 +0000] 8486 MainThread agent INFO SCM Agent Version: 5.12.0 
>>[13/Aug/2017 11:54:05 +0000] 8486 MainThread agent WARNING Expected mode 0751 for /run/cloudera-scm-agent but was 0755 
>>[13/Aug/2017 11:54:05 +0000] 8486 MainThread agent INFO Re-using pre-existing directory: /run/cloudera-scm-agent 
>>[13/Aug/2017 11:56:13 +0000] 9583 MainThread agent INFO SCM Agent Version: 5.12.0 
>>[13/Aug/2017 11:56:13 +0000] 9583 MainThread agent WARNING Expected mode 0751 for /run/cloudera-scm-agent but was 0755 
>>[13/Aug/2017 11:56:13 +0000] 9583 MainThread agent INFO Re-using pre-existing directory: /run/cloudera-scm-agent 
>>[13/Aug/2017 12:22:05 +0000] 11792 MainThread agent INFO SCM Agent Version: 5.12.0 
>>[13/Aug/2017 12:22:05 +0000] 11792 MainThread agent WARNING Expected mode 0751 for /run/cloudera-scm-agent but was 0755 
>>[13/Aug/2017 12:22:05 +0000] 11792 MainThread agent INFO Re-using pre-existing directory: /run/cloudera-scm-agent 
>>[13/Aug/2017 12:37:11 +0000] 13044 MainThread agent INFO SCM Agent Version: 5.12.0 
>>[13/Aug/2017 12:37:11 +0000] 13044 MainThread agent WARNING Expected mode 0751 for /run/cloudera-scm-agent but was 0755 
>>[13/Aug/2017 12:37:11 +0000] 13044 MainThread agent INFO Re-using pre-existing directory: /run/cloudera-scm-agent 
END (0) 
BEGIN sudo tail -n 50 /var/log/cloudera-scm-agent//cloudera-scm-agent.log | sed 's/^/>>/' 
>>[13/Aug/2017 12:22:07 +0000] 11817 MainThread filesystem_map INFO Using tolerance of 60.000000 
>>[13/Aug/2017 12:22:07 +0000] 11817 MainThread filesystem_map INFO Local filesystem types whitelist: ['ext2', 'ext3', 'ext4', 'xfs'] 
>>[13/Aug/2017 12:22:07 +0000] 11817 MainThread kt_renewer INFO Agent wide credential cache set to /run/cloudera-scm-agent/krb5cc_cm_agent_0 
>>[13/Aug/2017 12:22:07 +0000] 11817 MainThread agent INFO Using metrics_url_timeout_seconds of 30.000000 
>>[13/Aug/2017 12:22:07 +0000] 11817 MainThread agent INFO Using task_metrics_timeout_seconds of 5.000000 
>>[13/Aug/2017 12:22:07 +0000] 11817 MainThread agent INFO Using max_collection_wait_seconds of 10.000000 
>>[13/Aug/2017 12:22:07 +0000] 11817 MainThread metrics INFO Importing tasktracker metric schema from file /usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/cmf-5.12.0-py2.7.egg/cmf/monitor/tasktracker/schema.json 
>>[13/Aug/2017 12:22:07 +0000] 11817 MainThread ntp_monitor INFO Using timeout of 2.000000 
>>[13/Aug/2017 12:22:07 +0000] 11817 MainThread dns_names INFO Using timeout of 30.000000 
>>[13/Aug/2017 12:22:07 +0000] 11817 MainThread __init__ INFO Created DNS monitor. 
>>[13/Aug/2017 12:22:07 +0000] 11817 MainThread stacks_collection_manager INFO Using max_uncompressed_file_size_bytes: 5242880 
>>[13/Aug/2017 12:22:07 +0000] 11817 MainThread __init__ INFO Importing metric schema from file /usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/cmf-5.12.0-py2.7.egg/cmf/monitor/schema.json 
>>[13/Aug/2017 12:22:07 +0000] 11817 MainThread agent INFO Supervised processes will add the following to their environment (in addition to the supervisor's env): {'CDH_PARQUET_HOME': '/usr/lib/parquet', 'JSVC_HOME': '/usr/libexec/bigtop-utils', 'CMF_PACKAGE_DIR': '/usr/lib/cmf/service', 'CDH_HADOOP_BIN': '/usr/bin/hadoop', 'MGMT_HOME': '/usr/share/cmf', 'CDH_IMPALA_HOME': '/usr/lib/impala', 'CDH_YARN_HOME': '/usr/lib/hadoop-yarn', 'CDH_HDFS_HOME': '/usr/lib/hadoop-hdfs', 'PATH': '/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games', 'CDH_HUE_PLUGINS_HOME': '/usr/lib/hadoop', 'CM_STATUS_CODES': u'STATUS_NONE HDFS_DFS_DIR_NOT_EMPTY HBASE_TABLE_DISABLED HBASE_TABLE_ENABLED JOBTRACKER_IN_STANDBY_MODE YARN_RM_IN_STANDBY_MODE', 'KEYTRUSTEE_KP_HOME': '/usr/share/keytrustee-keyprovider', 'CLOUDERA_ORACLE_CONNECTOR_JAR': '/usr/share/java/oracle-connector-java.jar', 'CDH_SQOOP2_HOME': '/usr/lib/sqoop2', 'KEYTRUSTEE_SERVER_HOME': '/usr/lib/keytrustee-server', 'CDH_MR2_HOME': '/usr/lib/hadoop-mapreduce', 'HIVE_DEFAULT_XML': '/etc/hive/conf.dist/hive-default.xml', 'CLOUDERA_POSTGRESQL_JDBC_JAR': '/usr/share/cmf/lib/postgresql-9.0-801.jdbc4.jar', 'CDH_KMS_HOME': '/usr/lib/hadoop-kms', 'CDH_HBASE_HOME': '/usr/lib/hbase', 'CDH_SQOOP_HOME': '/usr/lib/sqoop', 'WEBHCAT_DEFAULT_XML': '/etc/hive-webhcat/conf.dist/webhcat-default.xml', 'CDH_OOZIE_HOME': '/usr/lib/oozie', 'CDH_ZOOKEEPER_HOME': '/usr/lib/zookeeper', 'CDH_HUE_HOME': '/usr/lib/hue', 'CLOUDERA_MYSQL_CONNECTOR_JAR': '/usr/share/java/mysql-connector-java.jar', 'CDH_HBASE_INDEXER_HOME': '/usr/lib/hbase-solr', 'CDH_MR1_HOME': '/usr/lib/hadoop-0.20-mapreduce', 'CDH_SOLR_HOME': '/usr/lib/solr', 'CDH_PIG_HOME': '/usr/lib/pig', 'CDH_SENTRY_HOME': '/usr/lib/sentry', 'CDH_CRUNCH_HOME': '/usr/lib/crunch', 'CDH_LLAMA_HOME': '/usr/lib/llama/', 'CDH_HTTPFS_HOME': '/usr/lib/hadoop-httpfs', 'CDH_HADOOP_HOME': '/usr/lib/hadoop', 'CDH_HIVE_HOME': '/usr/lib/hive', 'ORACLE_HOME': '/usr/share/oracle/instantclient', 'CDH_HCAT_HOME': '/usr/lib/hive-hcatalog', 'CDH_KAFKA_HOME': '/usr/lib/kafka', 'CDH_SPARK_HOME': '/usr/lib/spark', 'TOMCAT_HOME': '/usr/lib/bigtop-tomcat', 'CDH_FLUME_HOME': '/usr/lib/flume-ng'} 
>>[13/Aug/2017 12:22:07 +0000] 11817 MainThread agent INFO To override these variables, use /etc/cloudera-scm-agent/config.ini. Environment variables for CDH locations are not used when CDH is installed from parcels. 
>>[13/Aug/2017 12:22:07 +0000] 11817 MainThread agent INFO >>[13/Aug/2017 12:22:07 +0000] 11817 MainThread filesystem_map INFO Using tolerance of 60.000000 
>>[13/Aug/2017 12:22:07 +0000] 11817 MainThread filesystem_map INFO Local filesystem types whitelist: ['ext2', 'ext3', 'ext4', 'xfs'] 
>>[13/Aug/2017 12:22:07 +0000] 11817 MainThread kt_renewer INFO Agent wide credential cache set to /run/cloudera-scm-agent/krb5cc_cm_agent_0 
>>[13/Aug/2017 12:22:07 +0000] 11817 MainThread agent INFO Using metrics_url_timeout_seconds of 30.000000 
>>[13/Aug/2017 12:22:07 +0000] 11817 MainThread agent INFO Using task_metrics_timeout_seconds of 5.000000 
>>[13/Aug/2017 12:22:07 +0000] 11817 MainThread agent INFO Using max_collection_wait_seconds of 10.000000 
>>[13/Aug/2017 12:22:07 +0000] 11817 MainThread metrics INFO Importing tasktracker metric schema from file /usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/cmf-5.12.0-py2.7.egg/cmf/monitor/tasktracker/schema.json 
>>[13/Aug/2017 12:22:07 +0000] 11817 MainThread ntp_monitor INFO Using timeout of 2.000000 
>>[13/Aug/2017 12:22:07 +0000] 11817 MainThread dns_names INFO Using timeout of 30.000000 
>>[13/Aug/2017 12:22:07 +0000] 11817 MainThread __init__ INFO Created DNS monitor. 
>>[13/Aug/2017 12:22:07 +0000] 11817 MainThread stacks_collection_manager INFO Using max_uncompressed_file_size_bytes: 5242880 
>>[13/Aug/2017 12:22:07 +0000] 11817 MainThread __init__ INFO Importing metric schema from file /usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/cmf-5.12.0-py2.7.egg/cmf/monitor/schema.json 
>>[13/Aug/2017 12:22:07 +0000] 11817 MainThread agent INFO Supervised processes will add the following to their environment (in addition to the supervisor's env): {'CDH_PARQUET_HOME': '/usr/lib/parquet', 'JSVC_HOME': '/usr/libexec/bigtop-utils', 'CMF_PACKAGE_DIR': '/usr/lib/cmf/service', 'CDH_HADOOP_BIN': '/usr/bin/hadoop', 'MGMT_HOME': '/usr/share/cmf', 'CDH_IMPALA_HOME': '/usr/lib/impala', 'CDH_YARN_HOME': '/usr/lib/hadoop-yarn', 'CDH_HDFS_HOME': '/usr/lib/hadoop-hdfs', 'PATH': '/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games', 'CDH_HUE_PLUGINS_HOME': '/usr/lib/hadoop', 'CM_STATUS_CODES': u'STATUS_NONE HDFS_DFS_DIR_NOT_EMPTY HBASE_TABLE_DISABLED HBASE_TABLE_ENABLED JOBTRACKER_IN_STANDBY_MODE YARN_RM_IN_STANDBY_MODE', 'KEYTRUSTEE_KP_HOME': '/usr/share/keytrustee-keyprovider', 'CLOUDERA_ORACLE_CONNECTOR_JAR': '/usr/share/java/oracle-connector-java.jar', 'CDH_SQOOP2_HOME': '/usr/lib/sqoop2', 'KEYTRUSTEE_SERVER_HOME': '/usr/lib/keytrustee-server', 'CDH_MR2_HOME': '/usr/lib/hadoop-mapreduce', 'HIVE_DEFAULT_XML': '/etc/hive/conf.dist/hive-default.xml', 'CLOUDERA_POSTGRESQL_JDBC_JAR': '/usr/share/cmf/lib/postgresql-9.0-801.jdbc4.jar', 'CDH_KMS_HOME': '/usr/lib/hadoop-kms', 'CDH_HBASE_HOME': '/usr/lib/hbase', 'CDH_SQOOP_HOME': '/usr/lib/sqoop', 'WEBHCAT_DEFAULT_XML': '/etc/hive-webhcat/conf.dist/webhcat-default.xml', 'CDH_OOZIE_HOME': '/usr/lib/oozie', 'CDH_ZOOKEEPER_HOME': '/usr/lib/zookeeper', 'CDH_HUE_HOME': '/usr/lib/hue', 'CLOUDERA_MYSQL_CONNECTOR_JAR': '/usr/share/java/mysql-connector-java.jar', 'CDH_HBASE_INDEXER_HOME': '/usr/lib/hbase-solr', 'CDH_MR1_HOME': '/usr/lib/hadoop-0.20-mapreduce', 'CDH_SOLR_HOME': '/usr/lib/solr', 'CDH_PIG_HOME': '/usr/lib/pig', 'CDH_SENTRY_HOME': '/usr/lib/sentry', 'CDH_CRUNCH_HOME': '/usr/lib/crunch', 'CDH_LLAMA_HOME': '/usr/lib/llama/', 'CDH_HTTPFS_HOME': '/usr/lib/hadoop-httpfs', 'CDH_HADOOP_HOME': '/usr/lib/hadoop', 'CDH_HIVE_HOME': '/usr/lib/hive', 'ORACLE_HOME': '/usr/share/oracle/instantclient', 'CDH_HCAT_HOME': '/usr/lib/hive-hcatalog', 'CDH_KAFKA_HOME': '/usr/lib/kafka', 'CDH_SPARK_HOME': '/usr/lib/spark', 'TOMCAT_HOME': '/usr/lib/bigtop-tomcat', 'CDH_FLUME_HOME': '/usr/lib/flume-ng'} 
>>[13/Aug/2017 12:22:07 +0000] 11817 MainThread agent INFO To override these variables, use /etc/cloudera-scm-agent/config.ini. Environment variables for CDH locations are not used when CDH is installed from parcels. 
>>[13/Aug/2017 12:22:07 +0000] 11817 MainThread agent INFO Re-using pre-existing directory: /run/cloudera-scm-agent/process 
>>[13/Aug/2017 12:22:07 +0000] 11817 MainThread agent INFO Re-using pre-existing directory: /run/cloudera-scm-agent/supervisor 
>>[13/Aug/2017 12:22:07 +0000] 11817 MainThread agent INFO Re-using pre-existing directory: /run/cloudera-scm-agent/flood 
>>[13/Aug/2017 12:22:07 +0000] 11817 MainThread agent INFO Re-using pre-existing directory: /run/cloudera-scm-agent/supervisor/include 
>>[13/Aug/2017 12:22:08 +0000] 11817 MainThread agent ERROR Failed to connect to previous supervisor. 
>>Traceback (most recent call last): 
>> File "/usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/cmf-5.12.0-py2.7.egg/cmf/agent.py", line 2109, in find_or_start_supervisor 
>> self.configure_supervisor_clients() 
>> File "/usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/cmf-5.12.0-py2.7.egg/cmf/agent.py", line 2290, in configure_supervisor_clients 
>> supervisor_options.realize(args=["-c", os.path.join(self.supervisor_dir, "supervisord.conf")]) 
>> File "/usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/supervisor-3.0-py2.7.egg/supervisor/options.py", line 1599, in realize 
>> Options.realize(self, *arg, **kw) 
>> File "/usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/supervisor-3.0-py2.7.egg/supervisor/options.py", line 333, in realize 
>> self.process_config() 
>> File "/usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/supervisor-3.0-py2.7.egg/supervisor/options.py", line 341, in process_config 
>> self.process_config_file(do_usage) 
>> File "/usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/supervisor-3.0-py2.7.egg/supervisor/options.py", line 376, in process_config_file 
>> self.usage(str(msg)) 
>> File "/usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/supervisor-3.0-py2.7.egg/supervisor/options.py", line 164, in usage 
>> self.exit(2) 
>>SystemExit: 2 
>>[13/Aug/2017 12:22:08 +0000] 11817 Dummy-1 daemonize WARNING Stopping daemon. 
>>[13/Aug/2017 12:22:08 +0000] 11817 Dummy-1 agent INFO Stopping agent... 
>>[13/Aug/2017 12:22:08 +0000] 11817 Dummy-1 agent INFO No extant cgroups; unmounting any cgroup roots 
>>[13/Aug/2017 12:37:11 +0000] 13070 MainThread agent INFO SCM Agent Version: 5.12.0 
>>[13/Aug/2017 12:37:11 +0000] 13070 MainThread agent INFO Agent Protocol Version: 4 
>>[13/Aug/2017 12:37:11 +0000] 13070 MainThread agent INFO Using Host ID: d477a584-5588-420e-9a8e-d7e1dac57369 
>>[13/Aug/2017 12:37:11 +0000] 13070 MainThread agent INFO Using directory: /run/cloudera-scm-agent 
>>[13/Aug/2017 12:37:11 +0000] 13070 MainThread agent INFO Using supervisor binary path: /usr/lib/cmf/agent/build/env/bin/supervisord 
>>[13/Aug/2017 12:37:11 +0000] 13070 MainThread agent INFO Neither verify_cert_file nor verify_cert_dir are configured. Not performing validation of server certificates in HTTPS communication. These options can be configured in this agent's config.ini file to enable certificate validation. 
>>[13/Aug/2017 12:37:11 +0000] 13070 MainThread agent INFO Agent Logging Level: INFO 
>>[13/Aug/2017 12:37:11 +0000] 13070 MainThread agent INFO No command line vars 
>>[13/Aug/2017 12:37:11 +0000] 13070 MainThread agent INFO Missing database jar: /usr/share/java/mysql-connector-java.jar (normal, if you're not using this database type) 
>>[13/Aug/2017 12:37:11 +0000] 13070 MainThread agent INFO Missing database jar: /usr/share/java/oracle-connector-java.jar (normal, if you're not using this database type) 
>>[13/Aug/2017 12:37:11 +0000] 13070 MainThread agent INFO Found database jar: /usr/share/cmf/lib/postgresql-9.0-801.jdbc4.jar 
>>[13/Aug/2017 12:37:11 +0000] 13070 MainThread agent INFO Agent starting as pid 13070 user root(0) group root(0). 
Re-using pre-existing directory: /run/cloudera-scm-agent/process 
>>[13/Aug/2017 12:22:07 +0000] 11817 MainThread agent INFO Re-using pre-existing directory: /run/cloudera-scm-agent/supervisor 
>>[13/Aug/2017 12:22:07 +0000] 11817 MainThread agent INFO Re-using pre-existing directory: /run/cloudera-scm-agent/flood 
>>[13/Aug/2017 12:22:07 +0000] 11817 MainThread agent INFO Re-using pre-existing directory: /run/cloudera-scm-agent/supervisor/include 
>>[13/Aug/2017 12:22:08 +0000] 11817 MainThread agent ERROR Failed to connect to previous supervisor. 
>>Traceback (most recent call last): 
>> File "/usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/cmf-5.12.0-py2.7.egg/cmf/agent.py", line 2109, in find_or_start_supervisor 
>> self.configure_supervisor_clients() 
>> File "/usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/cmf-5.12.0-py2.7.egg/cmf/agent.py", line 2290, in configure_supervisor_clients 
>> supervisor_options.realize(args=["-c", os.path.join(self.supervisor_dir, "supervisord.conf")]) 
>> File "/usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/supervisor-3.0-py2.7.egg/supervisor/options.py", line 1599, in realize 
>> Options.realize(self, *arg, **kw) 
>> File "/usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/supervisor-3.0-py2.7.egg/supervisor/options.py", line 333, in realize 
>> self.process_config() 
>> File "/usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/supervisor-3.0-py2.7.egg/supervisor/options.py", line 341, in process_config 
>> self.process_config_file(do_usage) 
>> File "/usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/supervisor-3.0-py2.7.egg/supervisor/options.py", line 376, in process_config_file 
>> self.usage(str(msg)) 
>> File "/usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/supervisor-3.0-py2.7.egg/supervisor/options.py", line 164, in usage 
>> self.exit(2) 
>>SystemExit: 2 
>>[13/Aug/2017 12:22:08 +0000] 11817 Dummy-1 daemonize WARNING Stopping daemon. 
>>[13/Aug/2017 12:22:08 +0000] 11817 Dummy-1 agent INFO Stopping agent... 
>>[13/Aug/2017 12:22:08 +0000] 11817 Dummy-1 agent INFO No extant cgroups; unmounting any cgroup roots 
>>[13/Aug/2017 12:37:11 +0000] 13070 MainThread agent INFO SCM Agent Version: 5.12.0 
>>[13/Aug/2017 12:37:11 +0000] 13070 MainThread agent INFO Agent Protocol Version: 4 
>>[13/Aug/2017 12:37:11 +0000] 13070 MainThread agent INFO Using Host ID: d477a584-5588-420e-9a8e-d7e1dac57369 
>>[13/Aug/2017 12:37:11 +0000] 13070 MainThread agent INFO Using directory: /run/cloudera-scm-agent 
>>[13/Aug/2017 12:37:11 +0000] 13070 MainThread agent INFO Using supervisor binary path: /usr/lib/cmf/agent/build/env/bin/supervisord 
>>[13/Aug/2017 12:37:11 +0000] 13070 MainThread agent INFO Neither verify_cert_file nor verify_cert_dir are configured. Not performing validation of server certificates in HTTPS communication. These options can be configured in this agent's config.ini file to enable certificate validation. 
>>[13/Aug/2017 12:37:11 +0000] 13070 MainThread agent INFO Agent Logging Level: INFO 
>>[13/Aug/2017 12:37:11 +0000] 13070 MainThread agent INFO No command line vars 
>>[13/Aug/2017 12:37:11 +0000] 13070 MainThread agent INFO Missing database jar: /usr/share/java/mysql-connector-java.jar (normal, if you're not using this database type) 
>>[13/Aug/2017 12:37:11 +0000] 13070 MainThread agent INFO Missing database jar: /usr/share/java/oracle-connector-java.jar (normal, if you're not using this database type) 
>>[13/Aug/2017 12:37:11 +0000] 13070 MainThread agent INFO Found database jar: /usr/share/cmf/lib/postgresql-9.0-801.jdbc4.jar 
>>[13/Aug/2017 12:37:11 +0000] 13070 MainThread agent INFO Agent starting as pid 13070 user root(0) group root(0). 
END (0) 
end of agent logs. 
scm agent restarted 
Installation script completed successfully.

all done 
closing logging file descriptor 
Last Refreshed: Aug 13, 2017 1:49:19 PM EEST Turn Off Auto Refresh Close
Back 1 2 3 4 5 6 7 Continue
Cloudera Employee
Posts: 196
Registered: ‎07-08-2013

Re: Installation failed. Failed to receive heartbeat from agent.

[ Edited ]

Hello,

 

Based on the below stack trace in your agent log, you may be running into the same issue as these two [0] [1] fellow community member. Could you give the workaround posted in [1] a try.

 

>>[13/Aug/2017 12:22:08 +0000] 11817 MainThread agent ERROR Failed to connect to previous supervisor. 
>>Traceback (most recent call last): 
>> File "/usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/cmf-5.12.0-py2.7.egg/cmf/agent.py", line 2109, in find_or_start_supervisor 
>> self.configure_supervisor_clients() 
>> File "/usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/cmf-5.12.0-py2.7.egg/cmf/agent.py", line 2290, in configure_supervisor_clients 
>> supervisor_options.realize(args=["-c", os.path.join(self.supervisor_dir, "supervisord.conf")]) 
>> File "/usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/supervisor-3.0-py2.7.egg/supervisor/options.py", line 1599, in realize 
>> Options.realize(self, *arg, **kw) 
>> File "/usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/supervisor-3.0-py2.7.egg/supervisor/options.py", line 333, in realize 
>> self.process_config() 
>> File "/usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/supervisor-3.0-py2.7.egg/supervisor/options.py", line 341, in process_config 
>> self.process_config_file(do_usage) 
>> File "/usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/supervisor-3.0-py2.7.egg/supervisor/options.py", line 376, in process_config_file 
>> self.usage(str(msg)) 
>> File "/usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/supervisor-3.0-py2.7.egg/supervisor/options.py", line 164, in usage 
>> self.exit(2) 
>>SystemExit: 2 

[0] http://community.cloudera.com/t5/Cloudera-Manager-Installation/CDH-5-12-0-clouder-manager-agent-can-...

 

[1] http://community.cloudera.com/t5/Cloudera-Manager-Installation/Cloudera-Manager-Agent-cannot-connect...

 

New Contributor
Posts: 5
Registered: ‎08-13-2017

Re: Installation failed. Failed to receive heartbeat from agent.

[ Edited ]

...

New Contributor
Posts: 5
Registered: ‎08-13-2017

Re: Installation failed. Failed to receive heartbeat from agent.

[ Edited ]

Thanks, this helped me ending these logs, but  after that I faced some errors in next steps, so I decided to setup a new cluster node from the beginning, however, I am getting the same error message againg  but with different logs:

 Installation failed. Failed to receive heartbeat from agent.

/tmp/scm_prepare_node.uWGZDCrn 
using SSH_CLIENT to get the SCM hostname: 172.16.16.53 53838 22 
opening logging file descriptor 
Starting installation script...

Acquiring installation lock...

BEGIN flock 4 
END (0) 
Detecting root privileges...

effective UID is 1000 
BEGIN which pbrun 
END (1) 
BEGIN sudo -S id 
uid=0(root) gid=0(root) groups=0(root) 
END (0) 
Using 'sudo ' to acquire root privileges 
Detecting distribution...

BEGIN grep 'Ubuntu' /etc/lsb-release 
END (0) 
DISTRIB_ID=Ubuntu 
DISTRIB_DESCRIPTION="Ubuntu 16.04.3 LTS" 
BEGIN grep DISTRIB_CODENAME /etc/lsb-release 
END (0) 
DISTRIB_CODENAME=xenial 
BEGIN echo DISTRIB_CODENAME=xenial | cut -d = -f 2 
END (0) 
xenial 
Detecting Cloudera Manager Server...

BEGIN host -t PTR 172.16.16.53 
Host 53.16.16.172.in-addr.arpa. not found: 3(NXDOMAIN) 
END (1) 
BEGIN which python 
END (0) 
BEGIN python -c 'import socket; import sys; s = socket.socket(socket.AF_INET); s.settimeout(5.0); s.connect((sys.argv[1], int(sys.argv[2]))); s.close();' 172.16.16.53 7182 
/usr/bin/python 
END (0) 
BEGIN which wget 
END (0) 
/usr/bin/wget 
BEGIN wget -qO- -T 1 -t 1 http://169.254.169.254/latest/meta-data/public-hostname && /bin/echo 
END (4) 
Installing package repositories...

validating format of repository file /tmp/scm_prepare_node.uWGZDCrn/repos/ubuntu_xenial/cloudera-manager.list 
installing repository file /tmp/scm_prepare_node.uWGZDCrn/repos/ubuntu_xenial/cloudera-manager.list 
repository file /tmp/scm_prepare_node.uWGZDCrn/repos/ubuntu_xenial/cloudera-manager.list installed 
BEGIN sudo apt-key add /tmp/scm_prepare_node.uWGZDCrn/archive.key 
OK 
END (0) 
installing priority file /tmp/scm_prepare_node.uWGZDCrn/priorities/ubuntu_xenial/cloudera.pref 
priority file /tmp/scm_prepare_node.uWGZDCrn/priorities/ubuntu_xenial/cloudera.pref installed 
Refreshing package metadata...

BEGIN sudo apt-get update 
Get:1 http://security.ubuntu.com/ubuntu xenial-security InRelease [102 kB] 
Hit:2 http://eg.archive.ubuntu.com/ubuntu xenial InRelease 
Get:3 http://eg.archive.ubuntu.com/ubuntu xenial-updates InRelease [102 kB] 
Get:4 http://eg.archive.ubuntu.com/ubuntu xenial-backports InRelease [102 kB] 
Hit:5 https://archive.cloudera.com/cm5/ubuntu/xenial/amd64/cm xenial-cm5.12.0 InRelease 
Fetched 306 kB in 1s (153 kB/s) 
Reading package lists... 
W: https://archive.cloudera.com/cm5/ubuntu/xenial/amd64/cm/dists/xenial-cm5.12.0/InRelease: Signature by key F36A89E33CC1BD0F71079007327574EE02A818DD uses weak digest algorithm (SHA1) 
END (0) 
BEGIN sudo apt-get update 
Hit:1 http://eg.archive.ubuntu.com/ubuntu xenial InRelease 
Hit:2 https://archive.cloudera.com/cm5/ubuntu/xenial/amd64/cm xenial-cm5.12.0 InRelease 
Get:3 http://eg.archive.ubuntu.com/ubuntu xenial-updates InRelease [102 kB] 
Get:4 http://security.ubuntu.com/ubuntu xenial-security InRelease [102 kB] 
Get:5 http://eg.archive.ubuntu.com/ubuntu xenial-backports InRelease [102 kB] 
Fetched 306 kB in 2s (119 kB/s) 
Reading package lists... 
W: https://archive.cloudera.com/cm5/ubuntu/xenial/amd64/cm/dists/xenial-cm5.12.0/InRelease: Signature by key F36A89E33CC1BD0F71079007327574EE02A818DD uses weak digest algorithm (SHA1) 
END (0) 
Installing oracle-j2sdk1.6 package...

BEGIN sudo dpkg -l oracle-j2sdk1.6 | grep -E '^ii[[:space:]]*oracle-j2sdk1.6[[:space:]]*' 
ii oracle-j2sdk1.6 1.6.0+update31 amd64 Java(TM) JDK, Standard Edition, Oracle(TM) 
END (0) 
BEGIN echo oracle-j2sdk1.6 oracle-j2sdk1.7 cloudera-manager-agent cloudera-manager-daemons | grep oracle-j2sdk1.6 
END (0) 
oracle-j2sdk1.6 oracle-j2sdk1.7 cloudera-manager-agent cloudera-manager-daemons 
BEGIN sudo apt-cache show oracle-j2sdk1.6 
Package: oracle-j2sdk1.6 
Version: 1.6.0+update31 
Architecture: amd64 
Maintainer: Debian Java Maintainers <pkg-java-maintainers@lists.alioth.debian.org> 
Installed-Size: 224994 
Depends: libasound2 (>= 1.0.16), libc6 (>= 2.2.5), libx11-6, libxext6, libxi6, libxt6, libxtst6 
Recommends: netbase, libgtk1.2, libstdc++5 
Replaces: oracle-j2sdk1.6debian 
Provides: j2re1.6, j2sdk1.6, java-browser-plugin, java-compiler, java-runtime, java-runtime-headless, java-sdk, java-virtual-machine, java2-compiler, java2-runtime, java2-runtime-headless, java2-sdk 
Priority: optional 
Section: non-free/devel 
Filename: pool/contrib/o/oracle-j2sdk1.6/oracle-j2sdk1.6_1.6.0+update31_amd64.deb 
Size: 96896162 
SHA256: e3af578020ca3d595fbf1da7f006dde783fa10ace7e147ea135e5d09a8ad32b9 
SHA1: 4b4cd040b2b71f1b754180d89c8e69f5940d27a5 
MD5sum: 183149f3ddc42fcc03e137bea41cf85e 
Description: Java(TM) JDK, Standard Edition, Oracle(TM) 
The Java(TM) 2 SDK is a development environment for building 
applications, applets, and components that can be deployed on the 
Java(TM) platform. 
. 
The Java(TM) 2 SDK software includes tools useful for developing and 
testing programs written in the Java programming language and running 
on the Java platform. These tools are designed to be used from the 
command line. Except for appletviewer, these tools do not provide a 
graphical user interface. 
. 
This package has been automatically created with java-package (0.50). 
Description-md5: 62076f1aba3f5baa8ad532d753bd2313 

END (0) 
BEGIN sudo apt-get -o Dpkg::Options::=--force-confdef -o Dpkg::Options::=--force-confold -y install oracle-j2sdk1.6 
Reading package lists... 
Building dependency tree... 
Reading state information... 
oracle-j2sdk1.6 is already the newest version (1.6.0+update31). 
0 upgraded, 0 newly installed, 0 to remove and 52 not upgraded. 
END (0) 
remote package oracle-j2sdk1.6 installed 
Installing oracle-j2sdk1.7 package...

BEGIN sudo dpkg -l oracle-j2sdk1.7 | grep -E '^ii[[:space:]]*oracle-j2sdk1.7[[:space:]]*' 
ii oracle-j2sdk1.7 1.7.0+update67-1 amd64 no description given 
END (0) 
BEGIN echo oracle-j2sdk1.6 oracle-j2sdk1.7 cloudera-manager-agent cloudera-manager-daemons | grep oracle-j2sdk1.7 
END (0) 
BEGIN sudo apt-cache show oracle-j2sdk1.7 
oracle-j2sdk1.6 oracle-j2sdk1.7 cloudera-manager-agent cloudera-manager-daemons 
Package: oracle-j2sdk1.7 
Version: 1.7.0+update67-1 
License: unknown 
Vendor: root@rpmslave.ent.cloudera.com 
Architecture: amd64 
Maintainer: <scm-users@cloudera.org> 
Installed-Size: 285587 
Provides: java 
Homepage: http://example.com/no-uri-given 
Priority: extra 
Section: default 
Filename: pool/contrib/o/oracle-j2sdk1.7/oracle-j2sdk1.7_1.7.0+update67-1_amd64.deb 
Size: 142448292 
SHA256: b998f4aa8ff8e58ee1d7d55e409330034c8963dbdab07f164fe7baf2025f863e 
SHA1: 2f03993be2d96a6b2abf2259e77bd21ef1a2bbe4 
MD5sum: f7e1bc66703c986be480001ddd087135 
Description: no description given 
Description-md5: c0af8b65ef8df63b3bfb124d96da1778 

END (0) 
BEGIN sudo apt-get -o Dpkg::Options::=--force-confdef -o Dpkg::Options::=--force-confold -y install oracle-j2sdk1.7 
Reading package lists... 
Building dependency tree... 
Reading state information... 
oracle-j2sdk1.7 is already the newest version (1.7.0+update67-1). 
0 upgraded, 0 newly installed, 0 to remove and 52 not upgraded. 
END (0) 
remote package oracle-j2sdk1.7 installed 
Installing cloudera-manager-agent package...

BEGIN sudo dpkg -l cloudera-manager-agent | grep -E '^ii[[:space:]]*cloudera-manager-agent[[:space:]]*' 
ii cloudera-manager-agent 5.12.0-1.cm5120.p0.120~xenial-cm5 amd64 The Cloudera Manager Agent 
END (0) 
BEGIN echo oracle-j2sdk1.6 oracle-j2sdk1.7 cloudera-manager-agent cloudera-manager-daemons | grep cloudera-manager-agent 
END (0) 
BEGIN sudo apt-cache show cloudera-manager-agent 
oracle-j2sdk1.6 oracle-j2sdk1.7 cloudera-manager-agent cloudera-manager-daemons 
Package: cloudera-manager-agent 
Source: enterprise 
Version: 5.12.0-1.cm5120.p0.120~xenial-cm5 
Architecture: amd64 
Maintainer: Cloudera Inc. <https://issues.cloudera.org> 
Installed-Size: 44039 
Depends: libc6 (>= 2.17), libcomerr2 (>= 1.01), libgcc1 (>= 1:3.0), libgssapi-krb5-2 (>= 1.10+dfsg~), libkrb5-3 (>= 1.6.dfsg.2), libssl1.0.0 (>= 1.0.2~beta3), libstdc++6 (>= 5.2), zlib1g (>= 1:1.2.0), lsb-base, psmisc, bash, libsasl2-modules, libsasl2-modules-gssapi-mit, libxslt1.1, libsqlite3-0, openssl, libssl-dev, libfuse2, fuse-utils | fuse, rpcbind, cloudera-manager-daemons (= 5.12.0-1.cm5120.p0.120~xenial-cm5), perl, python-psycopg2, python-mysqldb, apache2, iproute2 
Homepage: http://www.cloudera.com 
Priority: extra 
Section: misc 
Filename: pool/contrib/e/enterprise/cloudera-manager-agent_5.12.0-1.cm5120.p0.120~xenial-cm5_amd64.deb 
Size: 11186376 
SHA256: 69618949fb10d631ac301f21f62ecab0a3631eec456b6de43ef9c6a17c107498 
SHA1: 6b137a4328780d56f964403ff8c56fe7577935a0 
MD5sum: f7c9fc2b393b6d61563ea34ca15b6e61 
Description: The Cloudera Manager Agent 
The Agent is deployed to machines running services managed by Cloudera Manager. 
Description-md5: 482a592ee859d31443f58aa3e48fe303 

END (0) 
Version: 5.12.0-1.cm5120.p0.120~xenial-cm5 
BEGIN sudo apt-get -o Dpkg::Options::=--force-confdef -o Dpkg::Options::=--force-confold -y install cloudera-manager-agent 
Reading package lists... 
Building dependency tree... 
Reading state information... 
cloudera-manager-agent is already the newest version (5.12.0-1.cm5120.p0.120~xenial-cm5). 
0 upgraded, 0 newly installed, 0 to remove and 52 not upgraded. 
END (0) 
remote package cloudera-manager-agent installed 
Installing cloudera-manager-daemons package...

BEGIN sudo dpkg -l cloudera-manager-daemons | grep -E '^ii[[:space:]]*cloudera-manager-daemons[[:space:]]*' 
ii cloudera-manager-daemons 5.12.0-1.cm5120.p0.120~xenial-cm5 all Provides daemons for monitoring Hadoop and related tools. 
END (0) 
BEGIN echo oracle-j2sdk1.6 oracle-j2sdk1.7 cloudera-manager-agent cloudera-manager-daemons | grep cloudera-manager-daemons 
END (0) 
BEGIN sudo apt-cache show cloudera-manager-daemons 
oracle-j2sdk1.6 oracle-j2sdk1.7 cloudera-manager-agent cloudera-manager-daemons 
Package: cloudera-manager-daemons 
Source: enterprise 
Version: 5.12.0-1.cm5120.p0.120~xenial-cm5 
Architecture: all 
Maintainer: Cloudera Inc. <https://issues.cloudera.org> 
Installed-Size: 869404 
Depends: perl 
Homepage: http://www.cloudera.com 
Priority: extra 
Section: misc 
Filename: pool/contrib/e/enterprise/cloudera-manager-daemons_5.12.0-1.cm5120.p0.120~xenial-cm5_all.deb 
Size: 737883268 
SHA256: cf168ac13387bef54c61034e7cfef49539b1616cfb876f91db5dfe458d237780 
SHA1: a18ed00de131d0c358411104fb3d886e0c211101 
MD5sum: 47813b5493281f58b36ca33868229394 
Description: Provides daemons for monitoring Hadoop and related tools. 
Provides daemons for monitoring Hadoop and related tools. 
Description-md5: 35bb5bc8fc2f296f791c3bda9e345340 

END (0) 
Version: 5.12.0-1.cm5120.p0.120~xenial-cm5 
BEGIN sudo apt-get -o Dpkg::Options::=--force-confdef -o Dpkg::Options::=--force-confold -y install cloudera-manager-daemons 
Reading package lists... 
Building dependency tree... 
Reading state information... 
cloudera-manager-daemons is already the newest version (5.12.0-1.cm5120.p0.120~xenial-cm5). 
0 upgraded, 0 newly installed, 0 to remove and 52 not upgraded. 
END (0) 
remote package cloudera-manager-daemons installed 
Installing Unlimited Strength Encryption policy files.

Installation not requested. Step will be skipped. 
Configuring Cloudera Manager Agent...

BEGIN grep server_host=172.16.16.53 /etc/cloudera-scm-agent/config.ini 
END (0) 
scm agent is already configured 
Starting Cloudera Manager Agent...

BEGIN /usr/sbin/service cloudera-scm-agent status 
server_host=172.16.16.53 
* cloudera-scm-agent.service - LSB: Cloudera SCM Agent 
Loaded: loaded (/etc/init.d/cloudera-scm-agent; bad; vendor preset: enabled) 
Active: active (exited) since ن 2017-08-14 15:46:17 EET; 2min 26s ago 
Docs: man:systemd-sysv-generator(8) 
Process: 6359 ExecStop=/etc/init.d/cloudera-scm-agent stop (code=exited, status=0/SUCCESS) 
Process: 6398 ExecStart=/etc/init.d/cloudera-scm-agent start (code=exited, status=0/SUCCESS) 

أغس 14 15:46:16 cluster systemd[1]: Stopped LSB: Cloudera SCM Agent. 
أغس 14 15:46:16 cluster systemd[1]: Starting LSB: Cloudera SCM Agent... 
أغس 14 15:46:16 cluster su[6418]: Successful su for root by root 
أغس 14 15:46:16 cluster su[6418]: + ??? root:root 
أغس 14 15:46:16 cluster su[6418]: pam_unix(su:session): session opened for user root by (uid=0) 
أغس 14 15:46:17 cluster cloudera-scm-agent[6398]: Starting cloudera-scm-agent: * cloudera-scm-agent started 
أغس 14 15:46:17 cluster systemd[1]: Started LSB: Cloudera SCM Agent. 
END (0) 
BEGIN sudo /usr/sbin/service cloudera-scm-agent restart 
END (0) 
agent logs: 
BEGIN sudo tail -n 50 /var/log/cloudera-scm-agent//cloudera-scm-agent.out | sed 's/^/>>/' 
>>[14/Aug/2017 13:34:54 +0000] 5592 MainThread agent WARNING Expected mode 0751 for /run/cloudera-scm-agent but was 0755 
>>[14/Aug/2017 13:34:54 +0000] 5592 MainThread agent INFO Re-using pre-existing directory: /run/cloudera-scm-agent 
>>[14/Aug/2017 13:45:16 +0000] 1114 MainThread agent INFO SCM Agent Version: 5.12.0 
>>[14/Aug/2017 13:45:16 +0000] 1114 MainThread agent WARNING Expected mode 0751 for /run/cloudera-scm-agent but was 0755 
>>[14/Aug/2017 13:45:16 +0000] 1114 MainThread agent INFO Re-using pre-existing directory: /run/cloudera-scm-agent 
>>[14/Aug/2017 13:50:56 +0000] 3170 MainThread agent INFO SCM Agent Version: 5.12.0 
>>[14/Aug/2017 13:50:56 +0000] 3170 MainThread agent WARNING Expected mode 0751 for /run/cloudera-scm-agent but was 0755 
>>[14/Aug/2017 13:50:56 +0000] 3170 MainThread agent INFO Re-using pre-existing directory: /run/cloudera-scm-agent 
>>[14/Aug/2017 13:55:10 +0000] 4821 MainThread agent INFO SCM Agent Version: 5.12.0 
>>[14/Aug/2017 13:55:10 +0000] 4821 MainThread agent WARNING Expected mode 0751 for /run/cloudera-scm-agent but was 0755 
>>[14/Aug/2017 13:55:10 +0000] 4821 MainThread agent INFO Re-using pre-existing directory: /run/cloudera-scm-agent 
>>[14/Aug/2017 14:02:12 +0000] 6180 MainThread agent INFO SCM Agent Version: 5.12.0 
>>[14/Aug/2017 14:02:12 +0000] 6180 MainThread agent WARNING Expected mode 0751 for /run/cloudera-scm-agent but was 0755 
>>[14/Aug/2017 14:02:12 +0000] 6180 MainThread agent INFO Re-using pre-existing directory: /run/cloudera-scm-agent 
>>[14/Aug/2017 14:06:24 +0000] 7684 MainThread agent INFO SCM Agent Version: 5.12.0 
>>[14/Aug/2017 14:06:24 +0000] 7684 MainThread agent WARNING Expected mode 0751 for /run/cloudera-scm-agent but was 0755 
>>[14/Aug/2017 14:06:24 +0000] 7684 MainThread agent INFO Re-using pre-existing directory: /run/cloudera-scm-agent 
>>[14/Aug/2017 14:09:42 +0000] 9172 MainThread agent INFO SCM Agent Version: 5.12.0 
>>[14/Aug/2017 14:09:42 +0000] 9172 MainThread agent WARNING Expected mode 0751 for /run/cloudera-scm-agent but was 0755 
>>[14/Aug/2017 14:09:42 +0000] 9172 MainThread agent INFO Re-using pre-existing directory: /run/cloudera-scm-agent 
>>[14/Aug/2017 14:12:44 +0000] 12168 MainThread agent INFO SCM Agent Version: 5.12.0 
>>[14/Aug/2017 14:12:44 +0000] 12168 MainThread agent WARNING Expected mode 0751 for /run/cloudera-scm-agent but was 0755 
>>[14/Aug/2017 14:12:44 +0000] 12168 MainThread agent INFO Re-using pre-existing directory: /run/cloudera-scm-agent 
>>[14/Aug/2017 15:05:53 +0000] 18342 MainThread agent INFO SCM Agent Version: 5.12.0 
>>[14/Aug/2017 15:05:53 +0000] 18342 MainThread agent WARNING Expected mode 0751 for /run/cloudera-scm-agent but was 0755 
>>[14/Aug/2017 15:05:53 +0000] 18342 MainThread agent INFO Re-using pre-existing directory: /run/cloudera-scm-agent 
>>[14/Aug/2017 15:17:39 +0000] 20414 MainThread agent INFO SCM Agent Version: 5.12.0 
>>[14/Aug/2017 15:17:39 +0000] 20414 MainThread agent WARNING Expected mode 0751 for /run/cloudera-scm-agent but was 0755 
>>[14/Aug/2017 15:17:39 +0000] 20414 MainThread agent INFO Re-using pre-existing directory: /run/cloudera-scm-agent 
>>[14/Aug/2017 15:22:02 +0000] 22047 MainThread agent INFO SCM Agent Version: 5.12.0 
>>[14/Aug/2017 15:22:02 +0000] 22047 MainThread agent WARNING Expected mode 0751 for /run/cloudera-scm-agent but was 0755 
>>[14/Aug/2017 15:22:02 +0000] 22047 MainThread agent INFO Re-using pre-existing directory: /run/cloudera-scm-agent 
>>[14/Aug/2017 15:24:37 +0000] 23553 MainThread agent INFO SCM Agent Version: 5.12.0 
>>[14/Aug/2017 15:24:37 +0000] 23553 MainThread agent WARNING Expected mode 0751 for /run/cloudera-scm-agent but was 0755 
>>[14/Aug/2017 15:24:37 +0000] 23553 MainThread agent INFO Re-using pre-existing directory: >>[14/Aug/2017 13:34:54 +0000] 5592 MainThread agent WARNING Expected mode 0751 for /run/cloudera-scm-agent but was 0755 
>>[14/Aug/2017 13:34:54 +0000] 5592 MainThread agent INFO Re-using pre-existing directory: /run/cloudera-scm-agent 
>>[14/Aug/2017 13:45:16 +0000] 1114 MainThread agent INFO SCM Agent Version: 5.12.0 
>>[14/Aug/2017 13:45:16 +0000] 1114 MainThread agent WARNING Expected mode 0751 for /run/cloudera-scm-agent but was 0755 
>>[14/Aug/2017 13:45:16 +0000] 1114 MainThread agent INFO Re-using pre-existing directory: /run/cloudera-scm-agent 
>>[14/Aug/2017 13:50:56 +0000] 3170 MainThread agent INFO SCM Agent Version: 5.12.0 
>>[14/Aug/2017 13:50:56 +0000] 3170 MainThread agent WARNING Expected mode 0751 for /run/cloudera-scm-agent but was 0755 
>>[14/Aug/2017 13:50:56 +0000] 3170 MainThread agent INFO Re-using pre-existing directory: /run/cloudera-scm-agent 
>>[14/Aug/2017 13:55:10 +0000] 4821 MainThread agent INFO SCM Agent Version: 5.12.0 
>>[14/Aug/2017 13:55:10 +0000] 4821 MainThread agent WARNING Expected mode 0751 for /run/cloudera-scm-agent but was 0755 
>>[14/Aug/2017 13:55:10 +0000] 4821 MainThread agent INFO Re-using pre-existing directory: /run/cloudera-scm-agent 
>>[14/Aug/2017 14:02:12 +0000] 6180 MainThread agent INFO SCM Agent Version: 5.12.0 
>>[14/Aug/2017 14:02:12 +0000] 6180 MainThread agent WARNING Expected mode 0751 for /run/cloudera-scm-agent but was 0755 
>>[14/Aug/2017 14:02:12 +0000] 6180 MainThread agent INFO Re-using pre-existing directory: /run/cloudera-scm-agent 
>>[14/Aug/2017 14:06:24 +0000] 7684 MainThread agent INFO SCM Agent Version: 5.12.0 
>>[14/Aug/2017 14:06:24 +0000] 7684 MainThread agent WARNING Expected mode 0751 for /run/cloudera-scm-agent but was 0755 
>>[14/Aug/2017 14:06:24 +0000] 7684 MainThread agent INFO Re-using pre-existing directory: /run/cloudera-scm-agent 
>>[14/Aug/2017 14:09:42 +0000] 9172 MainThread agent INFO SCM Agent Version: 5.12.0 
>>[14/Aug/2017 14:09:42 +0000] 9172 MainThread agent WARNING Expected mode 0751 for /run/cloudera-scm-agent but was 0755 
>>[14/Aug/2017 14:09:42 +0000] 9172 MainThread agent INFO Re-using pre-existing directory: /run/cloudera-scm-agent 
>>[14/Aug/2017 14:12:44 +0000] 12168 MainThread agent INFO SCM Agent Version: 5.12.0 
>>[14/Aug/2017 14:12:44 +0000] 12168 MainThread agent WARNING Expected mode 0751 for /run/cloudera-scm-agent but was 0755 
>>[14/Aug/2017 14:12:44 +0000] 12168 MainThread agent INFO Re-using pre-existing directory: /run/cloudera-scm-agent 
>>[14/Aug/2017 15:05:53 +0000] 18342 MainThread agent INFO SCM Agent Version: 5.12.0 
>>[14/Aug/2017 15:05:53 +0000] 18342 MainThread agent WARNING Expected mode 0751 for /run/cloudera-scm-agent but was 0755 
>>[14/Aug/2017 15:05:53 +0000] 18342 MainThread agent INFO Re-using pre-existing directory: /run/cloudera-scm-agent 
>>[14/Aug/2017 15:17:39 +0000] 20414 MainThread agent INFO SCM Agent Version: 5.12.0 
>>[14/Aug/2017 15:17:39 +0000] 20414 MainThread agent WARNING Expected mode 0751 for /run/cloudera-scm-agent but was 0755 
>>[14/Aug/2017 15:17:39 +0000] 20414 MainThread agent INFO Re-using pre-existing directory: /run/cloudera-scm-agent 
>>[14/Aug/2017 15:22:02 +0000] 22047 MainThread agent INFO SCM Agent Version: 5.12.0 
>>[14/Aug/2017 15:22:02 +0000] 22047 MainThread agent WARNING Expected mode 0751 for /run/cloudera-scm-agent but was 0755 
>>[14/Aug/2017 15:22:02 +0000] 22047 MainThread agent INFO Re-using pre-existing directory: /run/cloudera-scm-agent 
>>[14/Aug/2017 15:24:37 +0000] 23553 MainThread agent INFO SCM Agent Version: 5.12.0 
>>[14/Aug/2017 15:24:37 +0000] 23553 MainThread agent WARNING Expected mode 0751 for /run/cloudera-scm-agent but was 0755 
>>[14/Aug/2017 15:24:37 +0000] 23553 MainThread agent INFO Re-using pre-existing directory: /run/cloudera-scm-agent 
>>[14/Aug/2017 15:40:29 +0000] 1099 MainThread agent INFO SCM Agent Version: 5.12.0 
>>[14/Aug/2017 15:40:29 +0000] 1099 MainThread agent WARNING Expected mode 0751 for /run/cloudera-scm-agent but was 0755 
>>[14/Aug/2017 15:40:29 +0000] 1099 MainThread agent INFO Re-using pre-existing directory: /run/cloudera-scm-agent 
>>[14/Aug/2017 15:42:01 +0000] 3588 MainThread agent INFO SCM Agent Version: 5.12.0 
>>[14/Aug/2017 15:42:01 +0000] 3588 MainThread agent WARNING Expected mode 0751 for /run/cloudera-scm-agent but was 0755 
>>[14/Aug/2017 15:42:01 +0000] 3588 MainThread agent INFO Re-using pre-existing directory: /run/cloudera-scm-agent 
>>[14/Aug/2017 15:44:20 +0000] 4984 MainThread agent INFO SCM Agent Version: 5.12.0 
>>[14/Aug/2017 15:44:20 +0000] 4984 MainThread agent WARNING Expected mode 0751 for /run/cloudera-scm-agent but was 0755 
>>[14/Aug/2017 15:44:20 +0000] 4984 MainThread agent INFO Re-using pre-existing directory: /run/cloudera-scm-agent 
>>[14/Aug/2017 15:46:17 +0000] 6420 MainThread agent INFO SCM Agent Version: 5.12.0 
>>[14/Aug/2017 15:46:17 +0000] 6420 MainThread agent WARNING Expected mode 0751 for /run/cloudera-scm-agent but was 0755 
>>[14/Aug/2017 15:46:17 +0000] 6420 MainThread agent INFO Re-using pre-existing directory: /run/cloudera-scm-agent 
>>[14/Aug/2017 15:48:44 +0000] 7900 MainThread agent INFO SCM Agent Version: 5.12.0 
>>[14/Aug/2017 15:48:44 +0000] 7900 MainThread agent WARNING Expected mode 0751 for /run/cloudera-scm-agent but was 0755 
>>[14/Aug/2017 15:48:44 +0000] 7900 MainThread agent INFO Re-using pre-existing directory: /run/cloudera-scm-agent 
/run/cloudera-scm-agent 
>>[14/Aug/2017 15:40:29 +0000] 1099 MainThread agent INFO SCM Agent Version: 5.12.0 
>>[14/Aug/2017 15:40:29 +0000] 1099 MainThread agent WARNING Expected mode 0751 for /run/cloudera-scm-agent but was 0755 
>>[14/Aug/2017 15:40:29 +0000] 1099 MainThread agent INFO Re-using pre-existing directory: /run/cloudera-scm-agent 
>>[14/Aug/2017 15:42:01 +0000] 3588 MainThread agent INFO SCM Agent Version: 5.12.0 
>>[14/Aug/2017 15:42:01 +0000] 3588 MainThread agent WARNING Expected mode 0751 for /run/cloudera-scm-agent but was 0755 
>>[14/Aug/2017 15:42:01 +0000] 3588 MainThread agent INFO Re-using pre-existing directory: /run/cloudera-scm-agent 
>>[14/Aug/2017 15:44:20 +0000] 4984 MainThread agent INFO SCM Agent Version: 5.12.0 
>>[14/Aug/2017 15:44:20 +0000] 4984 MainThread agent WARNING Expected mode 0751 for /run/cloudera-scm-agent but was 0755 
>>[14/Aug/2017 15:44:20 +0000] 4984 MainThread agent INFO Re-using pre-existing directory: /run/cloudera-scm-agent 
>>[14/Aug/2017 15:46:17 +0000] 6420 MainThread agent INFO SCM Agent Version: 5.12.0 
>>[14/Aug/2017 15:46:17 +0000] 6420 MainThread agent WARNING Expected mode 0751 for /run/cloudera-scm-agent but was 0755 
>>[14/Aug/2017 15:46:17 +0000] 6420 MainThread agent INFO Re-using pre-existing directory: /run/cloudera-scm-agent 
>>[14/Aug/2017 15:48:44 +0000] 7900 MainThread agent INFO SCM Agent Version: 5.12.0 
>>[14/Aug/2017 15:48:44 +0000] 7900 MainThread agent WARNING Expected mode 0751 for /run/cloudera-scm-agent but was 0755 
>>[14/Aug/2017 15:48:44 +0000] 7900 MainThread agent INFO Re-using pre-existing directory: /run/cloudera-scm-agent 
END (0) 
BEGIN sudo tail -n 50 /var/log/cloudera-scm-agent//cloudera-scm-agent.log | sed 's/^/>>/' 
>>[14/Aug/2017 15:46:19 +0000] 6445 MainThread agent INFO Re-using pre-existing directory: /run/cloudera-scm-agent/supervisor/include 
>>[14/Aug/2017 15:46:19 +0000] 6445 MainThread agent INFO Supervisor version: 3.0, pid: 5057 
>>[14/Aug/2017 15:46:19 +0000] 6445 MainThread agent INFO Connecting to previous supervisor: agent-4984-1502718260. 
>>[14/Aug/2017 15:46:19 +0000] 6445 MainThread status_server INFO Using maximum impala profile bundle size of 1073741824 bytes. 
>>[14/Aug/2017 15:46:19 +0000] 6445 MainThread status_server INFO Using maximum stacks log bundle size of 1073741824 bytes. 
>>[14/Aug/2017 15:46:19 +0000] 6445 MainThread _cplogging INFO [14/Aug/2017:15:46:19] ENGINE Bus STARTING 
>>[14/Aug/2017 15:46:19 +0000] 6445 MainThread _cplogging INFO [14/Aug/2017:15:46:19] ENGINE Started monitor thread '_TimeoutMonitor'. 
>>[14/Aug/2017 15:46:19 +0000] 6445 MainThread _cplogging INFO [14/Aug/2017:15:46:19] ENGINE Serving on cluster:9000 
>>[14/Aug/2017 15:46:19 +0000] 6445 MainThread _cplogging INFO [14/Aug/2017:15:46:19] ENGINE Bus STARTED 
>>[14/Aug/2017 15:46:19 +0000] 6445 MainThread __init__ INFO New monitor: (<cmf.monitor.host.HostMonitor object at 0x7f4a76277f90>,) 
>>[14/Aug/2017 15:46:19 +0000] 6445 MainThread agent INFO Setting default socket timeout to 45 
>>[14/Aug/2017 15:46:19 +0000] 6445 MonitorDaemon-Scheduler __init__ INFO Monitor ready to report: ('HostMonitor',) 
>>[14/Aug/2017 15:46:19 +0000] 6445 MainThread heartbeat_tracker INFO HB stats (seconds): num:1 LIFE_MIN:0.03 min:0.03 mean:0.03 max:0.03 LIFE_MAX:0.03 
>>[14/Aug/2017 15:46:19 +0000] 6445 MainThread agent INFO CM server guid: 2fe42bb1-7624-4758-9ccc-2cf0f893be2d 
>>[14/Aug/2017 15:46:19 +0000] 6445 MainThread agent INFO Using parcels directory from server provided value: /opt/cloudera/parcels 
>>[14/Aug/2017 15:46:19 +0000] 6445 MainThread parcel INFO Agent does create users/groups and apply file permissions 
>>[14/Aug/2017 15:46:19 +0000] 6445 MainThread downloader INFO Downloader path: /opt/cloudera/parcel-cache 
>>[14/Aug/2017 15:46:19 +0000] 6445 MainThread parcel_cache INFO Using /opt/cloudera/parcel-cache for parcel cache 
>>[14/Aug/2017 15:46:20 +0000] 6445 MainThread agent INFO Flood daemon (re)start attempt 
>>[14/Aug/2017 15:46:20 +0000] 6445 MainThread agent INFO Triggering supervisord update. 
>>[14/Aug/2017 15:46:21 +0000] 6445 MainThread agent INFO Active parcel list updated; recalculating component info. 
>>[14/Aug/2017 15:46:22 +0000] 6445 MainThread throttling_logger INFO Identified java component java6 with full version JAVA_HOME=/usr/lib/jvm/j2sdk1.6-oracle java version "1.6.0_31" Java(TM) SE Runtime Environment (build 1.6.0_31-b04) Java HotSpot(TM) 64-Bit Server VM (build 20.6-b01, mixed mode) for requested version 6. 
>>[14/Aug/2017 15:46:22 +0000] 6445 MainThread throttling_logger INFO Identified java component java7 with full version JAVA_HOME=/usr/lib/jvm/java-7-oracle-cloudera java version "1.7.0_67" Java(TM) SE Runtime Environment (build 1.7.0_67-b01) Java HotSpot(TM) 64-Bit Server VM (build 24.65-b04, mixed mode) for requested version 7. 
>>[14/Aug/2017 15:48:43 +0000] 6445 MainThread agent INFO Stopping agent... 
>>[14/Aug/2017 15:48:43 +0000] 6445 MainThread agent INFO No extant cgroups; unmounting any cgroup roots 
>>[14/Aug/2017 15:48:43 +0000] 6445 MainThread agent INFO 2 processes are being managed; Supervisor will continue to run. 
>>[14/Aug/2017 15:48:43 +0000] 6445 MainThread _cplogging INFO [14/Aug/2017:15:48:43] ENGINE Bus STOPPING 
>>[14/Aug/2017 15:48:43 +0000] 6445 MainThread _cplogging INFO [14/Aug/2017:15:48:43] ENGINE HTTP Server cherrypy._cpwsgi_server.CPWSGIServer(('cluster', 9000)) shut down 
>>[14/Aug/2017 15:48:43 +0000] 6445 MainThread _cplogging INFO [14/Aug/2017:15:48:43] ENGINE Stopped thread '_TimeoutMonitor'. 
>>[14/Aug/2017 15:48:43 +0000] 6445 MainThread _cplogging INFO [1>>[14/Aug/2017 15:46:19 +0000] 6445 MainThread agent INFO Re-using pre-existing directory: /run/cloudera-scm-agent/supervisor/include 
>>[14/Aug/2017 15:46:19 +0000] 6445 MainThread agent INFO Supervisor version: 3.0, pid: 5057 
>>[14/Aug/2017 15:46:19 +0000] 6445 MainThread agent INFO Connecting to previous supervisor: agent-4984-1502718260. 
>>[14/Aug/2017 15:46:19 +0000] 6445 MainThread status_server INFO Using maximum impala profile bundle size of 1073741824 bytes. 
>>[14/Aug/2017 15:46:19 +0000] 6445 MainThread status_server INFO Using maximum stacks log bundle size of 1073741824 bytes. 
>>[14/Aug/2017 15:46:19 +0000] 6445 MainThread _cplogging INFO [14/Aug/2017:15:46:19] ENGINE Bus STARTING 
>>[14/Aug/2017 15:46:19 +0000] 6445 MainThread _cplogging INFO [14/Aug/2017:15:46:19] ENGINE Started monitor thread '_TimeoutMonitor'. 
>>[14/Aug/2017 15:46:19 +0000] 6445 MainThread _cplogging INFO [14/Aug/2017:15:46:19] ENGINE Serving on cluster:9000 
>>[14/Aug/2017 15:46:19 +0000] 6445 MainThread _cplogging INFO [14/Aug/2017:15:46:19] ENGINE Bus STARTED 
>>[14/Aug/2017 15:46:19 +0000] 6445 MainThread __init__ INFO New monitor: (<cmf.monitor.host.HostMonitor object at 0x7f4a76277f90>,) 
>>[14/Aug/2017 15:46:19 +0000] 6445 MainThread agent INFO Setting default socket timeout to 45 
>>[14/Aug/2017 15:46:19 +0000] 6445 MonitorDaemon-Scheduler __init__ INFO Monitor ready to report: ('HostMonitor',) 
>>[14/Aug/2017 15:46:19 +0000] 6445 MainThread heartbeat_tracker INFO HB stats (seconds): num:1 LIFE_MIN:0.03 min:0.03 mean:0.03 max:0.03 LIFE_MAX:0.03 
>>[14/Aug/2017 15:46:19 +0000] 6445 MainThread agent INFO CM server guid: 2fe42bb1-7624-4758-9ccc-2cf0f893be2d 
>>[14/Aug/2017 15:46:19 +0000] 6445 MainThread agent INFO Using parcels directory from server provided value: /opt/cloudera/parcels 
>>[14/Aug/2017 15:46:19 +0000] 6445 MainThread parcel INFO Agent does create users/groups and apply file permissions 
>>[14/Aug/2017 15:46:19 +0000] 6445 MainThread downloader INFO Downloader path: /opt/cloudera/parcel-cache 
>>[14/Aug/2017 15:46:19 +0000] 6445 MainThread parcel_cache INFO Using /opt/cloudera/parcel-cache for parcel cache 
>>[14/Aug/2017 15:46:20 +0000] 6445 MainThread agent INFO Flood daemon (re)start attempt 
>>[14/Aug/2017 15:46:20 +0000] 6445 MainThread agent INFO Triggering supervisord update. 
>>[14/Aug/2017 15:46:21 +0000] 6445 MainThread agent INFO Active parcel list updated; recalculating component info. 
>>[14/Aug/2017 15:46:22 +0000] 6445 MainThread throttling_logger INFO Identified java component java6 with full version JAVA_HOME=/usr/lib/jvm/j2sdk1.6-oracle java version "1.6.0_31" Java(TM) SE Runtime Environment (build 1.6.0_31-b04) Java HotSpot(TM) 64-Bit Server VM (build 20.6-b01, mixed mode) for requested version 6. 
>>[14/Aug/2017 15:46:22 +0000] 6445 MainThread throttling_logger INFO Identified java component java7 with full version JAVA_HOME=/usr/lib/jvm/java-7-oracle-cloudera java version "1.7.0_67" Java(TM) SE Runtime Environment (build 1.7.0_67-b01) Java HotSpot(TM) 64-Bit Server VM (build 24.65-b04, mixed mode) for requested version 7. 
>>[14/Aug/2017 15:48:43 +0000] 6445 MainThread agent INFO Stopping agent... 
>>[14/Aug/2017 15:48:43 +0000] 6445 MainThread agent INFO No extant cgroups; unmounting any cgroup roots 
>>[14/Aug/2017 15:48:43 +0000] 6445 MainThread agent INFO 2 processes are being managed; Supervisor will continue to run. 
>>[14/Aug/2017 15:48:43 +0000] 6445 MainThread _cplogging INFO [14/Aug/2017:15:48:43] ENGINE Bus STOPPING 
>>[14/Aug/2017 15:48:43 +0000] 6445 MainThread _cplogging INFO [14/Aug/2017:15:48:43] ENGINE HTTP Server cherrypy._cpwsgi_server.CPWSGIServer(('cluster', 9000)) shut down 
>>[14/Aug/2017 15:48:43 +0000] 6445 MainThread _cplogging INFO [14/Aug/2017:15:48:43] ENGINE Stopped thread '_TimeoutMonitor'. 
>>[14/Aug/2017 15:48:43 +0000] 6445 MainThread _cplogging INFO [14/Aug/2017:15:48:43] ENGINE Bus STOPPED 
>>[14/Aug/2017 15:48:43 +0000] 6445 MainThread _cplogging INFO [14/Aug/2017:15:48:43] ENGINE Bus STOPPING 
>>[14/Aug/2017 15:48:43 +0000] 6445 MainThread _cplogging INFO [14/Aug/2017:15:48:43] ENGINE HTTP Server cherrypy._cpwsgi_server.CPWSGIServer(('cluster', 9000)) already shut down 
>>[14/Aug/2017 15:48:43 +0000] 6445 MainThread _cplogging INFO [14/Aug/2017:15:48:43] ENGINE No thread running for None. 
>>[14/Aug/2017 15:48:43 +0000] 6445 MainThread _cplogging INFO [14/Aug/2017:15:48:43] ENGINE Bus STOPPED 
>>[14/Aug/2017 15:48:43 +0000] 6445 MainThread _cplogging INFO [14/Aug/2017:15:48:43] ENGINE Bus EXITING 
>>[14/Aug/2017 15:48:43 +0000] 6445 MainThread _cplogging INFO [14/Aug/2017:15:48:43] ENGINE Bus EXITED 
>>[14/Aug/2017 15:48:43 +0000] 6445 MainThread agent INFO Agent exiting; caught signal 15 
>>[14/Aug/2017 15:48:43 +0000] 6445 Dummy-14 daemonize WARNING Stopping daemon. 
>>[14/Aug/2017 15:48:44 +0000] 7925 MainThread agent INFO SCM Agent Version: 5.12.0 
>>[14/Aug/2017 15:48:44 +0000] 7925 MainThread agent INFO Agent Protocol Version: 4 
>>[14/Aug/2017 15:48:44 +0000] 7925 MainThread agent INFO Using Host ID: 734c85d4-3ee4-4b18-91fa-167cdb9cb07d 
>>[14/Aug/2017 15:48:44 +0000] 7925 MainThread agent INFO Using directory: /run/cloudera-scm-agent 
>>[14/Aug/2017 15:48:44 +0000] 7925 MainThread agent INFO Using supervisor binary path: /usr/lib/cmf/agent/build/env/bin/supervisord 
>>[14/Aug/2017 15:48:44 +0000] 7925 MainThread agent INFO Neither verify_cert_file nor verify_cert_dir are configured. Not performing validation of server certificates in HTTPS communication. These options can be configured in this agent's config.ini file to enable certificate validation. 
>>[14/Aug/2017 15:48:44 +0000] 7925 MainThread agent INFO Agent Logging Level: INFO 
>>[14/Aug/2017 15:48:44 +0000] 7925 MainThread agent INFO No command line vars 
>>[14/Aug/2017 15:48:44 +0000] 7925 MainThread agent INFO Missing database jar: /usr/share/java/mysql-connector-java.jar (normal, if you're not using this database type) 
>>[14/Aug/2017 15:48:44 +0000] 7925 MainThread agent INFO Missing database jar: /usr/share/java/oracle-connector-java.jar (normal, if you're not using this database type) 
>>[14/Aug/2017 15:48:44 +0000] 7925 MainThread agent INFO Found database jar: /usr/share/cmf/lib/postgresql-9.0-801.jdbc4.jar 
>>[14/Aug/2017 15:48:44 +0000] 7925 MainThread agent INFO Agent starting as pid 7925 user root(0) group root(0). 
4/Aug/2017:15:48:43] ENGINE Bus STOPPED 
>>[14/Aug/2017 15:48:43 +0000] 6445 MainThread _cplogging INFO [14/Aug/2017:15:48:43] ENGINE Bus STOPPING 
>>[14/Aug/2017 15:48:43 +0000] 6445 MainThread _cplogging INFO [14/Aug/2017:15:48:43] ENGINE HTTP Server cherrypy._cpwsgi_server.CPWSGIServer(('cluster', 9000)) already shut down 
>>[14/Aug/2017 15:48:43 +0000] 6445 MainThread _cplogging INFO [14/Aug/2017:15:48:43] ENGINE No thread running for None. 
>>[14/Aug/2017 15:48:43 +0000] 6445 MainThread _cplogging INFO [14/Aug/2017:15:48:43] ENGINE Bus STOPPED 
>>[14/Aug/2017 15:48:43 +0000] 6445 MainThread _cplogging INFO [14/Aug/2017:15:48:43] ENGINE Bus EXITING 
>>[14/Aug/2017 15:48:43 +0000] 6445 MainThread _cplogging INFO [14/Aug/2017:15:48:43] ENGINE Bus EXITED 
>>[14/Aug/2017 15:48:43 +0000] 6445 MainThread agent INFO Agent exiting; caught signal 15 
>>[14/Aug/2017 15:48:43 +0000] 6445 Dummy-14 daemonize WARNING Stopping daemon. 
>>[14/Aug/2017 15:48:44 +0000] 7925 MainThread agent INFO SCM Agent Version: 5.12.0 
>>[14/Aug/2017 15:48:44 +0000] 7925 MainThread agent INFO Agent Protocol Version: 4 
>>[14/Aug/2017 15:48:44 +0000] 7925 MainThread agent INFO Using Host ID: 734c85d4-3ee4-4b18-91fa-167cdb9cb07d 
>>[14/Aug/2017 15:48:44 +0000] 7925 MainThread agent INFO Using directory: /run/cloudera-scm-agent 
>>[14/Aug/2017 15:48:44 +0000] 7925 MainThread agent INFO Using supervisor binary path: /usr/lib/cmf/agent/build/env/bin/supervisord 
>>[14/Aug/2017 15:48:44 +0000] 7925 MainThread agent INFO Neither verify_cert_file nor verify_cert_dir are configured. Not performing validation of server certificates in HTTPS communication. These options can be configured in this agent's config.ini file to enable certificate validation. 
>>[14/Aug/2017 15:48:44 +0000] 7925 MainThread agent INFO Agent Logging Level: INFO 
>>[14/Aug/2017 15:48:44 +0000] 7925 MainThread agent INFO No command line vars 
>>[14/Aug/2017 15:48:44 +0000] 7925 MainThread agent INFO Missing database jar: /usr/share/java/mysql-connector-java.jar (normal, if you're not using this database type) 
>>[14/Aug/2017 15:48:44 +0000] 7925 MainThread agent INFO Missing database jar: /usr/share/java/oracle-connector-java.jar (normal, if you're not using this database type) 
>>[14/Aug/2017 15:48:44 +0000] 7925 MainThread agent INFO Found database jar: /usr/share/cmf/lib/postgresql-9.0-801.jdbc4.jar 
>>[14/Aug/2017 15:48:44 +0000] 7925 MainThread agent INFO Agent starting as pid 7925 user root(0) group root(0). 
END (0) 
end of agent logs. 
scm agent restarted 
Installation script completed successfully.

all done 
closing logging file descriptor 
Last Refreshed: Aug 14, 2017 4:50:55 PM EEST Turn Off Auto Refresh Close
Back

 

New Contributor
Posts: 5
Registered: ‎08-13-2017

Re: Installation failed. Failed to receive heartbeat from agent.

this solved my issue and I continued the installation steps, but I was stuck in another step.
However, I decided to setup a new cluster host from the beginning since I am aware of the process now, 

In the cluster installation step I got the same error message, with the same error logs, when I unmounted the mentioned directory in the solution, this time the problem wasn't solve, I still get the same error message but with different logs:

 Installation failed. Failed to receive heartbeat from agent.

/tmp/scm_prepare_node.kgwRfvqu 
using SSH_CLIENT to get the SCM hostname: 172.16.16.53 55164 22 
opening logging file descriptor 
Starting installation script...

Acquiring installation lock...

BEGIN flock 4 
END (0) 
Detecting root privileges...

effective UID is 1000 
BEGIN which pbrun 
END (1) 
BEGIN sudo -S id 
uid=0(root) gid=0(root) groups=0(root) 
END (0) 
Using 'sudo ' to acquire root privileges 
Detecting distribution...

BEGIN grep 'Ubuntu' /etc/lsb-release 
END (0) 
DISTRIB_ID=Ubuntu 
DISTRIB_DESCRIPTION="Ubuntu 16.04.3 LTS" 
BEGIN grep DISTRIB_CODENAME /etc/lsb-release 
END (0) 
DISTRIB_CODENAME=xenial 
BEGIN echo DISTRIB_CODENAME=xenial | cut -d = -f 2 
END (0) 
xenial 
Detecting Cloudera Manager Server...

BEGIN host -t PTR 172.16.16.53 
Host 53.16.16.172.in-addr.arpa. not found: 3(NXDOMAIN) 
END (1) 
BEGIN which python 
END (0) 
BEGIN python -c 'import socket; import sys; s = socket.socket(socket.AF_INET); s.settimeout(5.0); s.connect((sys.argv[1], int(sys.argv[2]))); s.close();' 172.16.16.53 7182 
/usr/bin/python 
END (0) 
BEGIN which wget 
END (0) 
/usr/bin/wget 
BEGIN wget -qO- -T 1 -t 1 http://169.254.169.254/latest/meta-data/public-hostname && /bin/echo 
END (4) 
Installing package repositories...

validating format of repository file /tmp/scm_prepare_node.kgwRfvqu/repos/ubuntu_xenial/cloudera-manager.list 
installing repository file /tmp/scm_prepare_node.kgwRfvqu/repos/ubuntu_xenial/cloudera-manager.list 
repository file /tmp/scm_prepare_node.kgwRfvqu/repos/ubuntu_xenial/cloudera-manager.list installed 
BEGIN sudo apt-key add /tmp/scm_prepare_node.kgwRfvqu/archive.key 
OK 
END (0) 
installing priority file /tmp/scm_prepare_node.kgwRfvqu/priorities/ubuntu_xenial/cloudera.pref 
priority file /tmp/scm_prepare_node.kgwRfvqu/priorities/ubuntu_xenial/cloudera.pref installed 
Refreshing package metadata...

BEGIN sudo apt-get update 
Get:1 http://security.ubuntu.com/ubuntu xenial-security InRelease [102 kB] 
Hit:2 https://archive.cloudera.com/cm5/ubuntu/xenial/amd64/cm xenial-cm5.12.0 InRelease 
Hit:3 http://eg.archive.ubuntu.com/ubuntu xenial InRelease 
Get:4 http://eg.archive.ubuntu.com/ubuntu xenial-updates InRelease [102 kB] 
Get:5 http://eg.archive.ubuntu.com/ubuntu xenial-backports InRelease [102 kB] 
Fetched 306 kB in 5s (58.9 kB/s) 
Reading package lists... 
W: https://archive.cloudera.com/cm5/ubuntu/xenial/amd64/cm/dists/xenial-cm5.12.0/InRelease: Signature by key F36A89E33CC1BD0F71079007327574EE02A818DD uses weak digest algorithm (SHA1) 
END (0) 
BEGIN sudo apt-get update 
Get:1 http://security.ubuntu.com/ubuntu xenial-security InRelease [102 kB] 
Hit:2 http://eg.archive.ubuntu.com/ubuntu xenial InRelease 
Get:3 http://eg.archive.ubuntu.com/ubuntu xenial-updates InRelease [102 kB] 
Hit:4 https://archive.cloudera.com/cm5/ubuntu/xenial/amd64/cm xenial-cm5.12.0 InRelease 
Get:5 http://eg.archive.ubuntu.com/ubuntu xenial-backports InRelease [102 kB] 
Fetched 306 kB in 1s (174 kB/s) 
Reading package lists... 
W: https://archive.cloudera.com/cm5/ubuntu/xenial/amd64/cm/dists/xenial-cm5.12.0/InRelease: Signature by key F36A89E33CC1BD0F71079007327574EE02A818DD uses weak digest algorithm (SHA1) 
END (0) 
Installing oracle-j2sdk1.6 package...

BEGIN sudo dpkg -l oracle-j2sdk1.6 | grep -E '^ii[[:space:]]*oracle-j2sdk1.6[[:space:]]*' 
ii oracle-j2sdk1.6 1.6.0+update31 amd64 Java(TM) JDK, Standard Edition, Oracle(TM) 
END (0) 
BEGIN echo oracle-j2sdk1.6 oracle-j2sdk1.7 cloudera-manager-agent cloudera-manager-daemons | grep oracle-j2sdk1.6 
END (0) 
oracle-j2sdk1.6 oracle-j2sdk1.7 cloudera-manager-agent cloudera-manager-daemons 
BEGIN sudo apt-cache show oracle-j2sdk1.6 
Package: oracle-j2sdk1.6 
Version: 1.6.0+update31 
Architecture: amd64 
Maintainer: Debian Java Maintainers <pkg-java-maintainers@lists.alioth.debian.org> 
Installed-Size: 224994 
Depends: libasound2 (>= 1.0.16), libc6 (>= 2.2.5), libx11-6, libxext6, libxi6, libxt6, libxtst6 
Recommends: netbase, libgtk1.2, libstdc++5 
Replaces: oracle-j2sdk1.6debian 
Provides: j2re1.6, j2sdk1.6, java-browser-plugin, java-compiler, java-runtime, java-runtime-headless, java-sdk, java-virtual-machine, java2-compiler, java2-runtime, java2-runtime-headless, java2-sdk 
Priority: optional 
Section: non-free/devel 
Filename: pool/contrib/o/oracle-j2sdk1.6/oracle-j2sdk1.6_1.6.0+update31_amd64.deb 
Size: 96896162 
SHA256: e3af578020ca3d595fbf1da7f006dde783fa10ace7e147ea135e5d09a8ad32b9 
SHA1: 4b4cd040b2b71f1b754180d89c8e69f5940d27a5 
MD5sum: 183149f3ddc42fcc03e137bea41cf85e 
Description: Java(TM) JDK, Standard Edition, Oracle(TM) 
The Java(TM) 2 SDK is a development environment for building 
applications, applets, and components that can be deployed on the 
Java(TM) platform. 
. 
The Java(TM) 2 SDK software includes tools useful for developing and 
testing programs written in the Java programming language and running 
on the Java platform. These tools are designed to be used from the 
command line. Except for appletviewer, these tools do not provide a 
graphical user interface. 
. 
This package has been automatically created with java-package (0.50). 
Description-md5: 62076f1aba3f5baa8ad532d753bd2313 

END (0) 
BEGIN sudo apt-get -o Dpkg::Options::=--force-confdef -o Dpkg::Options::=--force-confold -y install oracle-j2sdk1.6 
Reading package lists... 
Building dependency tree... 
Reading state information... 
oracle-j2sdk1.6 is already the newest version (1.6.0+update31). 
0 upgraded, 0 newly installed, 0 to remove and 52 not upgraded. 
END (0) 
remote package oracle-j2sdk1.6 installed 
Installing oracle-j2sdk1.7 package...

BEGIN sudo dpkg -l oracle-j2sdk1.7 | grep -E '^ii[[:space:]]*oracle-j2sdk1.7[[:space:]]*' 
ii oracle-j2sdk1.7 1.7.0+update67-1 amd64 no description given 
END (0) 
BEGIN echo oracle-j2sdk1.6 oracle-j2sdk1.7 cloudera-manager-agent cloudera-manager-daemons | grep oracle-j2sdk1.7 
END (0) 
oracle-j2sdk1.6 oracle-j2sdk1.7 cloudera-manager-agent cloudera-manager-daemons 
BEGIN sudo apt-cache show oracle-j2sdk1.7 
Package: oracle-j2sdk1.7 
Version: 1.7.0+update67-1 
License: unknown 
Vendor: root@rpmslave.ent.cloudera.com 
Architecture: amd64 
Maintainer: <scm-users@cloudera.org> 
Installed-Size: 285587 
Provides: java 
Homepage: http://example.com/no-uri-given 
Priority: extra 
Section: default 
Filename: pool/contrib/o/oracle-j2sdk1.7/oracle-j2sdk1.7_1.7.0+update67-1_amd64.deb 
Size: 142448292 
SHA256: b998f4aa8ff8e58ee1d7d55e409330034c8963dbdab07f164fe7baf2025f863e 
SHA1: 2f03993be2d96a6b2abf2259e77bd21ef1a2bbe4 
MD5sum: f7e1bc66703c986be480001ddd087135 
Description: no description given 
Description-md5: c0af8b65ef8df63b3bfb124d96da1778 

END (0) 
BEGIN sudo apt-get -o Dpkg::Options::=--force-confdef -o Dpkg::Options::=--force-confold -y install oracle-j2sdk1.7 
Reading package lists... 
Building dependency tree... 
Reading state information... 
oracle-j2sdk1.7 is already the newest version (1.7.0+update67-1). 
0 upgraded, 0 newly installed, 0 to remove and 52 not upgraded. 
END (0) 
remote package oracle-j2sdk1.7 installed 
Installing cloudera-manager-agent package...

BEGIN sudo dpkg -l cloudera-manager-agent | grep -E '^ii[[:space:]]*cloudera-manager-agent[[:space:]]*' 
ii cloudera-manager-agent 5.12.0-1.cm5120.p0.120~xenial-cm5 amd64 The Cloudera Manager Agent 
END (0) 
BEGIN echo oracle-j2sdk1.6 oracle-j2sdk1.7 cloudera-manager-agent cloudera-manager-daemons | grep cloudera-manager-agent 
END (0) 
oracle-j2sdk1.6 oracle-j2sdk1.7 cloudera-manager-agent cloudera-manager-daemons 
BEGIN sudo apt-cache show cloudera-manager-agent 
Package: cloudera-manager-agent 
Source: enterprise 
Version: 5.12.0-1.cm5120.p0.120~xenial-cm5 
Architecture: amd64 
Maintainer: Cloudera Inc. <https://issues.cloudera.org> 
Installed-Size: 44039 
Depends: libc6 (>= 2.17), libcomerr2 (>= 1.01), libgcc1 (>= 1:3.0), libgssapi-krb5-2 (>= 1.10+dfsg~), libkrb5-3 (>= 1.6.dfsg.2), libssl1.0.0 (>= 1.0.2~beta3), libstdc++6 (>= 5.2), zlib1g (>= 1:1.2.0), lsb-base, psmisc, bash, libsasl2-modules, libsasl2-modules-gssapi-mit, libxslt1.1, libsqlite3-0, openssl, libssl-dev, libfuse2, fuse-utils | fuse, rpcbind, cloudera-manager-daemons (= 5.12.0-1.cm5120.p0.120~xenial-cm5), perl, python-psycopg2, python-mysqldb, apache2, iproute2 
Homepage: http://www.cloudera.com 
Priority: extra 
Section: misc 
Filename: pool/contrib/e/enterprise/cloudera-manager-agent_5.12.0-1.cm5120.p0.120~xenial-cm5_amd64.deb 
Size: 11186376 
SHA256: 69618949fb10d631ac301f21f62ecab0a3631eec456b6de43ef9c6a17c107498 
SHA1: 6b137a4328780d56f964403ff8c56fe7577935a0 
MD5sum: f7c9fc2b393b6d61563ea34ca15b6e61 
Description: The Cloudera Manager Agent 
The Agent is deployed to machines running services managed by Cloudera Manager. 
Description-md5: 482a592ee859d31443f58aa3e48fe303 

END (0) 
Version: 5.12.0-1.cm5120.p0.120~xenial-cm5 
BEGIN sudo apt-get -o Dpkg::Options::=--force-confdef -o Dpkg::Options::=--force-confold -y install cloudera-manager-agent 
Reading package lists... 
Building dependency tree... 
Reading state information... 
cloudera-manager-agent is already the newest version (5.12.0-1.cm5120.p0.120~xenial-cm5). 
0 upgraded, 0 newly installed, 0 to remove and 52 not upgraded. 
END (0) 
remote package cloudera-manager-agent installed 
Installing cloudera-manager-daemons package...

BEGIN sudo dpkg -l cloudera-manager-daemons | grep -E '^ii[[:space:]]*cloudera-manager-daemons[[:space:]]*' 
ii cloudera-manager-daemons 5.12.0-1.cm5120.p0.120~xenial-cm5 all Provides daemons for monitoring Hadoop and related tools. 
END (0) 
BEGIN echo oracle-j2sdk1.6 oracle-j2sdk1.7 cloudera-manager-agent cloudera-manager-daemons | grep cloudera-manager-daemons 
END (0) 
BEGIN sudo apt-cache show cloudera-manager-daemons 
oracle-j2sdk1.6 oracle-j2sdk1.7 cloudera-manager-agent cloudera-manager-daemons 
Package: cloudera-manager-daemons 
Source: enterprise 
Version: 5.12.0-1.cm5120.p0.120~xenial-cm5 
Architecture: all 
Maintainer: Cloudera Inc. <https://issues.cloudera.org> 
Installed-Size: 869404 
Depends: perl 
Homepage: http://www.cloudera.com 
Priority: extra 
Section: misc 
Filename: pool/contrib/e/enterprise/cloudera-manager-daemons_5.12.0-1.cm5120.p0.120~xenial-cm5_all.deb 
Size: 737883268 
SHA256: cf168ac13387bef54c61034e7cfef49539b1616cfb876f91db5dfe458d237780 
SHA1: a18ed00de131d0c358411104fb3d886e0c211101 
MD5sum: 47813b5493281f58b36ca33868229394 
Description: Provides daemons for monitoring Hadoop and related tools. 
Provides daemons for monitoring Hadoop and related tools. 
Description-md5: 35bb5bc8fc2f296f791c3bda9e345340 

END (0) 
Version: 5.12.0-1.cm5120.p0.120~xenial-cm5 
BEGIN sudo apt-get -o Dpkg::Options::=--force-confdef -o Dpkg::Options::=--force-confold -y install cloudera-manager-daemons 
Reading package lists... 
Building dependency tree... 
Reading state information... 
cloudera-manager-daemons is already the newest version (5.12.0-1.cm5120.p0.120~xenial-cm5). 
0 upgraded, 0 newly installed, 0 to remove and 52 not upgraded. 
END (0) 
remote package cloudera-manager-daemons installed 
Installing Unlimited Strength Encryption policy files.

Installation not requested. Step will be skipped. 
Configuring Cloudera Manager Agent...

BEGIN grep server_host=172.16.16.53 /etc/cloudera-scm-agent/config.ini 
END (0) 
scm agent is already configured 
Starting Cloudera Manager Agent...

BEGIN /usr/sbin/service cloudera-scm-agent status 
server_host=172.16.16.53 
* cloudera-scm-agent.service - LSB: Cloudera SCM Agent 
Loaded: loaded (/etc/init.d/cloudera-scm-agent; bad; vendor preset: enabled) 
Active: active (exited) since ن 2017-08-14 16:20:28 EET; 4min 7s ago 
Docs: man:systemd-sysv-generator(8) 
Process: 7454 ExecStop=/etc/init.d/cloudera-scm-agent stop (code=exited, status=0/SUCCESS) 
Process: 7493 ExecStart=/etc/init.d/cloudera-scm-agent start (code=exited, status=0/SUCCESS) 

أغس 14 16:20:28 cluster systemd[1]: Stopped LSB: Cloudera SCM Agent. 
أغس 14 16:20:28 cluster systemd[1]: Starting LSB: Cloudera SCM Agent... 
أغس 14 16:20:28 cluster su[7513]: Successful su for root by root 
أغس 14 16:20:28 cluster su[7513]: + ??? root:root 
أغس 14 16:20:28 cluster su[7513]: pam_unix(su:session): session opened for user root by (uid=0) 
أغس 14 16:20:28 cluster cloudera-scm-agent[7493]: Starting cloudera-scm-agent: * cloudera-scm-agent started 
أغس 14 16:20:28 cluster systemd[1]: Started LSB: Cloudera SCM Agent. 
END (0) 
BEGIN sudo /usr/sbin/service cloudera-scm-agent restart 
END (0) 
agent logs: 
BEGIN sudo tail -n 50 /var/log/cloudera-scm-agent//cloudera-scm-agent.out | sed 's/^/>>/' 
>>[14/Aug/2017 15:24:37 +0000] 23553 MainThread agent WARNING Expected mode 0751 for /run/cloudera-scm-agent but was 0755 
>>[14/Aug/2017 15:24:37 +0000] 23553 MainThread agent INFO Re-using pre-existing directory: /run/cloudera-scm-agent 
>>[14/Aug/2017 15:40:29 +0000] 1099 MainThread agent INFO SCM Agent Version: 5.12.0 
>>[14/Aug/2017 15:40:29 +0000] 1099 MainThread agent WARNING Expected mode 0751 for /run/cloudera-scm-agent but was 0755 
>>[14/Aug/2017 15:40:29 +0000] 1099 MainThread agent INFO Re-using pre-existing directory: /run/cloudera-scm-agent 
>>[14/Aug/2017 15:42:01 +0000] 3588 MainThread agent INFO SCM Agent Version: 5.12.0 
>>[14/Aug/2017 15:42:01 +0000] 3588 MainThread agent WARNING Expected mode 0751 for /run/cloudera-scm-agent but was 0755 
>>[14/Aug/2017 15:42:01 +0000] 3588 MainThread agent INFO Re-using pre-existing directory: /run/cloudera-scm-agent 
>>[14/Aug/2017 15:44:20 +0000] 4984 MainThread agent INFO SCM Agent Version: 5.12.0 
>>[14/Aug/2017 15:44:20 +0000] 4984 MainThread agent WARNING Expected mode 0751 for /run/cloudera-scm-agent but was 0755 
>>[14/Aug/2017 15:44:20 +0000] 4984 MainThread agent INFO Re-using pre-existing directory: /run/cloudera-scm-agent 
>>[14/Aug/2017 15:46:17 +0000] 6420 MainThread agent INFO SCM Agent Version: 5.12.0 
>>[14/Aug/2017 15:46:17 +0000] 6420 MainThread agent WARNING Expected mode 0751 for /run/cloudera-scm-agent but was 0755 
>>[14/Aug/2017 15:46:17 +0000] 6420 MainThread agent INFO Re-using pre-existing directory: /run/cloudera-scm-agent 
>>[14/Aug/2017 15:48:44 +0000] 7900 MainThread agent INFO SCM Agent Version: 5.12.0 
>>[14/Aug/2017 15:48:44 +0000] 7900 MainThread agent WARNING Expected mode 0751 for /run/cloudera-scm-agent but was 0755 
>>[14/Aug/2017 15:48:44 +0000] 7900 MainThread agent INFO Re-using pre-existing directory: /run/cloudera-scm-agent 
>>[14/Aug/2017 15:55:20 +0000] 10087 MainThread agent INFO SCM Agent Version: 5.12.0 
>>[14/Aug/2017 15:55:20 +0000] 10087 MainThread agent WARNING Expected mode 0751 for /run/cloudera-scm-agent but was 0755 
>>[14/Aug/2017 15:55:20 +0000] 10087 MainThread agent INFO Re-using pre-existing directory: /run/cloudera-scm-agent 
>>[14/Aug/2017 15:57:33 +0000] 11562 MainThread agent INFO SCM Agent Version: 5.12.0 
>>[14/Aug/2017 15:57:33 +0000] 11562 MainThread agent WARNING Expected mode 0751 for /run/cloudera-scm-agent but was 0755 
>>[14/Aug/2017 15:57:33 +0000] 11562 MainThread agent INFO Re-using pre-existing directory: /run/cloudera-scm-agent 
>>[14/Aug/2017 16:02:10 +0000] 13258 MainThread agent INFO SCM Agent Version: 5.12.0 
>>[14/Aug/2017 16:02:10 +0000] 13258 MainThread agent WARNING Expected mode 0751 for /run/cloudera-scm-agent but was 0755 
>>[14/Aug/2017 16:02:10 +0000] 13258 MainThread agent INFO Re-using pre-existing directory: /run/cloudera-scm-agent 
>>[14/Aug/2017 16:05:42 +0000] 14770 MainThread agent INFO SCM Agent Version: 5.12.0 
>>[14/Aug/2017 16:05:42 +0000] 14770 MainThread agent WARNING Expected mode 0751 for /run/cloudera-scm-agent but was 0755 
>>[14/Aug/2017 16:05:42 +0000] 14770 MainThread agent INFO Re-using pre-existing directory: /run/cloudera-scm-agent 
>>[14/Aug/2017 16:10:55 +0000] 16442 MainThread agent INFO SCM Agent Version: 5.12.0 
>>[14/Aug/2017 16:10:55 +0000] 16442 MainThread agent WARNING Expected mode 0751 for /run/cloudera-scm-agent but was 0755 
>>[14/Aug/2017 16:10:55 +0000] 16442 MainThread agent INFO Re-using pre-existing directory: /run/cloudera-scm-agent 
>>[14/Aug/2017 16:13:49 +0000] 1145 MainThread agent INFO SCM Agent Version: 5.12.0 
>>[14/Aug/2017 16:13:49 +0000] 1145 MainThread agent WARNING Expected mode 0751 for /run/cloudera-scm-agent but was 0755 
>>[14/Aug/2017 16:13:49 +0000] 1145 MainThread agent INFO Re-using pre-existing directory>>[14/Aug/2017 15:24:37 +0000] 23553 MainThread agent WARNING Expected mode 0751 for /run/cloudera-scm-agent but was 0755 
>>[14/Aug/2017 15:24:37 +0000] 23553 MainThread agent INFO Re-using pre-existing directory: /run/cloudera-scm-agent 
>>[14/Aug/2017 15:40:29 +0000] 1099 MainThread agent INFO SCM Agent Version: 5.12.0 
>>[14/Aug/2017 15:40:29 +0000] 1099 MainThread agent WARNING Expected mode 0751 for /run/cloudera-scm-agent but was 0755 
>>[14/Aug/2017 15:40:29 +0000] 1099 MainThread agent INFO Re-using pre-existing directory: /run/cloudera-scm-agent 
>>[14/Aug/2017 15:42:01 +0000] 3588 MainThread agent INFO SCM Agent Version: 5.12.0 
>>[14/Aug/2017 15:42:01 +0000] 3588 MainThread agent WARNING Expected mode 0751 for /run/cloudera-scm-agent but was 0755 
>>[14/Aug/2017 15:42:01 +0000] 3588 MainThread agent INFO Re-using pre-existing directory: /run/cloudera-scm-agent 
>>[14/Aug/2017 15:44:20 +0000] 4984 MainThread agent INFO SCM Agent Version: 5.12.0 
>>[14/Aug/2017 15:44:20 +0000] 4984 MainThread agent WARNING Expected mode 0751 for /run/cloudera-scm-agent but was 0755 
>>[14/Aug/2017 15:44:20 +0000] 4984 MainThread agent INFO Re-using pre-existing directory: /run/cloudera-scm-agent 
>>[14/Aug/2017 15:46:17 +0000] 6420 MainThread agent INFO SCM Agent Version: 5.12.0 
>>[14/Aug/2017 15:46:17 +0000] 6420 MainThread agent WARNING Expected mode 0751 for /run/cloudera-scm-agent but was 0755 
>>[14/Aug/2017 15:46:17 +0000] 6420 MainThread agent INFO Re-using pre-existing directory: /run/cloudera-scm-agent 
>>[14/Aug/2017 15:48:44 +0000] 7900 MainThread agent INFO SCM Agent Version: 5.12.0 
>>[14/Aug/2017 15:48:44 +0000] 7900 MainThread agent WARNING Expected mode 0751 for /run/cloudera-scm-agent but was 0755 
>>[14/Aug/2017 15:48:44 +0000] 7900 MainThread agent INFO Re-using pre-existing directory: /run/cloudera-scm-agent 
>>[14/Aug/2017 15:55:20 +0000] 10087 MainThread agent INFO SCM Agent Version: 5.12.0 
>>[14/Aug/2017 15:55:20 +0000] 10087 MainThread agent WARNING Expected mode 0751 for /run/cloudera-scm-agent but was 0755 
>>[14/Aug/2017 15:55:20 +0000] 10087 MainThread agent INFO Re-using pre-existing directory: /run/cloudera-scm-agent 
>>[14/Aug/2017 15:57:33 +0000] 11562 MainThread agent INFO SCM Agent Version: 5.12.0 
>>[14/Aug/2017 15:57:33 +0000] 11562 MainThread agent WARNING Expected mode 0751 for /run/cloudera-scm-agent but was 0755 
>>[14/Aug/2017 15:57:33 +0000] 11562 MainThread agent INFO Re-using pre-existing directory: /run/cloudera-scm-agent 
>>[14/Aug/2017 16:02:10 +0000] 13258 MainThread agent INFO SCM Agent Version: 5.12.0 
>>[14/Aug/2017 16:02:10 +0000] 13258 MainThread agent WARNING Expected mode 0751 for /run/cloudera-scm-agent but was 0755 
>>[14/Aug/2017 16:02:10 +0000] 13258 MainThread agent INFO Re-using pre-existing directory: /run/cloudera-scm-agent 
>>[14/Aug/2017 16:05:42 +0000] 14770 MainThread agent INFO SCM Agent Version: 5.12.0 
>>[14/Aug/2017 16:05:42 +0000] 14770 MainThread agent WARNING Expected mode 0751 for /run/cloudera-scm-agent but was 0755 
>>[14/Aug/2017 16:05:42 +0000] 14770 MainThread agent INFO Re-using pre-existing directory: /run/cloudera-scm-agent 
>>[14/Aug/2017 16:10:55 +0000] 16442 MainThread agent INFO SCM Agent Version: 5.12.0 
>>[14/Aug/2017 16:10:55 +0000] 16442 MainThread agent WARNING Expected mode 0751 for /run/cloudera-scm-agent but was 0755 
>>[14/Aug/2017 16:10:55 +0000] 16442 MainThread agent INFO Re-using pre-existing directory: /run/cloudera-scm-agent 
>>[14/Aug/2017 16:13:49 +0000] 1145 MainThread agent INFO SCM Agent Version: 5.12.0 
>>[14/Aug/2017 16:13:49 +0000] 1145 MainThread agent WARNING Expected mode 0751 for /run/cloudera-scm-agent but was 0755 
>>[14/Aug/2017 16:13:49 +0000] 1145 MainThread agent INFO Re-using pre-existing directory: /run/cloudera-scm-agent 
>>[14/Aug/2017 16:14:43 +0000] 3398 MainThread agent INFO SCM Agent Version: 5.12.0 
>>[14/Aug/2017 16:14:43 +0000] 3398 MainThread agent WARNING Expected mode 0751 for /run/cloudera-scm-agent but was 0755 
>>[14/Aug/2017 16:14:43 +0000] 3398 MainThread agent INFO Re-using pre-existing directory: /run/cloudera-scm-agent 
>>[14/Aug/2017 16:15:51 +0000] 4575 MainThread agent INFO SCM Agent Version: 5.12.0 
>>[14/Aug/2017 16:15:51 +0000] 4575 MainThread agent WARNING Expected mode 0751 for /run/cloudera-scm-agent but was 0755 
>>[14/Aug/2017 16:15:51 +0000] 4575 MainThread agent INFO Re-using pre-existing directory: /run/cloudera-scm-agent 
>>[14/Aug/2017 16:18:40 +0000] 6143 MainThread agent INFO SCM Agent Version: 5.12.0 
>>[14/Aug/2017 16:18:40 +0000] 6143 MainThread agent WARNING Expected mode 0751 for /run/cloudera-scm-agent but was 0755 
>>[14/Aug/2017 16:18:40 +0000] 6143 MainThread agent INFO Re-using pre-existing directory: /run/cloudera-scm-agent 
>>[14/Aug/2017 16:20:28 +0000] 7515 MainThread agent INFO SCM Agent Version: 5.12.0 
>>[14/Aug/2017 16:20:28 +0000] 7515 MainThread agent WARNING Expected mode 0751 for /run/cloudera-scm-agent but was 0755 
>>[14/Aug/2017 16:20:28 +0000] 7515 MainThread agent INFO Re-using pre-existing directory: /run/cloudera-scm-agent 
>>[14/Aug/2017 16:24:37 +0000] 9161 MainThread agent INFO SCM Agent Version: 5.12.0 
>>[14/Aug/2017 16:24:37 +0000] 9161 MainThread agent WARNING Expected mode 0751 for /run/cloudera-scm-agent but was 0755 
>>[14/Aug/2017 16:24:37 +0000] 9161 MainThread agent INFO Re-using pre-existing directory: /run/cloudera-scm-agent 
: /run/cloudera-scm-agent 
>>[14/Aug/2017 16:14:43 +0000] 3398 MainThread agent INFO SCM Agent Version: 5.12.0 
>>[14/Aug/2017 16:14:43 +0000] 3398 MainThread agent WARNING Expected mode 0751 for /run/cloudera-scm-agent but was 0755 
>>[14/Aug/2017 16:14:43 +0000] 3398 MainThread agent INFO Re-using pre-existing directory: /run/cloudera-scm-agent 
>>[14/Aug/2017 16:15:51 +0000] 4575 MainThread agent INFO SCM Agent Version: 5.12.0 
>>[14/Aug/2017 16:15:51 +0000] 4575 MainThread agent WARNING Expected mode 0751 for /run/cloudera-scm-agent but was 0755 
>>[14/Aug/2017 16:15:51 +0000] 4575 MainThread agent INFO Re-using pre-existing directory: /run/cloudera-scm-agent 
>>[14/Aug/2017 16:18:40 +0000] 6143 MainThread agent INFO SCM Agent Version: 5.12.0 
>>[14/Aug/2017 16:18:40 +0000] 6143 MainThread agent WARNING Expected mode 0751 for /run/cloudera-scm-agent but was 0755 
>>[14/Aug/2017 16:18:40 +0000] 6143 MainThread agent INFO Re-using pre-existing directory: /run/cloudera-scm-agent 
>>[14/Aug/2017 16:20:28 +0000] 7515 MainThread agent INFO SCM Agent Version: 5.12.0 
>>[14/Aug/2017 16:20:28 +0000] 7515 MainThread agent WARNING Expected mode 0751 for /run/cloudera-scm-agent but was 0755 
>>[14/Aug/2017 16:20:28 +0000] 7515 MainThread agent INFO Re-using pre-existing directory: /run/cloudera-scm-agent 
>>[14/Aug/2017 16:24:37 +0000] 9161 MainThread agent INFO SCM Agent Version: 5.12.0 
>>[14/Aug/2017 16:24:37 +0000] 9161 MainThread agent WARNING Expected mode 0751 for /run/cloudera-scm-agent but was 0755 
>>[14/Aug/2017 16:24:37 +0000] 9161 MainThread agent INFO Re-using pre-existing directory: /run/cloudera-scm-agent 
END (0) 
BEGIN sudo tail -n 50 /var/log/cloudera-scm-agent//cloudera-scm-agent.log | sed 's/^/>>/' 
>>[14/Aug/2017 16:20:31 +0000] 7540 MainThread agent INFO Re-using pre-existing directory: /run/cloudera-scm-agent/supervisor/include 
>>[14/Aug/2017 16:20:31 +0000] 7540 MainThread agent INFO Supervisor version: 3.0, pid: 6195 
>>[14/Aug/2017 16:20:31 +0000] 7540 MainThread agent INFO Connecting to previous supervisor: agent-6143-1502720320. 
>>[14/Aug/2017 16:20:31 +0000] 7540 MainThread status_server INFO Using maximum impala profile bundle size of 1073741824 bytes. 
>>[14/Aug/2017 16:20:31 +0000] 7540 MainThread status_server INFO Using maximum stacks log bundle size of 1073741824 bytes. 
>>[14/Aug/2017 16:20:31 +0000] 7540 MainThread _cplogging INFO [14/Aug/2017:16:20:31] ENGINE Bus STARTING 
>>[14/Aug/2017 16:20:31 +0000] 7540 MainThread _cplogging INFO [14/Aug/2017:16:20:31] ENGINE Started monitor thread '_TimeoutMonitor'. 
>>[14/Aug/2017 16:20:31 +0000] 7540 MainThread _cplogging INFO [14/Aug/2017:16:20:31] ENGINE Serving on cluster:9000 
>>[14/Aug/2017 16:20:31 +0000] 7540 MainThread _cplogging INFO [14/Aug/2017:16:20:31] ENGINE Bus STARTED 
>>[14/Aug/2017 16:20:31 +0000] 7540 MainThread __init__ INFO New monitor: (<cmf.monitor.host.HostMonitor object at 0x7f7dad4f6f90>,) 
>>[14/Aug/2017 16:20:31 +0000] 7540 MainThread agent INFO Setting default socket timeout to 45 
>>[14/Aug/2017 16:20:31 +0000] 7540 MonitorDaemon-Scheduler __init__ INFO Monitor ready to report: ('HostMonitor',) 
>>[14/Aug/2017 16:20:31 +0000] 7540 MainThread heartbeat_tracker INFO HB stats (seconds): num:1 LIFE_MIN:0.03 min:0.03 mean:0.03 max:0.03 LIFE_MAX:0.03 
>>[14/Aug/2017 16:20:31 +0000] 7540 MainThread agent INFO CM server guid: 2fe42bb1-7624-4758-9ccc-2cf0f893be2d 
>>[14/Aug/2017 16:20:31 +0000] 7540 MainThread agent INFO Using parcels directory from server provided value: /opt/cloudera/parcels 
>>[14/Aug/2017 16:20:31 +0000] 7540 MainThread parcel INFO Agent does create users/groups and apply file permissions 
>>[14/Aug/2017 16:20:31 +0000] 7540 MainThread downloader INFO Downloader path: /opt/cloudera/parcel-cache 
>>[14/Aug/2017 16:20:31 +0000] 7540 MainThread parcel_cache INFO Using /opt/cloudera/parcel-cache for parcel cache 
>>[14/Aug/2017 16:20:32 +0000] 7540 MainThread agent INFO Flood daemon (re)start attempt 
>>[14/Aug/2017 16:20:32 +0000] 7540 MainThread agent INFO Triggering supervisord update. 
>>[14/Aug/2017 16:20:33 +0000] 7540 MainThread agent INFO Active parcel list updated; recalculating component info. 
>>[14/Aug/2017 16:20:33 +0000] 7540 MainThread throttling_logger INFO Identified java component java6 with full version JAVA_HOME=/usr/lib/jvm/j2sdk1.6-oracle java version "1.6.0_31" Java(TM) SE Runtime Environment (build 1.6.0_31-b04) Java HotSpot(TM) 64-Bit Server VM (build 20.6-b01, mixed mode) for requested version 6. 
>>[14/Aug/2017 16:20:34 +0000] 7540 MainThread throttling_logger INFO Identified java component java7 with full version JAVA_HOME=/usr/lib/jvm/java-7-oracle-cloudera java version "1.7.0_67" Java(TM) SE Runtime Environment (build 1.7.0_67-b01) Java HotSpot(TM) 64-Bit Server VM (build 24.65-b04, mixed mode) for requested version 7. 
>>[14/Aug/2017 16:24:36 +0000] 7540 MainThread agent INFO Stopping agent... 
>>[14/Aug/2017 16:24:36 +0000] 7540 MainThread agent INFO No extant cgroups; unmounting any cgroup roots 
>>[14/Aug/2017 16:24:36 +0000] 7540 MainThread agent INFO 2 processes are being managed; Supervisor will continue to run. 
>>[14/Aug/2017 16:24:36 +0000] 7540 MainThread _cplogging INFO [14/Aug/2017:16:24:36] ENGINE Bus STOPPING 
>>[14/Aug/2017 16:24:36 +0000] 7540 MainThread _cplogging INFO [14/Aug/2017:16:24:36] ENGINE HTTP Server cherrypy._cpwsgi_server.CPWSGIServer(('cluster', 9000)) shut down 
>>[14/Aug/2017 16:24:36 +0000] 7540 MainThread _cplogging INFO [14/Aug/2017:16:24:36] ENGINE Stopped thread '_TimeoutMonitor'. 
>>[14/Aug/2017 16:24:36 +0000] 7540 MainThread _cplogging INFO [1>>[14/Aug/2017 16:20:31 +0000] 7540 MainThread agent INFO Re-using pre-existing directory: /run/cloudera-scm-agent/supervisor/include 
>>[14/Aug/2017 16:20:31 +0000] 7540 MainThread agent INFO Supervisor version: 3.0, pid: 6195 
>>[14/Aug/2017 16:20:31 +0000] 7540 MainThread agent INFO Connecting to previous supervisor: agent-6143-1502720320. 
>>[14/Aug/2017 16:20:31 +0000] 7540 MainThread status_server INFO Using maximum impala profile bundle size of 1073741824 bytes. 
>>[14/Aug/2017 16:20:31 +0000] 7540 MainThread status_server INFO Using maximum stacks log bundle size of 1073741824 bytes. 
>>[14/Aug/2017 16:20:31 +0000] 7540 MainThread _cplogging INFO [14/Aug/2017:16:20:31] ENGINE Bus STARTING 
>>[14/Aug/2017 16:20:31 +0000] 7540 MainThread _cplogging INFO [14/Aug/2017:16:20:31] ENGINE Started monitor thread '_TimeoutMonitor'. 
>>[14/Aug/2017 16:20:31 +0000] 7540 MainThread _cplogging INFO [14/Aug/2017:16:20:31] ENGINE Serving on cluster:9000 
>>[14/Aug/2017 16:20:31 +0000] 7540 MainThread _cplogging INFO [14/Aug/2017:16:20:31] ENGINE Bus STARTED 
>>[14/Aug/2017 16:20:31 +0000] 7540 MainThread __init__ INFO New monitor: (<cmf.monitor.host.HostMonitor object at 0x7f7dad4f6f90>,) 
>>[14/Aug/2017 16:20:31 +0000] 7540 MainThread agent INFO Setting default socket timeout to 45 
>>[14/Aug/2017 16:20:31 +0000] 7540 MonitorDaemon-Scheduler __init__ INFO Monitor ready to report: ('HostMonitor',) 
>>[14/Aug/2017 16:20:31 +0000] 7540 MainThread heartbeat_tracker INFO HB stats (seconds): num:1 LIFE_MIN:0.03 min:0.03 mean:0.03 max:0.03 LIFE_MAX:0.03 
>>[14/Aug/2017 16:20:31 +0000] 7540 MainThread agent INFO CM server guid: 2fe42bb1-7624-4758-9ccc-2cf0f893be2d 
>>[14/Aug/2017 16:20:31 +0000] 7540 MainThread agent INFO Using parcels directory from server provided value: /opt/cloudera/parcels 
>>[14/Aug/2017 16:20:31 +0000] 7540 MainThread parcel INFO Agent does create users/groups and apply file permissions 
>>[14/Aug/2017 16:20:31 +0000] 7540 MainThread downloader INFO Downloader path: /opt/cloudera/parcel-cache 
>>[14/Aug/2017 16:20:31 +0000] 7540 MainThread parcel_cache INFO Using /opt/cloudera/parcel-cache for parcel cache 
>>[14/Aug/2017 16:20:32 +0000] 7540 MainThread agent INFO Flood daemon (re)start attempt 
>>[14/Aug/2017 16:20:32 +0000] 7540 MainThread agent INFO Triggering supervisord update. 
>>[14/Aug/2017 16:20:33 +0000] 7540 MainThread agent INFO Active parcel list updated; recalculating component info. 
>>[14/Aug/2017 16:20:33 +0000] 7540 MainThread throttling_logger INFO Identified java component java6 with full version JAVA_HOME=/usr/lib/jvm/j2sdk1.6-oracle java version "1.6.0_31" Java(TM) SE Runtime Environment (build 1.6.0_31-b04) Java HotSpot(TM) 64-Bit Server VM (build 20.6-b01, mixed mode) for requested version 6. 
>>[14/Aug/2017 16:20:34 +0000] 7540 MainThread throttling_logger INFO Identified java component java7 with full version JAVA_HOME=/usr/lib/jvm/java-7-oracle-cloudera java version "1.7.0_67" Java(TM) SE Runtime Environment (build 1.7.0_67-b01) Java HotSpot(TM) 64-Bit Server VM (build 24.65-b04, mixed mode) for requested version 7. 
>>[14/Aug/2017 16:24:36 +0000] 7540 MainThread agent INFO Stopping agent... 
>>[14/Aug/2017 16:24:36 +0000] 7540 MainThread agent INFO No extant cgroups; unmounting any cgroup roots 
>>[14/Aug/2017 16:24:36 +0000] 7540 MainThread agent INFO 2 processes are being managed; Supervisor will continue to run. 
>>[14/Aug/2017 16:24:36 +0000] 7540 MainThread _cplogging INFO [14/Aug/2017:16:24:36] ENGINE Bus STOPPING 
>>[14/Aug/2017 16:24:36 +0000] 7540 MainThread _cplogging INFO [14/Aug/2017:16:24:36] ENGINE HTTP Server cherrypy._cpwsgi_server.CPWSGIServer(('cluster', 9000)) shut down 
>>[14/Aug/2017 16:24:36 +0000] 7540 MainThread _cplogging INFO [14/Aug/2017:16:24:36] ENGINE Stopped thread '_TimeoutMonitor'. 
>>[14/Aug/2017 16:24:36 +0000] 7540 MainThread _cplogging INFO [14/Aug/2017:16:24:36] ENGINE Bus STOPPED 
>>[14/Aug/2017 16:24:36 +0000] 7540 MainThread _cplogging INFO [14/Aug/2017:16:24:36] ENGINE Bus STOPPING 
>>[14/Aug/2017 16:24:36 +0000] 7540 MainThread _cplogging INFO [14/Aug/2017:16:24:36] ENGINE HTTP Server cherrypy._cpwsgi_server.CPWSGIServer(('cluster', 9000)) already shut down 
>>[14/Aug/2017 16:24:36 +0000] 7540 MainThread _cplogging INFO [14/Aug/2017:16:24:36] ENGINE No thread running for None. 
>>[14/Aug/2017 16:24:36 +0000] 7540 MainThread _cplogging INFO [14/Aug/2017:16:24:36] ENGINE Bus STOPPED 
>>[14/Aug/2017 16:24:36 +0000] 7540 MainThread _cplogging INFO [14/Aug/2017:16:24:36] ENGINE Bus EXITING 
>>[14/Aug/2017 16:24:36 +0000] 7540 MainThread _cplogging INFO [14/Aug/2017:16:24:36] ENGINE Bus EXITED 
>>[14/Aug/2017 16:24:36 +0000] 7540 MainThread agent INFO Agent exiting; caught signal 15 
>>[14/Aug/2017 16:24:36 +0000] 7540 Dummy-14 daemonize WARNING Stopping daemon. 
>>[14/Aug/2017 16:24:37 +0000] 9186 MainThread agent INFO SCM Agent Version: 5.12.0 
>>[14/Aug/2017 16:24:37 +0000] 9186 MainThread agent INFO Agent Protocol Version: 4 
>>[14/Aug/2017 16:24:37 +0000] 9186 MainThread agent INFO Using Host ID: 734c85d4-3ee4-4b18-91fa-167cdb9cb07d 
>>[14/Aug/2017 16:24:37 +0000] 9186 MainThread agent INFO Using directory: /run/cloudera-scm-agent 
>>[14/Aug/2017 16:24:37 +0000] 9186 MainThread agent INFO Using supervisor binary path: /usr/lib/cmf/agent/build/env/bin/supervisord 
>>[14/Aug/2017 16:24:37 +0000] 9186 MainThread agent INFO Neither verify_cert_file nor verify_cert_dir are configured. Not performing validation of server certificates in HTTPS communication. These options can be configured in this agent's config.ini file to enable certificate validation. 
>>[14/Aug/2017 16:24:37 +0000] 9186 MainThread agent INFO Agent Logging Level: INFO 
>>[14/Aug/2017 16:24:37 +0000] 9186 MainThread agent INFO No command line vars 
>>[14/Aug/2017 16:24:37 +0000] 9186 MainThread agent INFO Missing database jar: /usr/share/java/mysql-connector-java.jar (normal, if you're not using this database type) 
>>[14/Aug/2017 16:24:37 +0000] 9186 MainThread agent INFO Missing database jar: /usr/share/java/oracle-connector-java.jar (normal, if you're not using this database type) 
>>[14/Aug/2017 16:24:37 +0000] 9186 MainThread agent INFO Found database jar: /usr/share/cmf/lib/postgresql-9.0-801.jdbc4.jar 
>>[14/Aug/2017 16:24:37 +0000] 9186 MainThread agent INFO Agent starting as pid 9186 user root(0) group root(0). 
4/Aug/2017:16:24:36] ENGINE Bus STOPPED 
>>[14/Aug/2017 16:24:36 +0000] 7540 MainThread _cplogging INFO [14/Aug/2017:16:24:36] ENGINE Bus STOPPING 
>>[14/Aug/2017 16:24:36 +0000] 7540 MainThread _cplogging INFO [14/Aug/2017:16:24:36] ENGINE HTTP Server cherrypy._cpwsgi_server.CPWSGIServer(('cluster', 9000)) already shut down 
>>[14/Aug/2017 16:24:36 +0000] 7540 MainThread _cplogging INFO [14/Aug/2017:16:24:36] ENGINE No thread running for None. 
>>[14/Aug/2017 16:24:36 +0000] 7540 MainThread _cplogging INFO [14/Aug/2017:16:24:36] ENGINE Bus STOPPED 
>>[14/Aug/2017 16:24:36 +0000] 7540 MainThread _cplogging INFO [14/Aug/2017:16:24:36] ENGINE Bus EXITING 
>>[14/Aug/2017 16:24:36 +0000] 7540 MainThread _cplogging INFO [14/Aug/2017:16:24:36] ENGINE Bus EXITED 
>>[14/Aug/2017 16:24:36 +0000] 7540 MainThread agent INFO Agent exiting; caught signal 15 
>>[14/Aug/2017 16:24:36 +0000] 7540 Dummy-14 daemonize WARNING Stopping daemon. 
>>[14/Aug/2017 16:24:37 +0000] 9186 MainThread agent INFO SCM Agent Version: 5.12.0 
>>[14/Aug/2017 16:24:37 +0000] 9186 MainThread agent INFO Agent Protocol Version: 4 
>>[14/Aug/2017 16:24:37 +0000] 9186 MainThread agent INFO Using Host ID: 734c85d4-3ee4-4b18-91fa-167cdb9cb07d 
>>[14/Aug/2017 16:24:37 +0000] 9186 MainThread agent INFO Using directory: /run/cloudera-scm-agent 
>>[14/Aug/2017 16:24:37 +0000] 9186 MainThread agent INFO Using supervisor binary path: /usr/lib/cmf/agent/build/env/bin/supervisord 
>>[14/Aug/2017 16:24:37 +0000] 9186 MainThread agent INFO Neither verify_cert_file nor verify_cert_dir are configured. Not performing validation of server certificates in HTTPS communication. These options can be configured in this agent's config.ini file to enable certificate validation. 
>>[14/Aug/2017 16:24:37 +0000] 9186 MainThread agent INFO Agent Logging Level: INFO 
>>[14/Aug/2017 16:24:37 +0000] 9186 MainThread agent INFO No command line vars 
>>[14/Aug/2017 16:24:37 +0000] 9186 MainThread agent INFO Missing database jar: /usr/share/java/mysql-connector-java.jar (normal, if you're not using this database type) 
>>[14/Aug/2017 16:24:37 +0000] 9186 MainThread agent INFO Missing database jar: /usr/share/java/oracle-connector-java.jar (normal, if you're not using this database type) 
>>[14/Aug/2017 16:24:37 +0000] 9186 MainThread agent INFO Found database jar: /usr/share/cmf/lib/postgresql-9.0-801.jdbc4.jar 
>>[14/Aug/2017 16:24:37 +0000] 9186 MainThread agent INFO Agent starting as pid 9186 user root(0) group root(0). 
END (0) 
end of agent logs. 
scm agent restarted 
Installation script completed successfully.

all done 
closing logging file descriptor 

 

Announcements