Support Questions

Find answers, ask questions, and share your expertise
Announcements
Celebrating as our community reaches 100,000 members! Thank you!

Installation failed. Failed to receive heartbeat from agent.

avatar
Explorer

Error Message: Installation failed. Failed to receive heartbeat from agent. • Ensure that the host's hostname is configured properly. • Ensure that port 7182 is accessible on the Cloudera Manager Server (check firewall rules). • Ensure that ports 9000 and 9001 are not in use on the host being added. • Check agent logs in /var/log/cloudera-scm-agent/ on the host being added. (Some of the logs can be found in the installation details). • If Use TLS Encryption for Agentsis enabled in Cloudera Manager (Administration -> Settings -> Security), ensure that /etc/cloudera-scm-agent/config.inihas use_tls=1 on the host being added. Restart the corresponding agent and click the Retry link here. Log file: /tmp/scm_prepare_node.bK5vQRgw using SSH_CLIENT to get the SCM hostname: 10.x.y.z 38830 22 opening logging file descriptor Starting installation script... Acquiring installation lock... BEGIN flock 4 END (0) Detecting root privileges... effective UID is 0 Detecting distribution... BEGIN grep 'Ubuntu' /etc/lsb-release DISTRIB_ID=Ubuntu DISTRIB_DESCRIPTION="Ubuntu 16.04.2 LTS" END (0) BEGIN grep DISTRIB_CODENAME /etc/lsb-release END (0) DISTRIB_CODENAME=xenial BEGIN echo DISTRIB_CODENAME=xenial | cut -d = -f 2 xenial END (0) Detecting Cloudera Manager Server... BEGIN host -t PTR 10.x.y.z Host z.y.x.10.in-addr.arpa. not found: 3(NXDOMAIN) END (1) BEGIN which python /usr/bin/python END (0) BEGIN python -c 'import socket; import sys; s = socket.socket(socket.AF_INET); s.settimeout(5.0); s.connect((sys.argv[1], int(sys.argv[2]))); s.close();' 10.x.y.z 7182 END (0) BEGIN which wget /usr/bin/wget END (0) BEGIN wget -qO- -T 1 -t 1 http://169.254.169.254/latest/meta-data/public-hostname && /bin/echo END (4) Installing package repositories... validating format of repository file /tmp/scm_prepare_node.bK5vQRgw/repos/ubuntu_xenial/cloudera-manager.list installing repository file /tmp/scm_prepare_node.bK5vQRgw/repos/ubuntu_xenial/cloudera-manager.list repository file /tmp/scm_prepare_node.bK5vQRgw/repos/ubuntu_xenial/cloudera-manager.list installed BEGIN apt-key add /tmp/scm_prepare_node.bK5vQRgw/archive.key OK END (0) installing priority file /tmp/scm_prepare_node.bK5vQRgw/priorities/ubuntu_xenial/cloudera.pref priority file /tmp/scm_prepare_node.bK5vQRgw/priorities/ubuntu_xenial/cloudera.pref in-stalled Refreshing package metadata... BEGIN apt-get update Hit:1 http://archive.cloudera.com/cm5/ubuntu/xenial/amd64/cm xenial-cm5 InRelease Hit:2 https://archive.cloudera.com/cdh5/ubuntu/precise/amd64/cdh precise-cdh5 InRe-lease Hit:3 http://repo.mysql.com/apt/ubuntu xenial InRelease Hit:4 https://archive.cloudera.com/cm5/ubuntu/xenial/amd64/cm xenial-cm5.12.0 InRe-lease Hit:5 http://in.archive.ubuntu.com/ubuntu xenial InRelease Get:6 http://security.ubuntu.com/ubuntu xenial-security InRelease [102 kB] Get:7 http://in.archive.ubuntu.com/ubuntu xenial-updates InRelease [102 kB] Get:8 http://security.ubuntu.com/ubuntu xenial-security/main amd64 DEP-11 Metadata [60.2 kB] Get:9 http://security.ubuntu.com/ubuntu xenial-security/main DEP-11 64x64 Icons [52.0 kB] Get:10 http://in.archive.ubuntu.com/ubuntu xenial-backports InRelease [102 kB] Get:11 http://in.archive.ubuntu.com/ubuntu xenial-updates/main amd64 DEP-11 Metada-ta [305 kB] Get:12 http://security.ubuntu.com/ubuntu xenial-security/universe amd64 DEP-11 Metadata [48.8 kB] Get:13 http://security.ubuntu.com/ubuntu xenial-security/universe DEP-11 64x64 Icons [64.2 kB] Get:14 http://in.archive.ubuntu.com/ubuntu xenial-updates/main DEP-11 64x64 Icons [206 kB] Get:15 http://in.archive.ubuntu.com/ubuntu xenial-updates/universe amd64 DEP-11 Metadata [171 kB] Get:16 http://in.archive.ubuntu.com/ubuntu xenial-updates/universe DEP-11 64x64 Icons [224 kB] Get:17 http://in.archive.ubuntu.com/ubuntu xenial-updates/multiverse amd64 DEP-11 Metadata [5,892 B] Get:18 http://in.archive.ubuntu.com/ubuntu xenial-backports/main amd64 DEP-11 Metadata [3,324 B] Get:19 http://in.archive.ubuntu.com/ubuntu xenial-backports/universe amd64 DEP-11 Metadata [5,136 B] Fetched 1,451 kB in 6s (241 kB/s) Reading package lists... W: http://archive.cloudera.com/cm5/ubuntu/xenial/amd64/cm/dists/xenial-cm5/InRelease: Signature by key F36A89E33CC1BD0F71079007327574EE02A818DD uses weak digest algorithm (SHA1) W: https://archive.cloudera.com/cdh5/ubuntu/precise/amd64/cdh/dists/precise-cdh5/InRelease: Signature by key F36A89E33CC1BD0F71079007327574EE02A818DD uses weak digest algorithm (SHA1) W: https://archive.cloudera.com/cm5/ubuntu/xenial/amd64/cm/dists/xenial-cm5.12.0/InRelease: Signature by key F36A89E33CC1BD0F71079007327574EE02A818DD uses weak digest algorithm (SHA1) END (0) BEGIN apt-get update Hit:1 http://repo.mysql.com/apt/ubuntu xenial InRelease Hit:2 http://archive.cloudera.com/cm5/ubuntu/xenial/amd64/cm xenial-cm5 InRelease Hit:3 https://archive.cloudera.com/cdh5/ubuntu/precise/amd64/cdh precise-cdh5 InRe-lease Hit:4 https://archive.cloudera.com/cm5/ubuntu/xenial/amd64/cm xenial-cm5.12.0 InRe-lease Hit:5 http://security.ubuntu.com/ubuntu xenial-security InRelease Hit:6 http://in.archive.ubuntu.com/ubuntu xenial InRelease Hit:7 http://in.archive.ubuntu.com/ubuntu xenial-updates InRelease Hit:8 http://in.archive.ubuntu.com/ubuntu xenial-backports InRelease Reading package lists... W: http://archive.cloudera.com/cm5/ubuntu/xenial/amd64/cm/dists/xenial-cm5/InRelease: Signature by key F36A89E33CC1BD0F71079007327574EE02A818DD uses weak digest algorithm (SHA1) W: https://archive.cloudera.com/cdh5/ubuntu/precise/amd64/cdh/dists/precise-cdh5/InRelease: Signature by key F36A89E33CC1BD0F71079007327574EE02A818DD uses weak digest algorithm (SHA1) W: https://archive.cloudera.com/cm5/ubuntu/xenial/amd64/cm/dists/xenial-cm5.12.0/InRelease: Signature by key F36A89E33CC1BD0F71079007327574EE02A818DD uses weak digest algorithm (SHA1) END (0) Installing cloudera-manager-agent package... BEGIN dpkg -l cloudera-manager-agent | grep -E '^ii[[:space:]]*cloudera-manager-agent[[:space:]]*' ii cloudera-manager-agent 5.12.0-1.cm5120.p0.120~xenial-cm5 amd64 The Cloudera Manager Agent END (0) BEGIN echo oracle-j2sdk1.6 oracle-j2sdk1.7 cloudera-manager-agent cloudera-manager-daemons | grep cloudera-manager-agent oracle-j2sdk1.6 oracle-j2sdk1.7 cloudera-manager-agent cloudera-manager-daemons END (0) BEGIN apt-cache show cloudera-manager-agent Package: cloudera-manager-agent Source: enterprise Version: 5.12.0-1.cm5120.p0.120~xenial-cm5 Architecture: amd64 Maintainer: Cloudera Inc. Installed-Size: 44039 Depends: libc6 (>= 2.17), libcomerr2 (>= 1.01), libgcc1 (>= 1:3.0), libgssapi-krb5-2 (>= 1.10+dfsg~), libkrb5-3 (>= 1.6.dfsg.2), libssl1.0.0 (>= 1.0.2~beta3), libstdc++6 (>= 5.2), zlib1g (>= 1:1.2.0), lsb-base, psmisc, bash, libsasl2-modules, libsasl2-modules-gssapi-mit, libxslt1.1, libsqlite3-0, openssl, libssl-dev, libfuse2, fuse-utils | fuse, rpcbind, cloudera-manager-daemons (= 5.12.0-1.cm5120.p0.120~xenial-cm5), perl, python-psycopg2, py-thon-mysqldb, apache2, iproute2 Homepage: http://www.cloudera.com Priority: extra Section: misc Filename: pool/contrib/e/enterprise/cloudera-manager-agent_5.12.0-1.cm5120.p0.120~xenial-cm5_amd64.deb Size: 11186376 SHA256: 69618949fb10d631ac301f21f62ecab0a3631eec456b6de43ef9c6a17c107498 SHA1: 6b137a4328780d56f964403ff8c56fe7577935a0 MD5sum: f7c9fc2b393b6d61563ea34ca15b6e61 Description: The Cloudera Manager Agent The Agent is deployed to machines running services managed by Cloudera Manager. Description-md5: 482a592ee859d31443f58aa3e48fe303 END (0) Version: 5.12.0-1.cm5120.p0.120~xenial-cm5 BEGIN apt-get -o Dpkg::Options::=--force-confdef -o Dpkg::Options::=--force-confold -y in-stall cloudera-manager-agent Reading package lists... Building dependency tree... Reading state information... cloudera-manager-agent is already the newest version (5.12.0-1.cm5120.p0.120~xenial-cm5). 0 upgraded, 0 newly installed, 0 to remove and 347 not upgraded. END (0) remote package cloudera-manager-agent installed Installing cloudera-manager-daemons package... BEGIN dpkg -l cloudera-manager-daemons | grep -E '^ii[[:space:]]*cloudera-manager-daemons[[:space:]]*' ii cloudera-manager-daemons 5.12.0-1.cm5120.p0.120~xenial-cm5 all Provides daemons for monitoring Hadoop and related tools. END (0) BEGIN echo oracle-j2sdk1.6 oracle-j2sdk1.7 cloudera-manager-agent cloudera-manager-daemons | grep cloudera-manager-daemons oracle-j2sdk1.6 oracle-j2sdk1.7 cloudera-manager-agent cloudera-manager-daemons END (0) BEGIN apt-cache show cloudera-manager-daemons Package: cloudera-manager-daemons Source: enterprise Version: 5.12.0-1.cm5120.p0.120~xenial-cm5 Architecture: all Maintainer: Cloudera Inc. Installed-Size: 869404 Depends: perl Homepage: http://www.cloudera.com Priority: extra Section: misc Filename: pool/contrib/e/enterprise/cloudera-manager-daemons_5.12.0-1.cm5120.p0.120~xenial-cm5_all.deb Size: 737883268 SHA256: cf168ac13387bef54c61034e7cfef49539b1616cfb876f91db5dfe458d237780 SHA1: a18ed00de131d0c358411104fb3d886e0c211101 MD5sum: 47813b5493281f58b36ca33868229394 Description: Provides daemons for monitoring Hadoop and related tools. Provides daemons for monitoring Hadoop and related tools. Description-md5: 35bb5bc8fc2f296f791c3bda9e345340 END (0) Version: 5.12.0-1.cm5120.p0.120~xenial-cm5 BEGIN apt-get -o Dpkg::Options::=--force-confdef -o Dpkg::Options::=--force-confold -y in-stall cloudera-manager-daemons Reading package lists... Building dependency tree... Reading state information... cloudera-manager-daemons is already the newest version (5.12.0-1.cm5120.p0.120~xenial-cm5). 0 upgraded, 0 newly installed, 0 to remove and 347 not upgraded. END (0) remote package cloudera-manager-daemons installed Installing Unlimited Strength Encryption policy files. Installation not requested. Step will be skipped. Configuring Cloudera Manager Agent... BEGIN grep server_host=10.x.y.z /etc/cloudera-scm-agent/config.ini server_host=10.x.y.z END (0) scm agent is already configured BEGIN sed -e 's/#\(USER=.*\)/\1/' -i /etc/default/cloudera-scm-agent END (0) Starting Cloudera Manager Agent... BEGIN /usr/sbin/service cloudera-scm-agent status * cloudera-scm-agent.service - LSB: Cloudera SCM Agent Loaded: loaded (/etc/init.d/cloudera-scm-agent; bad; vendor preset: enabled) Active: active (exited) since Thu 2017-08-24 15:47:19 IST; 58min ago Docs: man:systemd-sysv-generator(8) Process: 9473 ExecStop=/etc/init.d/cloudera-scm-agent stop (code=exited, sta-tus=0/SUCCESS) Process: 9496 ExecStart=/etc/init.d/cloudera-scm-agent start (code=exited, sta-tus=0/SUCCESS) Aug 24 15:47:17 PC355406 systemd[1]: Starting LSB: Cloudera SCM Agent... Aug 24 15:47:17 PC355406 su[9516]: Successful su for cloudera-scm by root Aug 24 15:47:17 PC355406 su[9516]: + ??? root:cloudera-scm Aug 24 15:47:17 PC355406 su[9516]: pam_unix(su:session): session opened for user cloudera-scm by (uid=0) Aug 24 15:47:19 PC355406 cloudera-scm-agent[9496]: Starting cloudera-scm-agent: * cloudera-scm-agent started Aug 24 15:47:19 PC355406 systemd[1]: Started LSB: Cloudera SCM Agent. END (0) BEGIN /usr/sbin/service cloudera-scm-agent restart END (0) agent logs: BEGIN tail -n 50 /var/log/cloudera-scm-agent//cloudera-scm-agent.out | sed 's/^/>>/' >>[24/Aug/2017 12:55:20 +0000] 1442 MainThread agent INFO Re-using pre-existing di-rectory: /run/cloudera-scm-agent >>/usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/cmf-5.12.0-py2.7.egg/cmf/redaction.py:260: SyntaxWarning: name 'REDACTOR' is assigned to be-fore global declaration >> global REDACTOR >>/usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/cmf-5.12.0-py2.7.egg/cmf/redaction.py:261: SyntaxWarning: name 'NOP_REDACTOR' is assigned to before global declaration >> global NOP_REDACTOR >>[24/Aug/2017 13:03:49 +0000] 1426 MainThread agent INFO SCM Agent Version: 5.12.0 >>[24/Aug/2017 13:03:49 +0000] 1426 MainThread agent WARNING Expected mode 0751 for /run/cloudera-scm-agent but was 0755 >>[24/Aug/2017 13:03:49 +0000] 1426 MainThread agent INFO Re-using pre-existing di-rectory: /run/cloudera-scm-agent >>/usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/cmf-5.12.0-py2.7.egg/cmf/redaction.py:260: SyntaxWarning: name 'REDACTOR' is assigned to be-fore global declaration >> global REDACTOR >>/usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/cmf-5.12.0-py2.7.egg/cmf/redaction.py:261: SyntaxWarning: name 'NOP_REDACTOR' is assigned to before global declaration >> global NOP_REDACTOR >>[24/Aug/2017 13:06:32 +0000] 4147 MainThread agent INFO SCM Agent Version: 5.12.0 >>[24/Aug/2017 13:06:32 +0000] 4147 MainThread agent WARNING Expected mode 0751 for /run/cloudera-scm-agent but was 0755 >>[24/Aug/2017 13:06:32 +0000] 4147 MainThread agent INFO Re-using pre-existing di-rectory: /run/cloudera-scm-agent >>/usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/cmf-5.12.0-py2.7.egg/cmf/redaction.py:260: SyntaxWarning: name 'REDACTOR' is assigned to be-fore global declaration >> global REDACTOR >>/usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/cmf-5.12.0-py2.7.egg/cmf/redaction.py:261: SyntaxWarning: name 'NOP_REDACTOR' is assigned to before global declaration >> global NOP_REDACTOR >>[24/Aug/2017 15:38:40 +0000] 6308 MainThread agent INFO SCM Agent Version: 5.12.0 >>[24/Aug/2017 15:38:40 +0000] 6308 MainThread agent WARNING Expected mode 0751 for /run/cloudera-scm-agent but was 0755 >>[24/Aug/2017 15:38:40 +0000] 6308 MainThread agent INFO Re-using pre-existing di-rectory: /run/cloudera-scm-agent >>/usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/cmf-5.12.0-py2.7.egg/cmf/redaction.py:260: SyntaxWarning: name 'REDACTOR' is assigned to be-fore global declaration >> global REDACTOR >>/usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/cmf-5.12.0-py2.7.egg/cmf/redaction.py:261: SyntaxWarning: name 'NOP_REDACTOR' is assigned to before global declaration >> global NOP_REDACTOR >>[24/Aug/2017 15:40:25 +0000] 7651 MainThread agent INFO SCM Agent Version: 5.12.0 >>[24/Aug/2017 15:40:25 +0000] 7651 MainThread agent WARNING Expected mode 0751 for /run/cloudera-scm-agent but was 0755 >>[24/Aug/2017 15:40:25 +0000] 7651 MainThread agent INFO Re-using pre-existing di-rectory: /run/cloudera-scm-agent >>/usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/cmf-5.12.0-py2.7.egg/cmf/redaction.py:260: SyntaxWarning: name 'REDACTOR' is assigned to be-fore global declaration >> global REDACTOR >>/usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/cmf-5.12.0-py2.7.egg/cmf/redaction.py:261: SyntaxWarning: name 'NOP_REDACTOR' is assigned to before global declaration >> global NOP_REDACTOR >>[24/Aug/2017 15:43:14 +0000] 8111 MainThread agent INFO SCM Agent Version: 5.12.0 >>[24/Aug/2017 15:43:14 +0000] 8111 MainThread agent WARNING Expected mode 0751 for /run/cloudera-scm-agent but was 0755 >>[24/Aug/2017 15:43:14 +0000] 8111 MainThread agent INFO Re-using pre-existing di-rectory: /run/cloudera-scm-agent >>/usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/cmf-5.12.0-py2.7.egg/cmf/redaction.py:260: SyntaxWarning: name 'REDACTOR' is assigned to be-fore global declaration >> global REDACTOR >>/usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/cmf-5.12.0-py2.7.egg/cmf/redaction.py:261: SyntaxWarning: name 'NOP_REDACTOR' is assigned to before global declaration >> global NOP_REDACTOR >>[24/Aug/2017 15:47:19 +0000] 9518 MainThread agent INFO SCM Agent Version: 5.12.0 >>[24/Aug/2017 15:47:19 +0000] 9518 MainThread agent WARNING Expected mode 0751 for /run/cloudera-scm-agent but was 0755 >>[24/Aug/2017 15:47:19 +0000] 9518 MainThread agent INFO Re-using pre-existing di-rectory: /run/cloudera-scm-agent >>/usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/cmf-5.12.0-py2.7.egg/cmf/redaction.py:260: SyntaxWarning: name 'REDACTOR' is assigned to be-fore global declaration >> global REDACTOR >>/usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/cmf-5.12.0-py2.7.egg/cmf/redaction.py:261: SyntaxWarning: name 'NOP_REDACTOR' is assigned to before global declaration >> global NOP_REDACTOR >>[24/Aug/2017 16:46:11 +0000] 11744 MainThread agent INFO SCM Agent Version: 5.12.0 >>[24/Aug/2017 16:46:11 +0000] 11744 MainThread agent WARNING Expected mode 0751 for /run/cloudera-scm-agent but was 0755 >>[24/Aug/2017 16:46:11 +0000] 11744 MainThread agent INFO Re-using pre-existing directory: /run/cloudera-scm-agent >>[24/Aug/2017 12:55:20 +0000] 1442 MainThread agent INFO Re-using pre-existing di-rectory: /run/cloudera-scm-agent >>/usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/cmf-5.12.0-py2.7.egg/cmf/redaction.py:260: SyntaxWarning: name 'REDACTOR' is assigned to be-fore global declaration >> global REDACTOR >>/usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/cmf-5.12.0-py2.7.egg/cmf/redaction.py:261: SyntaxWarning: name 'NOP_REDACTOR' is assigned to before global declaration >> global NOP_REDACTOR >>[24/Aug/2017 13:03:49 +0000] 1426 MainThread agent INFO SCM Agent Version: 5.12.0 >>[24/Aug/2017 13:03:49 +0000] 1426 MainThread agent WARNING Expected mode 0751 for /run/cloudera-scm-agent but was 0755 >>[24/Aug/2017 13:03:49 +0000] 1426 MainThread agent INFO Re-using pre-existing di-rectory: /run/cloudera-scm-agent >>/usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/cmf-5.12.0-py2.7.egg/cmf/redaction.py:260: SyntaxWarning: name 'REDACTOR' is assigned to be-fore global declaration >> global REDACTOR >>/usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/cmf-5.12.0-py2.7.egg/cmf/redaction.py:261: SyntaxWarning: name 'NOP_REDACTOR' is assigned to before global declaration >> global NOP_REDACTOR >>[24/Aug/2017 13:06:32 +0000] 4147 MainThread agent INFO SCM Agent Version: 5.12.0 >>[24/Aug/2017 13:06:32 +0000] 4147 MainThread agent WARNING Expected mode 0751 for /run/cloudera-scm-agent but was 0755 >>[24/Aug/2017 13:06:32 +0000] 4147 MainThread agent INFO Re-using pre-existing di-rectory: /run/cloudera-scm-agent >>/usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/cmf-5.12.0-py2.7.egg/cmf/redaction.py:260: SyntaxWarning: name 'REDACTOR' is assigned to be-fore global declaration >> global REDACTOR >>/usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/cmf-5.12.0-py2.7.egg/cmf/redaction.py:261: SyntaxWarning: name 'NOP_REDACTOR' is assigned to before global declaration >> global NOP_REDACTOR >>[24/Aug/2017 15:38:40 +0000] 6308 MainThread agent INFO SCM Agent Version: 5.12.0 >>[24/Aug/2017 15:38:40 +0000] 6308 MainThread agent WARNING Expected mode 0751 for /run/cloudera-scm-agent but was 0755 >>[24/Aug/2017 15:38:40 +0000] 6308 MainThread agent INFO Re-using pre-existing di-rectory: /run/cloudera-scm-agent >>/usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/cmf-5.12.0-py2.7.egg/cmf/redaction.py:260: SyntaxWarning: name 'REDACTOR' is assigned to be-fore global declaration >> global REDACTOR >>/usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/cmf-5.12.0-py2.7.egg/cmf/redaction.py:261: SyntaxWarning: name 'NOP_REDACTOR' is assigned to before global declaration >> global NOP_REDACTOR >>[24/Aug/2017 15:40:25 +0000] 7651 MainThread agent INFO SCM Agent Version: 5.12.0 >>[24/Aug/2017 15:40:25 +0000] 7651 MainThread agent WARNING Expected mode 0751 for /run/cloudera-scm-agent but was 0755 >>[24/Aug/2017 15:40:25 +0000] 7651 MainThread agent INFO Re-using pre-existing di-rectory: /run/cloudera-scm-agent >>/usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/cmf-5.12.0-py2.7.egg/cmf/redaction.py:260: SyntaxWarning: name 'REDACTOR' is assigned to be-fore global declaration >> global REDACTOR >>/usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/cmf-5.12.0-py2.7.egg/cmf/redaction.py:261: SyntaxWarning: name 'NOP_REDACTOR' is assigned to before global declaration >> global NOP_REDACTOR >>[24/Aug/2017 15:43:14 +0000] 8111 MainThread agent INFO SCM Agent Version: 5.12.0 >>[24/Aug/2017 15:43:14 +0000] 8111 MainThread agent WARNING Expected mode 0751 for /run/cloudera-scm-agent but was 0755 >>[24/Aug/2017 15:43:14 +0000] 8111 MainThread agent INFO Re-using pre-existing di-rectory: /run/cloudera-scm-agent >>/usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/cmf-5.12.0-py2.7.egg/cmf/redaction.py:260: SyntaxWarning: name 'REDACTOR' is assigned to be-fore global declaration >> global REDACTOR >>/usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/cmf-5.12.0-py2.7.egg/cmf/redaction.py:261: SyntaxWarning: name 'NOP_REDACTOR' is assigned to before global declaration >> global NOP_REDACTOR >>[24/Aug/2017 15:47:19 +0000] 9518 MainThread agent INFO SCM Agent Version: 5.12.0 >>[24/Aug/2017 15:47:19 +0000] 9518 MainThread agent WARNING Expected mode 0751 for /run/cloudera-scm-agent but was 0755 >>[24/Aug/2017 15:47:19 +0000] 9518 MainThread agent INFO Re-using pre-existing di-rectory: /run/cloudera-scm-agent >>/usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/cmf-5.12.0-py2.7.egg/cmf/redaction.py:260: SyntaxWarning: name 'REDACTOR' is assigned to be-fore global declaration >> global REDACTOR >>/usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/cmf-5.12.0-py2.7.egg/cmf/redaction.py:261: SyntaxWarning: name 'NOP_REDACTOR' is assigned to before global declaration >> global NOP_REDACTOR >>[24/Aug/2017 16:46:11 +0000] 11744 MainThread agent INFO SCM Agent Version: 5.12.0 >>[24/Aug/2017 16:46:11 +0000] 11744 MainThread agent WARNING Expected mode 0751 for /run/cloudera-scm-agent but was 0755 >>[24/Aug/2017 16:46:11 +0000] 11744 MainThread agent INFO Re-using pre-existing directory: /run/cloudera-scm-agent END (0) BEGIN tail -n 50 /var/log/cloudera-scm-agent//cloudera-scm-agent.log | sed 's/^/>>/' >>[24/Aug/2017 15:47:19 +0000] 9533 MainThread agent INFO Because agent not run-ning as root, all processes will run with current user. >>[24/Aug/2017 15:47:21 +0000] 9533 MainThread agent INFO Re-using pre-existing di-rectory: /run/cloudera-scm-agent/cgroups >>[24/Aug/2017 15:47:21 +0000] 9533 MainThread cgroups INFO Found existing subsys-tem blkio at /sys/fs/cgroup/blkio >>[24/Aug/2017 15:47:21 +0000] 9533 MainThread cgroups INFO Found existing subsys-tem memory at /sys/fs/cgroup/memory >>[24/Aug/2017 15:47:21 +0000] 9533 MainThread cgroups INFO Found existing subsys-tem cpu at /sys/fs/cgroup/cpu,cpuacct >>[24/Aug/2017 15:47:21 +0000] 9533 MainThread cgroups INFO Found existing subsys-tem cpuacct at /sys/fs/cgroup/cpu,cpuacct >>[24/Aug/2017 15:47:21 +0000] 9533 MainThread cgroups WARNING Could not read capabilities from /proc/cgroups. error: sudo: no tty present and no askpass program speci-fied >> >>[24/Aug/2017 15:47:21 +0000] 9533 MainThread agent INFO No cgroups capabilities found >>[24/Aug/2017 15:47:21 +0000] 9533 MainThread agent INFO Setting up supervisord event monitor. >>[24/Aug/2017 15:47:21 +0000] 9533 MainThread filesystem_map INFO Monitored nodev filesystem types: ['nfs', 'nfs4', 'tmpfs'] >>[24/Aug/2017 15:47:21 +0000] 9533 MainThread filesystem_map INFO Using timeout of 2.000000 >>[24/Aug/2017 15:47:21 +0000] 9533 MainThread filesystem_map INFO Using join timeout of 0.100000 >>[24/Aug/2017 15:47:21 +0000] 9533 MainThread filesystem_map INFO Using tolerance of 60.000000 >>[24/Aug/2017 15:47:21 +0000] 9533 MainThread filesystem_map INFO Local filesystem types whitelist: ['ext2', 'ext3', 'ext4', 'xfs'] >>[24/Aug/2017 15:47:21 +0000] 9533 MainThread kt_renewer INFO Agent wide creden-tial cache set to /run/cloudera-scm-agent/krb5cc_cm_agent_123 >>[24/Aug/2017 15:47:21 +0000] 9533 MainThread agent INFO Using met-rics_url_timeout_seconds of 30.000000 >>[24/Aug/2017 15:47:21 +0000] 9533 MainThread agent INFO Using task_metrics_timeout_seconds of 5.000000 >>[24/Aug/2017 15:47:21 +0000] 9533 MainThread agent INFO Using max_collection_wait_seconds of 10.000000 >>[24/Aug/2017 15:47:21 +0000] 9533 MainThread metrics INFO Importing tasktracker metric schema from file /usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/cmf-5.12.0-py2.7.egg/cmf/monitor/tasktracker/schema.json >>[24/Aug/2017 15:47:21 +0000] 9533 MainThread ntp_monitor INFO Using timeout of 2.000000 >>[24/Aug/2017 15:47:21 +0000] 9533 MainThread dns_names INFO Using timeout of 30.000000 >>[24/Aug/2017 15:47:21 +0000] 9533 MainThread __init__ INFO Created DNS monitor. >>[24/Aug/2017 15:47:21 +0000] 9533 MainThread stacks_collection_manager INFO Us-ing max_uncompressed_file_size_bytes: 5242880 >>[24/Aug/2017 15:47:21 +0000] 9533 MainThread __init__ INFO Importing metric sche-ma from file /usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/cmf-5.12.0-py2.7.egg/cmf/monitor/schema.json >>[24/Aug/2017 15:47:21 +0000] 9533 MainThread agent INFO Supervised processes will add the following to their environment (in addition to the supervisor's env): {'CDH_PARQUET_HOME': '/usr/lib/parquet', 'JSVC_HOME': '/usr/libexec/bigtop-utils', 'CMF_PACKAGE_DIR': '/usr/lib/cmf/service', 'CDH_HADOOP_BIN': '/usr/bin/hadoop', 'MGMT_HOME': '/usr/share/cmf', 'CDH_IMPALA_HOME': '/usr/lib/impala', 'CDH_YARN_HOME': '/usr/lib/hadoop-yarn', 'CDH_HDFS_HOME': '/usr/lib/hadoop-hdfs', 'PATH': '/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/usr/share/maven', 'CDH_HUE_PLUGINS_HOME': '/usr/lib/hadoop', 'CM_STATUS_CODES': u'STATUS_NONE HDFS_DFS_DIR_NOT_EMPTY HBASE_TABLE_DISABLED HBASE_TABLE_ENABLED JOBTRACKER_IN_STANDBY_MODE YARN_RM_IN_STANDBY_MODE', 'KEYTRUSTEE_KP_HOME': '/usr/share/keytrustee-keyprovider', 'CLOUDERA_ORACLE_CONNECTOR_JAR': '/usr/share/java/oracle-connector-java.jar', 'CDH_SQOOP2_HOME': '/usr/lib/sqoop2', 'KEYTRUS-TEE_SERVER_HOME': '/usr/lib/keyt>>[24/Aug/2017 15:47:19 +0000] 9533 MainThread agent INFO Because agent not running as root, all processes will run with current user. >>[24/Aug/2017 15:47:21 +0000] 9533 MainThread agent INFO Re-using pre-existing di-rectory: /run/cloudera-scm-agent/cgroups >>[24/Aug/2017 15:47:21 +0000] 9533 MainThread cgroups INFO Found existing subsys-tem blkio at /sys/fs/cgroup/blkio >>[24/Aug/2017 15:47:21 +0000] 9533 MainThread cgroups INFO Found existing subsys-tem memory at /sys/fs/cgroup/memory >>[24/Aug/2017 15:47:21 +0000] 9533 MainThread cgroups INFO Found existing subsys-tem cpu at /sys/fs/cgroup/cpu,cpuacct >>[24/Aug/2017 15:47:21 +0000] 9533 MainThread cgroups INFO Found existing subsys-tem cpuacct at /sys/fs/cgroup/cpu,cpuacct >>[24/Aug/2017 15:47:21 +0000] 9533 MainThread cgroups WARNING Could not read capabilities from /proc/cgroups. error: sudo: no tty present and no askpass program speci-fied >> >>[24/Aug/2017 15:47:21 +0000] 9533 MainThread agent INFO No cgroups capabilities found >>[24/Aug/2017 15:47:21 +0000] 9533 MainThread agent INFO Setting up supervisord event monitor. >>[24/Aug/2017 15:47:21 +0000] 9533 MainThread filesystem_map INFO Monitored nodev filesystem types: ['nfs', 'nfs4', 'tmpfs'] >>[24/Aug/2017 15:47:21 +0000] 9533 MainThread filesystem_map INFO Using timeout of 2.000000 >>[24/Aug/2017 15:47:21 +0000] 9533 MainThread filesystem_map INFO Using join timeout of 0.100000 >>[24/Aug/2017 15:47:21 +0000] 9533 MainThread filesystem_map INFO Using tolerance of 60.000000 >>[24/Aug/2017 15:47:21 +0000] 9533 MainThread filesystem_map INFO Local filesystem types whitelist: ['ext2', 'ext3', 'ext4', 'xfs'] >>[24/Aug/2017 15:47:21 +0000] 9533 MainThread kt_renewer INFO Agent wide creden-tial cache set to /run/cloudera-scm-agent/krb5cc_cm_agent_123 >>[24/Aug/2017 15:47:21 +0000] 9533 MainThread agent INFO Using met-rics_url_timeout_seconds of 30.000000 >>[24/Aug/2017 15:47:21 +0000] 9533 MainThread agent INFO Using task_metrics_timeout_seconds of 5.000000 >>[24/Aug/2017 15:47:21 +0000] 9533 MainThread agent INFO Using max_collection_wait_seconds of 10.000000 >>[24/Aug/2017 15:47:21 +0000] 9533 MainThread metrics INFO Importing tasktracker metric schema from file /usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/cmf-5.12.0-py2.7.egg/cmf/monitor/tasktracker/schema.json >>[24/Aug/2017 15:47:21 +0000] 9533 MainThread ntp_monitor INFO Using timeout of 2.000000 >>[24/Aug/2017 15:47:21 +0000] 9533 MainThread dns_names INFO Using timeout of 30.000000 >>[24/Aug/2017 15:47:21 +0000] 9533 MainThread __init__ INFO Created DNS monitor. >>[24/Aug/2017 15:47:21 +0000] 9533 MainThread stacks_collection_manager INFO Us-ing max_uncompressed_file_size_bytes: 5242880 >>[24/Aug/2017 15:47:21 +0000] 9533 MainThread __init__ INFO Importing metric sche-ma from file /usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/cmf-5.12.0-py2.7.egg/cmf/monitor/schema.json >>[24/Aug/2017 15:47:21 +0000] 9533 MainThread agent INFO Supervised processes will add the following to their environment (in addition to the supervisor's env): {'CDH_PARQUET_HOME': '/usr/lib/parquet', 'JSVC_HOME': '/usr/libexec/bigtop-utils', 'CMF_PACKAGE_DIR': '/usr/lib/cmf/service', 'CDH_HADOOP_BIN': '/usr/bin/hadoop', 'MGMT_HOME': '/usr/share/cmf', 'CDH_IMPALA_HOME': '/usr/lib/impala', 'CDH_YARN_HOME': '/usr/lib/hadoop-yarn', 'CDH_HDFS_HOME': '/usr/lib/hadoop-hdfs', 'PATH': '/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/usr/share/maven', 'CDH_HUE_PLUGINS_HOME': '/usr/lib/hadoop', 'CM_STATUS_CODES': u'STATUS_NONE HDFS_DFS_DIR_NOT_EMPTY HBASE_TABLE_DISABLED HBASE_TABLE_ENABLED JOBTRACKER_IN_STANDBY_MODE YARN_RM_IN_STANDBY_MODE', 'KEYTRUSTEE_KP_HOME': '/usr/share/keytrustee-keyprovider', 'CLOUDERA_ORACLE_CONNECTOR_JAR': '/usr/share/java/oracle-connector-java.jar', 'CDH_SQOOP2_HOME': '/usr/lib/sqoop2', 'KEYTRUS-TEE_SERVER_HOME': '/usr/lib/keytrustee-server', 'CDH_MR2_HOME': '/usr/lib/hadoop-mapreduce', 'HIVE_DEFAULT_XML': '/etc/hive/conf.dist/hive-default.xml', 'CLOUDERA_POSTGRESQL_JDBC_JAR': '/usr/share/cmf/lib/postgresql-9.0-801.jdbc4.jar', 'CDH_KMS_HOME': '/usr/lib/hadoop-kms', 'CDH_HBASE_HOME': '/usr/lib/hbase', 'CDH_SQOOP_HOME': '/usr/lib/sqoop', 'WEBHCAT_DEFAULT_XML': '/etc/hive-webhcat/conf.dist/webhcat-default.xml', 'CDH_OOZIE_HOME': '/usr/lib/oozie', 'SUDO': 'sudo', 'CDH_ZOOKEEPER_HOME': '/usr/lib/zookeeper', 'CDH_HUE_HOME': '/usr/lib/hue', 'CLOUDERA_MYSQL_CONNECTOR_JAR': '/usr/share/java/mysql-connector-java.jar', 'CDH_HBASE_INDEXER_HOME': '/usr/lib/hbase-solr', 'CDH_MR1_HOME': '/usr/lib/hadoop-0.20-mapreduce', 'CDH_SOLR_HOME': '/usr/lib/solr', 'CDH_PIG_HOME': '/usr/lib/pig', 'CDH_SENTRY_HOME': '/usr/lib/sentry', 'CDH_CRUNCH_HOME': '/usr/lib/crunch', 'CDH_LLAMA_HOME': '/usr/lib/llama/', 'CDH_HTTPFS_HOME': '/usr/lib/hadoop-httpfs', 'CDH_HADOOP_HOME': '/usr/lib/hadoop', 'CDH_HIVE_HOME': '/usr/lib/hive', 'ORACLE_HOME': '/usr/share/oracle/instantclient', 'CDH_HCAT_HOME': '/usr/lib/hive-hcatalog', 'CDH_KAFKA_HOME': '/usr/lib/kafka', 'CDH_SPARK_HOME': '/usr/lib/spark', 'TOMCAT_HOME': '/usr/lib/bigtop-tomcat', 'CDH_FLUME_HOME': '/usr/lib/flume-ng'} >>[24/Aug/2017 15:47:21 +0000] 9533 MainThread agent INFO To override these varia-bles, use /etc/cloudera-scm-agent/config.ini. Environment variables for CDH locations are not used when CDH is installed from parcels. >>[24/Aug/2017 15:47:21 +0000] 9533 MainThread agent INFO Re-using pre-existing di-rectory: /run/cloudera-scm-agent/process >>[24/Aug/2017 15:47:21 +0000] 9533 MainThread agent INFO Re-using pre-existing di-rectory: /run/cloudera-scm-agent/supervisor >>[24/Aug/2017 15:47:21 +0000] 9533 MainThread agent INFO Re-using pre-existing di-rectory: /run/cloudera-scm-agent/flood >>[24/Aug/2017 15:47:21 +0000] 9533 MainThread agent INFO Re-using pre-existing di-rectory: /run/cloudera-scm-agent/supervisor/include >>[24/Aug/2017 15:47:21 +0000] 9533 MainThread agent ERROR Failed to connect to previous supervisor. >>Traceback (most recent call last): >> File "/usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/cmf-5.12.0-py2.7.egg/cmf/agent.py", line 2109, in find_or_start_supervisor >> self.configure_supervisor_clients() >> File "/usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/cmf-5.12.0-py2.7.egg/cmf/agent.py", line 2290, in configure_supervisor_clients >> supervisor_options.realize(args=["-c", os.path.join(self.supervisor_dir, "supervi-sord.conf")]) >> File "/usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/supervisor-3.0-py2.7.egg/supervisor/options.py", line 1599, in realize >> Options.realize(self, *arg, **kw) >> File "/usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/supervisor-3.0-py2.7.egg/supervisor/options.py", line 333, in realize >> self.process_config() >> File "/usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/supervisor-3.0-py2.7.egg/supervisor/options.py", line 341, in process_config >> self.process_config_file(do_usage) >> File "/usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/supervisor-3.0-py2.7.egg/supervisor/options.py", line 376, in process_config_file >> self.usage(str(msg)) >> File "/usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/supervisor-3.0-py2.7.egg/supervisor/options.py", line 164, in usage >> self.exit(2) >>SystemExit: 2 >>[24/Aug/2017 15:47:21 +0000] 9533 Dummy-1 daemonize WARNING Stopping dae-mon. >>[24/Aug/2017 15:47:21 +0000] 9533 Dummy-1 agent INFO Stopping agent... rustee-server', 'CDH_MR2_HOME': '/usr/lib/hadoop-mapreduce', 'HIVE_DEFAULT_XML': '/etc/hive/conf.dist/hive-default.xml', 'CLOUDERA_POSTGRESQL_JDBC_JAR': '/usr/share/cmf/lib/postgresql-9.0-801.jdbc4.jar', 'CDH_KMS_HOME': '/usr/lib/hadoop-kms', 'CDH_HBASE_HOME': '/usr/lib/hbase', 'CDH_SQOOP_HOME': '/usr/lib/sqoop', 'WEBHCAT_DEFAULT_XML': '/etc/hive-webhcat/conf.dist/webhcat-default.xml', 'CDH_OOZIE_HOME': '/usr/lib/oozie', 'SUDO': 'sudo', 'CDH_ZOOKEEPER_HOME': '/usr/lib/zookeeper', 'CDH_HUE_HOME': '/usr/lib/hue', 'CLOUDERA_MYSQL_CONNECTOR_JAR': '/usr/share/java/mysql-connector-java.jar', 'CDH_HBASE_INDEXER_HOME': '/usr/lib/hbase-solr', 'CDH_MR1_HOME': '/usr/lib/hadoop-0.20-mapreduce', 'CDH_SOLR_HOME': '/usr/lib/solr', 'CDH_PIG_HOME': '/usr/lib/pig', 'CDH_SENTRY_HOME': '/usr/lib/sentry', 'CDH_CRUNCH_HOME': '/usr/lib/crunch', 'CDH_LLAMA_HOME': '/usr/lib/llama/', 'CDH_HTTPFS_HOME': '/usr/lib/hadoop-httpfs', 'CDH_HADOOP_HOME': '/usr/lib/hadoop', 'CDH_HIVE_HOME': '/usr/lib/hive', 'ORACLE_HOME': '/usr/share/oracle/instantclient', 'CDH_HCAT_HOME': '/usr/lib/hive-hcatalog', 'CDH_KAFKA_HOME': '/usr/lib/kafka', 'CDH_SPARK_HOME': '/usr/lib/spark', 'TOMCAT_HOME': '/usr/lib/bigtop-tomcat', 'CDH_FLUME_HOME': '/usr/lib/flume-ng'} >>[24/Aug/2017 15:47:21 +0000] 9533 MainThread agent INFO To override these varia-bles, use /etc/cloudera-scm-agent/config.ini. Environment variables for CDH locations are not used when CDH is installed from parcels. >>[24/Aug/2017 15:47:21 +0000] 9533 MainThread agent INFO Re-using pre-existing di-rectory: /run/cloudera-scm-agent/process >>[24/Aug/2017 15:47:21 +0000] 9533 MainThread agent INFO Re-using pre-existing di-rectory: /run/cloudera-scm-agent/supervisor >>[24/Aug/2017 15:47:21 +0000] 9533 MainThread agent INFO Re-using pre-existing di-rectory: /run/cloudera-scm-agent/flood >>[24/Aug/2017 15:47:21 +0000] 9533 MainThread agent INFO Re-using pre-existing di-rectory: /run/cloudera-scm-agent/supervisor/include >>[24/Aug/2017 15:47:21 +0000] 9533 MainThread agent ERROR Failed to connect to previous supervisor. >>Traceback (most recent call last): >> File "/usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/cmf-5.12.0-py2.7.egg/cmf/agent.py", line 2109, in find_or_start_supervisor >> self.configure_supervisor_clients() >> File "/usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/cmf-5.12.0-py2.7.egg/cmf/agent.py", line 2290, in configure_supervisor_clients >> supervisor_options.realize(args=["-c", os.path.join(self.supervisor_dir, "supervi-sord.conf")]) >> File "/usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/supervisor-3.0-py2.7.egg/supervisor/options.py", line 1599, in realize >> Options.realize(self, *arg, **kw) >> File "/usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/supervisor-3.0-py2.7.egg/supervisor/options.py", line 333, in realize >> self.process_config() >> File "/usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/supervisor-3.0-py2.7.egg/supervisor/options.py", line 341, in process_config >> self.process_config_file(do_usage) >> File "/usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/supervisor-3.0-py2.7.egg/supervisor/options.py", line 376, in process_config_file >> self.usage(str(msg)) >> File "/usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/supervisor-3.0-py2.7.egg/supervisor/options.py", line 164, in usage >> self.exit(2) >>SystemExit: 2 >>[24/Aug/2017 15:47:21 +0000] 9533 Dummy-1 daemonize WARNING Stopping dae-mon. >>[24/Aug/2017 15:47:21 +0000] 9533 Dummy-1 agent INFO Stopping agent... END (0) end of agent logs. scm agent restarted Installation script completed successfully. all done closing logging file descriptor My /etc/hosts file is: 127.0.0.1 localhost #127.0.0.1 PC355406 10.x.y.z PC355406 # The following lines are desirable for IPv6 capable hosts ::1 ip6-localhost ip6-loopback fe00::0 ip6-localnet ff00::0 ip6-mcastprefix ff02::1 ip6-allnodes ff02::2 ip6-allrouters Kindly Provide me a solution.

23 REPLIES 23

avatar
Champion

if its a testing enviroment see if you can disable firewall or iptable . 

restart the cloudera manager daemons 

finally check the jvm version on the cluster make sure you dont have multiple java hanging out in the cluster

since i dont have direct access to your cluster i am throwing all my guess.

are you following the path A installation of Cloudera manager using binary file . ? 

 

https://www.cloudera.com/documentation/enterprise/5-5-x/topics/cm_ig_install_path_a.html

avatar
Master Collaborator

based on your stack trace, it's likely you're running into the same issue as a fellow community member [0], can you try the workaround posted in the [1]

 

 

[24/Aug/2017 15:47:21 +0000] 9533 MainThread agent ERROR Failed to connect to previous supervisor. 
>>Tr...f/agent/build/env/lib/python2.7/site-packages/cmf-5.12.0-py2.7.egg/cmf/agent.py", line 2109, in find_or_start_supervisor 
>> self.configure_supervisor_clients() 
>> File "/usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/cmf-5.12.0-py2.7.egg/cmf/agent.py", line 2290, in configure_supervisor_clients 
>> supervisor_options.realize(args=["-c", os.path.join(self.supervisor_dir, "supervi-sord.conf")]) 
>> File "/usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/supervisor-3.0-py2.7.egg/supervisor/options.py", line 1599, in realize 
>> Options.realize(self, *arg, **kw) 
>> File "/usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/supervisor-3.0-py2.7.egg/supervisor/options.py", line 333, in realize 
>> self.process_config() 
>> File "/usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/supervisor-3.0-py2.7.egg/supervisor/options.py", line 341, in process_config 
>> self.process_config_file(do_usage) 
>> File "/usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/supervisor-3.0-py2.7.egg/supervisor/options.py", line 376, in process_config_file >> self.usage(str(msg)) 
>> File "/usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/supervisor-3.0-py2.7.egg/supervisor/options.py", line 164, in usage 
>> self.exit(2) >>SystemExit: 2 >>[24/Aug/2017 15:47:21 +0000] 9533 Dummy-1 daemonize WARNING Stopping dae-mon. 
>>[24/Aug/2017 15:47:21 +0000] 9533 Dummy-1 agent INFO Stopping agent... 

 

[0] https://community.cloudera.com/t5/Cloudera-Manager-Installation/Cloudera-Manager-Heartbeat-Python-Su...

 

[1] http://community.cloudera.com/t5/Cloudera-Manager-Installation/CDH-5-12-0-clouder-manager-agent-can-...

 

avatar
Explorer

Hi

I have tried the solution you told me to run umount /run/user/42/gvfs command so i got this:

root@PC355406:/# for mnt in $(mount|cut -d ' ' -f 3); do stat $mnt 1>/dev/null 2>&1; rc=$?; if [ $rc -ne 0 ]; then echo "error accessing $mnt"; fi; done
error accessing /run/user/1000/gvfs
root@PC355406:/# mount
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
udev on /dev type devtmpfs (rw,nosuid,relatime,size=8151824k,nr_inodes=2037956,mode=755)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,noexec,relatime,size=1635248k,mode=755)
/dev/sda1 on / type ext4 (rw,relatime,errors=remount-ro,data=ordered)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
tmpfs on /run/lock type tmpfs (rw,nosuid,nodev,noexec,relatime,size=5120k)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
systemd-1 on /proc/sys/fs/binfmt_misc type autofs (rw,relatime,fd=26,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=13687)
mqueue on /dev/mqueue type mqueue (rw,relatime)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime)
fusectl on /sys/fs/fuse/connections type fusectl (rw,relatime)
tmpfs on /run/user/123 type tmpfs (rw,nosuid,nodev,relatime,size=1635248k,mode=700,uid=123,gid=130)
tmpfs on /run/user/1000 type tmpfs (rw,nosuid,nodev,relatime,size=1635248k,mode=700,uid=1000,gid=1000)
gvfsd-fuse on /run/user/1000/gvfs type fuse.gvfsd-fuse (rw,nosuid,nodev,relatime,user_id=1000,group_id=1000)
root@PC355406:/# df -h
Filesystem      Size  Used Avail Use% Mounted on
udev            7.8G     0  7.8G   0% /dev
tmpfs           1.6G  9.7M  1.6G   1% /run
/dev/sda1       902G  8.7G  847G   2% /
tmpfs           7.8G   55M  7.8G   1% /dev/shm
tmpfs           5.0M  4.0K  5.0M   1% /run/lock
tmpfs           7.8G     0  7.8G   0% /sys/fs/cgroup
tmpfs           1.6G     0  1.6G   0% /run/user/123
tmpfs           1.6G   68K  1.6G   1% /run/user/1000
root@PC355406:/# umount /run/user/42/gvfs
umount: /run/user/42/gvfs: mountpoint not found
root@PC355406:/# umount /run/user/42
umount: /run/user/42: mountpoint not found
root@PC355406:/# file /etc/alternatives/java /etc/alternatives/javac
/etc/alternatives/java:  symbolic link to /usr/local/java/jdk1.8.0_144/bin/java
/etc/alternatives/javac: symbolic link to /usr/lib/jvm/j2sdk1.6-oracle/bin/javac
root@PC355406:/# update-java-alternatives -l
j2sdk1.6-oracle                315        /usr/lib/jvm/j2sdk1.6-oracle
java-1.8.0-openjdk-amd64       1081       /usr/lib/jvm/java-1.8.0-openjdk-amd64
root@PC355406:/# java -version
java version "1.8.0_144"
Java(TM) SE Runtime Environment (build 1.8.0_144-b01)
Java HotSpot(TM) 64-Bit Server VM (build 25.144-b01, mixed mode)
root@PC355406:/# javac -version
javac 1.6.0_31
root@PC355406:/# gedit /etc/hosts

** (gedit:10775): WARNING **: Set document metadata failed: Setting attribute metadata::gedit-position not supported

Inside this my java version is also shown.

 

Also now i tried to install the cluster i got this error log:

/tmp/scm_prepare_node.tPO3N5DM 
using SSH_CLIENT to get the SCM hostname: 10.237.36.112 52464 22 
opening logging file descriptor 
Starting installation script...
Acquiring installation lock...
BEGIN flock 4 
END (0) 
Detecting root privileges...
effective UID is 1000 
BEGIN which pbrun 
END (1) 
BEGIN sudo -S id 
uid=0(root) gid=0(root) groups=0(root) 
END (0) 
Using 'sudo ' to acquire root privileges 
Detecting distribution...
BEGIN grep 'Ubuntu' /etc/lsb-release 
END (0) 
DISTRIB_ID=Ubuntu 
DISTRIB_DESCRIPTION="Ubuntu 16.04.2 LTS" 
BEGIN grep DISTRIB_CODENAME /etc/lsb-release 
END (0) 
DISTRIB_CODENAME=xenial 
BEGIN echo DISTRIB_CODENAME=xenial | cut -d = -f 2 
xenial 
END (0) 
Detecting Cloudera Manager Server...
BEGIN host -t PTR 10.237.36.112 
END (1) 
Host 112.36.237.10.in-addr.arpa. not found: 3(NXDOMAIN) 
BEGIN which python 
END (0) 
BEGIN python -c 'import socket; import sys; s = socket.socket(socket.AF_INET); s.settimeout(5.0); s.connect((sys.argv[1], int(sys.argv[2]))); s.close();' 10.237.36.112 7182 
/usr/bin/python 
END (0) 
BEGIN which wget 
END (0) 
/usr/bin/wget 
BEGIN wget -qO- -T 1 -t 1 http://169.254.169.254/latest/meta-data/public-hostname && /bin/echo 
END (4) 
Installing package repositories...
validating format of repository file /tmp/scm_prepare_node.tPO3N5DM/repos/ubuntu_xenial/cloudera-manager.list 
installing repository file /tmp/scm_prepare_node.tPO3N5DM/repos/ubuntu_xenial/cloudera-manager.list 
repository file /tmp/scm_prepare_node.tPO3N5DM/repos/ubuntu_xenial/cloudera-manager.list installed 
BEGIN sudo apt-key add /tmp/scm_prepare_node.tPO3N5DM/archive.key 
OK 
END (0) 
installing priority file /tmp/scm_prepare_node.tPO3N5DM/priorities/ubuntu_xenial/cloudera.pref 
priority file /tmp/scm_prepare_node.tPO3N5DM/priorities/ubuntu_xenial/cloudera.pref installed 
Refreshing package metadata...
BEGIN sudo apt-get update 
Hit:1 http://repo.mysql.com/apt/ubuntu xenial InRelease 
Hit:2 http://archive.cloudera.com/cm5/ubuntu/xenial/amd64/cm xenial-cm5 InRelease 
Hit:3 https://archive.cloudera.com/cdh5/ubuntu/precise/amd64/cdh precise-cdh5 InRelease 
Hit:4 http://security.ubuntu.com/ubuntu xenial-security InRelease 
Hit:5 https://archive.cloudera.com/cm5/ubuntu/xenial/amd64/cm xenial-cm5.12.0 InRelease 
Hit:6 http://in.archive.ubuntu.com/ubuntu xenial InRelease 
Hit:7 http://in.archive.ubuntu.com/ubuntu xenial-updates InRelease 
Hit:8 http://in.archive.ubuntu.com/ubuntu xenial-backports InRelease 
W: http://archive.cloudera.com/cm5/ubuntu/xenial/amd64/cm/dists/xenial-cm5/InRelease: Signature by key F36A89E33CC1BD0F71079007327574EE02A818DD uses weak digest algorithm (SHA1) 
W: https://archive.cloudera.com/cdh5/ubuntu/precise/amd64/cdh/dists/precise-cdh5/InRelease: Signature by key F36A89E33CC1BD0F71079007327574EE02A818DD uses weak digest algorithm (SHA1) 
W: https://archive.cloudera.com/cm5/ubuntu/xenial/amd64/cm/dists/xenial-cm5.12.0/InRelease: Signature by key F36A89E33CC1BD0F71079007327574EE02A818DD uses weak digest algorithm (SHA1) 
E: Could not get lock /var/lib/dpkg/lock - open (11: Resource temporarily unavailable) 
E: Unable to lock the administration directory (/var/lib/dpkg/), is another process using it? 
END (100) 
BEGIN sudo apt-get update 
Hit:1 http://repo.mysql.com/apt/ubuntu xenial InRelease 
Hit:2 http://archive.cloudera.com/cm5/ubuntu/xenial/amd64/cm xenial-cm5 InRelease 
Hit:3 https://archive.cloudera.com/cdh5/ubuntu/precise/amd64/cdh precise-cdh5 InRelease 
Hit:4 https://archive.cloudera.com/cm5/ubuntu/xenial/amd64/cm xenial-cm5.12.0 InRelease 
Hit:5 http://in.archive.ubuntu.com/ubuntu xenial InRelease 
Hit:6 http://security.ubuntu.com/ubuntu xenial-security InRelease 
Hit:7 http://in.archive.ubuntu.com/ubuntu xenial-updates InRelease 
Hit:8 http://in.archive.ubuntu.com/ubuntu xenial-backports InRelease 
W: http://archive.cloudera.com/cm5/ubuntu/xenial/amd64/cm/dists/xenial-cm5/InRelease: Signature by key F36A89E33CC1BD0F71079007327574EE02A818DD uses weak digest algorithm (SHA1) 
W: https://archive.cloudera.com/cdh5/ubuntu/precise/amd64/cdh/dists/precise-cdh5/InRelease: Signature by key F36A89E33CC1BD0F71079007327574EE02A818DD uses weak digest algorithm (SHA1) 
W: https://archive.cloudera.com/cm5/ubuntu/xenial/amd64/cm/dists/xenial-cm5.12.0/InRelease: Signature by key F36A89E33CC1BD0F71079007327574EE02A818DD uses weak digest algorithm (SHA1) 
E: Could not get lock /var/lib/dpkg/lock - open (11: Resource temporarily unavailable) 
E: Unable to lock the administration directory (/var/lib/dpkg/), is another process using it? 
END (100) 
Installing cloudera-manager-agent package...
BEGIN sudo dpkg -l cloudera-manager-agent | grep -E '^ii[[:space:]]*cloudera-manager-agent[[:space:]]*' 
ii cloudera-manager-agent 5.12.0-1.cm5120.p0.120~xenial-cm5 amd64 The Cloudera Manager Agent 
END (0) 
BEGIN echo oracle-j2sdk1.6 oracle-j2sdk1.7 cloudera-manager-agent cloudera-manager-daemons | grep cloudera-manager-agent 
oracle-j2sdk1.6 oracle-j2sdk1.7 cloudera-manager-agent cloudera-manager-daemons 
END (0) 
BEGIN sudo apt-cache show cloudera-manager-agent 
Package: cloudera-manager-agent 
Source: enterprise 
Version: 5.12.0-1.cm5120.p0.120~xenial-cm5 
Architecture: amd64 
Maintainer: Cloudera Inc. <https://issues.cloudera.org> 
Installed-Size: 44039 
Depends: libc6 (>= 2.17), libcomerr2 (>= 1.01), libgcc1 (>= 1:3.0), libgssapi-krb5-2 (>= 1.10+dfsg~), libkrb5-3 (>= 1.6.dfsg.2), libssl1.0.0 (>= 1.0.2~beta3), libstdc++6 (>= 5.2), zlib1g (>= 1:1.2.0), lsb-base, psmisc, bash, libsasl2-modules, libsasl2-modules-gssapi-mit, libxslt1.1, libsqlite3-0, openssl, libssl-dev, libfuse2, fuse-utils | fuse, rpcbind, cloudera-manager-daemons (= 5.12.0-1.cm5120.p0.120~xenial-cm5), perl, python-psycopg2, python-mysqldb, apache2, iproute2 
Homepage: http://www.cloudera.com 
Priority: extra 
Section: misc 
Filename: pool/contrib/e/enterprise/cloudera-manager-agent_5.12.0-1.cm5120.p0.120~xenial-cm5_amd64.deb 
Size: 11186376 
SHA256: 69618949fb10d631ac301f21f62ecab0a3631eec456b6de43ef9c6a17c107498 
SHA1: 6b137a4328780d56f964403ff8c56fe7577935a0 
MD5sum: f7c9fc2b393b6d61563ea34ca15b6e61 
Description: The Cloudera Manager Agent 
The Agent is deployed to machines running services managed by Cloudera Manager. 
Description-md5: 482a592ee859d31443f58aa3e48fe303 

END (0) 
Version: 5.12.0-1.cm5120.p0.120~xenial-cm5 
BEGIN sudo apt-get -o Dpkg::Options::=--force-confdef -o Dpkg::Options::=--force-confold -y install cloudera-manager-agent 
E: Could not get lock /var/lib/dpkg/lock - open (11: Resource temporarily unavailable) 
E: Unable to lock the administration directory (/var/lib/dpkg/), is another process using it? 
END (100) 
remote package cloudera-manager-agent could not be installed, giving up 
waiting for rollback request 

 Please help me with that.

Also i am using path A installation only.

avatar
Explorer

Hi my iptables are :

 

 sudo sysv-rc-conf iptables –list

root@PC355406:/# sudo sysv-rc-conf iptables --list
acpid        2:on	3:on	4:on	5:on
alsa-utils   0:off	1:off	6:off	S:on
anacron      2:on	3:on	4:on	5:on
apache-htcac 0:off	1:off	2:off	3:off	4:off	5:off	6:off
apache2      0:off	1:off	2:on	3:on	4:on	5:on	6:off
apparmor     S:on
apport       2:on	3:on	4:on	5:on
avahi-daemon 0:off	1:off	2:on	3:on	4:on	5:on	6:off
bluetooth    0:off	1:off	2:on	3:on	4:on	5:on	6:off
brltty       S:on
cloudera-scm 0:off	1:off	2:on	3:on	4:on	5:on	6:off
cloudera-scm 0:off	1:off	2:on	3:on	4:on	5:on	6:off
cloudera-scm 0:off	1:off	2:on	3:on	4:on	5:on	6:off
console-setu S:on
cron         2:on	3:on	4:on	5:on
cups         1:off	2:on	3:on	4:on	5:on
cups-browsed 0:off	1:off	2:on	3:on	4:on	5:on	6:off
dbus         2:on	3:on	4:on	5:on
dns-clean    S:on
grub-common  2:on	3:on	4:on	5:on
halt         0:off
irqbalance   0:off	1:off	2:on	3:on	4:on	5:on	6:off
kerneloops   0:off	1:off	2:on	3:on	4:on	5:on	6:off
keyboard-set S:on
killprocs    1:on
kmod         S:on
lightdm      0:off	1:off	2:on	3:on	4:on	5:on	6:off
mysql        0:off	1:off	2:on	3:on	4:on	5:on	6:off
network-mana
networking   0:off	6:off	S:on
ondemand     2:on	3:on	4:on	5:on
plymouth     0:off	2:on	3:on	4:on	5:on	6:off
plymouth-log S:on
postgresql   0:off	1:off	2:on	3:on	4:on	5:on	6:off
pppd-dns     S:on
procps       S:on
rc.local     2:on	3:on	4:on	5:on
reboot       6:off
resolvconf   0:off	6:off	S:on
rpcbind      0:off	1:off	6:off	S:on
rsync        2:on	3:on	4:on	5:on
rsyslog      0:off	1:off	2:on	3:on	4:on	5:on	6:off
saned        1:off	2:on	3:on	4:on	5:on
sendsigs     0:off	6:off
single       1:on
speech-dispa 0:off	1:off	2:on	3:on	4:on	5:on	6:off
ssh          2:on	3:on	4:on	5:on
sysstat      2:on	3:on	4:on	5:on
thermald     0:off	1:off	2:on	3:on	4:on	5:on	6:off
udev         S:on
ufw          1:off	S:on
umountfs     0:off	6:off
umountroot   0:off	6:off
unattended-u 0:off	6:off
urandom      0:off	6:off	S:on
uuidd        0:off	1:off	2:on	3:on	4:on	5:on	6:off
whoopsie     1:off	2:on	3:on	4:on	5:on
x11-common   S:on

also java versions are:

 

root@PC355406:/# file /etc/alternatives/java /etc/alternatives/javac
/etc/alternatives/java:  symbolic link to /usr/local/java/jdk1.8.0_144/bin/java
/etc/alternatives/javac: symbolic link to /usr/lib/jvm/j2sdk1.6-oracle/bin/javac
root@PC355406:/# update-java-alternatives -l
j2sdk1.6-oracle                315        /usr/lib/jvm/j2sdk1.6-oracle
java-1.8.0-openjdk-amd64       1081       /usr/lib/jvm/java-1.8.0-openjdk-amd64
root@PC355406:/# java -version
java version "1.8.0_144"
Java(TM) SE Runtime Environment (build 1.8.0_144-b01)
Java HotSpot(TM) 64-Bit Server VM (build 25.144-b01, mixed mode)
root@PC355406:/# javac -version
javac 1.6.0_31

and i am following the path A installation process only.

 

Kindly tell me if any changes required.

Thanks

avatar
Master Collaborator

The bash for loop that you executed indicated which mount point is inaccessible, you should try umounting that and see if you can progress.

 

root@PC355406:/# for mnt in $(mount|cut -d ' ' -f 3); do stat $mnt 1>/dev/null 2>&1; rc=$?; if [ $rc -ne 0 ]; then echo "error accessing $mnt"; fi; done
error accessing /run/user/1000/gvfs

 

avatar
Explorer

Hi,

 

I have unmounted that and now after executing that loop there is no error but still i am not able to install cluster. Same erro is there.

Please help.

 

Thanks,

Amit

avatar
Master Collaborator

Hi Amit,

 

The solution I've provided was for the issue you've reported initially/at the begining of this thread, I can see that you are reporting multiple issues. Would you mind clarifying what you meant "Same error is there.", this is so I or a community member can guide you accordingly.

 

Thank you,

M

avatar
Explorer

Hi,

 

By mentioning "same error", i mean to say that i am still not able to install cluster in cloudera as it is still giving me the error "Unable to find heartbeat". There are 5 possible error mentioned in details which i already removed ("As i off i think so"). Above i have sent the logs of error i am getting alongwith my iptables view and  /etc/cloudera-scm-agent/config.ini file so that u can tell me whats exactly the error is. Also i have sent the details of my etc/hosts file and my hostname.

Kindly help me with issue.

 

Thanks,

Amit Kumar

avatar
Master Collaborator

Hi Amit,

 

Looking into the errors your've posted the initial issue can be likely resolved using the workaround I've posted initially. The second issue is likely that an old apt thread is locking the package manager, see below. You might need to kill the other process which is holding the lock, once you've done so it will allow the package manager to proceed with the installation. 

 

...
E: Could not get lock /var/lib/dpkg/lock - open (11: Resource temporarily unavailable) E: Unable to lock the administration directory (/var/lib/dpkg/), is another process using it?
...

 

Best,

 

Michalis

avatar
Explorer

Hi,

That error is resolved thanks for help. But i am stuck at "Failed to receive heartbeat from agent".

/tmp/scm_prepare_node.bK5vQRgw 
using SSH_CLIENT to get the SCM hostname: 10.x.y.z 38830 22 
opening logging file descriptor 
Starting installation script... Acquiring installation lock...
BEGIN flock 4 
END (0) 
Detecting root privileges...
effective UID is 0 
Detecting distribution...
BEGIN grep 'Ubuntu' /etc/lsb-release 
DISTRIB_ID=Ubuntu 
DISTRIB_DESCRIPTION="Ubuntu 16.04.2 LTS" 
END (0) 
BEGIN grep DISTRIB_CODENAME /etc/lsb-release 
END (0) 
DISTRIB_CODENAME=xenial 
BEGIN echo DISTRIB_CODENAME=xenial | cut -d = -f 2 
xenial 
END (0) 
Detecting Cloudera Manager Server...
BEGIN host -t PTR 10.x.y.z
Host z.y.x.10.in-addr.arpa. not found: 3(NXDOMAIN) 
END (1) 
BEGIN which python 
/usr/bin/python 
END (0) 
BEGIN python -c 'import socket; import sys; s = socket.socket(socket.AF_INET); s.settimeout(5.0); s.connect((sys.argv[1], int(sys.argv[2]))); s.close();' 10.x.y.z 7182 
END (0) 
BEGIN which wget 
/usr/bin/wget 
END (0) 
BEGIN wget -qO- -T 1 -t 1 http://169.254.169.254/latest/meta-data/public-hostname && /bin/echo 
END (4) 
Installing package repositories...
validating format of repository file /tmp/scm_prepare_node.bK5vQRgw/repos/ubuntu_xenial/cloudera-manager.list 
installing repository file /tmp/scm_prepare_node.bK5vQRgw/repos/ubuntu_xenial/cloudera-manager.list 
repository file /tmp/scm_prepare_node.bK5vQRgw/repos/ubuntu_xenial/cloudera-manager.list installed 
BEGIN apt-key add /tmp/scm_prepare_node.bK5vQRgw/archive.key 
OK 
END (0) 
installing priority file /tmp/scm_prepare_node.bK5vQRgw/priorities/ubuntu_xenial/cloudera.pref 
priority file /tmp/scm_prepare_node.bK5vQRgw/priorities/ubuntu_xenial/cloudera.pref in-stalled 
Refreshing package metadata...
BEGIN apt-get update 
Hit:1 http://archive.cloudera.com/cm5/ubuntu/xenial/amd64/cm xenial-cm5 InRelease 
Hit:2 https://archive.cloudera.com/cdh5/ubuntu/precise/amd64/cdh precise-cdh5 InRe-lease 
Hit:3 http://repo.mysql.com/apt/ubuntu xenial InRelease 
Hit:4 https://archive.cloudera.com/cm5/ubuntu/xenial/amd64/cm xenial-cm5.12.0 InRe-lease 
Hit:5 http://in.archive.ubuntu.com/ubuntu xenial InRelease 
Get:6 http://security.ubuntu.com/ubuntu xenial-security InRelease [102 kB] 
Get:7 http://in.archive.ubuntu.com/ubuntu xenial-updates InRelease [102 kB] 
Get:8 http://security.ubuntu.com/ubuntu xenial-security/main amd64 DEP-11 Metadata [60.2 kB] 
Get:9 http://security.ubuntu.com/ubuntu xenial-security/main DEP-11 64x64 Icons [52.0 kB]
Get:10 http://in.archive.ubuntu.com/ubuntu xenial-backports InRelease [102 kB] 
Get:11 http://in.archive.ubuntu.com/ubuntu xenial-updates/main amd64 DEP-11 Metada-ta [305 kB] 
Get:12 http://security.ubuntu.com/ubuntu xenial-security/universe amd64 DEP-11 Metadata [48.8 kB] 
Get:13 http://security.ubuntu.com/ubuntu xenial-security/universe DEP-11 64x64 Icons [64.2 kB] 
Get:14 http://in.archive.ubuntu.com/ubuntu xenial-updates/main DEP-11 64x64 Icons [206 kB] 
Get:15 http://in.archive.ubuntu.com/ubuntu xenial-updates/universe amd64 DEP-11 Metadata [171 kB] 
Get:16 http://in.archive.ubuntu.com/ubuntu xenial-updates/universe DEP-11 64x64 Icons [224 kB] 
Get:17 http://in.archive.ubuntu.com/ubuntu xenial-updates/multiverse amd64 DEP-11 Metadata [5,892 B] 
Get:18 http://in.archive.ubuntu.com/ubuntu xenial-backports/main amd64 DEP-11 Metadata [3,324 B] 
Get:19 http://in.archive.ubuntu.com/ubuntu xenial-backports/universe amd64 DEP-11 Metadata [5,136 B] 
Fetched 1,451 kB in 6s (241 kB/s) 
Reading package lists... 
W: http://archive.cloudera.com/cm5/ubuntu/xenial/amd64/cm/dists/xenial-cm5/InRelease: Signature by key F36A89E33CC1BD0F71079007327574EE02A818DD uses weak digest algorithm (SHA1) 
W: https://archive.cloudera.com/cdh5/ubuntu/precise/amd64/cdh/dists/precise-cdh5/InRelease: Signature by key F36A89E33CC1BD0F71079007327574EE02A818DD uses weak digest algorithm (SHA1) 
W: https://archive.cloudera.com/cm5/ubuntu/xenial/amd64/cm/dists/xenial-cm5.12.0/InRelease: Signature by key F36A89E33CC1BD0F71079007327574EE02A818DD uses weak digest algorithm (SHA1) 
END (0) 
BEGIN apt-get update 
Hit:1 http://repo.mysql.com/apt/ubuntu xenial InRelease 
Hit:2 http://archive.cloudera.com/cm5/ubuntu/xenial/amd64/cm xenial-cm5 InRelease 
Hit:3 https://archive.cloudera.com/cdh5/ubuntu/precise/amd64/cdh precise-cdh5 InRe-lease 
Hit:4 https://archive.cloudera.com/cm5/ubuntu/xenial/amd64/cm xenial-cm5.12.0 InRe-lease 
Hit:5 http://security.ubuntu.com/ubuntu xenial-security InRelease 
Hit:6 http://in.archive.ubuntu.com/ubuntu xenial InRelease 
Hit:7 http://in.archive.ubuntu.com/ubuntu xenial-updates InRelease 
Hit:8 http://in.archive.ubuntu.com/ubuntu xenial-backports InRelease 
Reading package lists... 
W: http://archive.cloudera.com/cm5/ubuntu/xenial/amd64/cm/dists/xenial-cm5/InRelease: Signature by key F36A89E33CC1BD0F71079007327574EE02A818DD uses weak digest algorithm (SHA1) 
W: https://archive.cloudera.com/cdh5/ubuntu/precise/amd64/cdh/dists/precise-cdh5/InRelease: Signature by key F36A89E33CC1BD0F71079007327574EE02A818DD uses weak digest algorithm (SHA1) 
W: https://archive.cloudera.com/cm5/ubuntu/xenial/amd64/cm/dists/xenial-cm5.12.0/InRelease: Signature by key F36A89E33CC1BD0F71079007327574EE02A818DD uses weak digest algorithm (SHA1) 
END (0) 
Installing cloudera-manager-agent package...
BEGIN dpkg -l cloudera-manager-agent | grep -E '^ii[[:space:]]*cloudera-manager-agent[[:space:]]*' 
ii cloudera-manager-agent 5.12.0-1.cm5120.p0.120~xenial-cm5 amd64 The Cloudera Manager Agent 
END (0) 
BEGIN echo oracle-j2sdk1.6 oracle-j2sdk1.7 cloudera-manager-agent cloudera-manager-daemons | grep cloudera-manager-agent 
oracle-j2sdk1.6 oracle-j2sdk1.7 cloudera-manager-agent cloudera-manager-daemons 
END (0) 
BEGIN apt-cache show cloudera-manager-agent 
Package: cloudera-manager-agent 
Source: enterprise 
Version: 5.12.0-1.cm5120.p0.120~xenial-cm5 
Architecture: amd64 
Maintainer: Cloudera Inc. <https://issues.cloudera.org> 
Installed-Size: 44039 
Depends: libc6 (>= 2.17), libcomerr2 (>= 1.01), libgcc1 (>= 1:3.0), libgssapi-krb5-2 (>= 1.10+dfsg~), libkrb5-3 (>= 1.6.dfsg.2), libssl1.0.0 (>= 1.0.2~beta3), libstdc++6 (>= 5.2), zlib1g (>= 1:1.2.0), lsb-base, psmisc, bash, libsasl2-modules, libsasl2-modules-gssapi-mit, libxslt1.1, libsqlite3-0, openssl, libssl-dev, libfuse2, fuse-utils | fuse, rpcbind, cloudera-manager-daemons (= 5.12.0-1.cm5120.p0.120~xenial-cm5), perl, python-psycopg2, py-thon-mysqldb, apache2, iproute2 
Homepage: http://www.cloudera.com 
Priority: extra 
Section: misc 
Filename: pool/contrib/e/enterprise/cloudera-manager-agent_5.12.0-1.cm5120.p0.120~xenial-cm5_amd64.deb 
Size: 11186376 
SHA256: 69618949fb10d631ac301f21f62ecab0a3631eec456b6de43ef9c6a17c107498 
SHA1: 6b137a4328780d56f964403ff8c56fe7577935a0 
MD5sum: f7c9fc2b393b6d61563ea34ca15b6e61 
Description: The Cloudera Manager Agent 
The Agent is deployed to machines running services managed by Cloudera Manager. 
Description-md5: 482a592ee859d31443f58aa3e48fe303 

END (0) 
Version: 5.12.0-1.cm5120.p0.120~xenial-cm5 
BEGIN apt-get -o Dpkg::Options::=--force-confdef -o Dpkg::Options::=--force-confold -y in-stall cloudera-manager-agent 
Reading package lists... 
Building dependency tree... 
Reading state information... 
cloudera-manager-agent is already the newest version (5.12.0-1.cm5120.p0.120~xenial-cm5).
0 upgraded, 0 newly installed, 0 to remove and 347 not upgraded. 
END (0) 
remote package cloudera-manager-agent installed 
Installing cloudera-manager-daemons package...
BEGIN dpkg -l cloudera-manager-daemons | grep -E '^ii[[:space:]]*cloudera-manager-daemons[[:space:]]*' 
ii cloudera-manager-daemons 5.12.0-1.cm5120.p0.120~xenial-cm5 all Provides daemons for monitoring Hadoop and related tools. 
END (0) 
BEGIN echo oracle-j2sdk1.6 oracle-j2sdk1.7 cloudera-manager-agent cloudera-manager-daemons | grep cloudera-manager-daemons 
oracle-j2sdk1.6 oracle-j2sdk1.7 cloudera-manager-agent cloudera-manager-daemons 
END (0) 
BEGIN apt-cache show cloudera-manager-daemons 
Package: cloudera-manager-daemons 
Source: enterprise 
Version: 5.12.0-1.cm5120.p0.120~xenial-cm5 
Architecture: all 
Maintainer: Cloudera Inc. <https://issues.cloudera.org> 
Installed-Size: 869404 
Depends: perl 
Homepage: http://www.cloudera.com 
Priority: extra 
Section: misc 
Filename: pool/contrib/e/enterprise/cloudera-manager-daemons_5.12.0-1.cm5120.p0.120~xenial-cm5_all.deb 
Size: 737883268 
SHA256: cf168ac13387bef54c61034e7cfef49539b1616cfb876f91db5dfe458d237780 
SHA1: a18ed00de131d0c358411104fb3d886e0c211101 
MD5sum: 47813b5493281f58b36ca33868229394 
Description: Provides daemons for monitoring Hadoop and related tools. 
Provides daemons for monitoring Hadoop and related tools. 
Description-md5: 35bb5bc8fc2f296f791c3bda9e345340 

END (0) 
Version: 5.12.0-1.cm5120.p0.120~xenial-cm5 
BEGIN apt-get -o Dpkg::Options::=--force-confdef -o Dpkg::Options::=--force-confold -y in-stall cloudera-manager-daemons 
Reading package lists... 
Building dependency tree... 
Reading state information... 
cloudera-manager-daemons is already the newest version (5.12.0-1.cm5120.p0.120~xenial-cm5). 
0 upgraded, 0 newly installed, 0 to remove and 347 not upgraded. 
END (0) 
remote package cloudera-manager-daemons installed 
Installing Unlimited Strength Encryption policy files.
Installation not requested. Step will be skipped. 
Configuring Cloudera Manager Agent...
BEGIN grep server_host=10.x.y.z /etc/cloudera-scm-agent/config.ini 
server_host=10.x.y.z 
END (0) 
scm agent is already configured 
BEGIN sed -e 's/#\(USER=.*\)/\1/' -i /etc/default/cloudera-scm-agent 
END (0) 
Starting Cloudera Manager Agent...
BEGIN /usr/sbin/service cloudera-scm-agent status 
* cloudera-scm-agent.service - LSB: Cloudera SCM Agent 
Loaded: loaded (/etc/init.d/cloudera-scm-agent; bad; vendor preset: enabled) 
Active: active (exited) since Thu 2017-08-24 15:47:19 IST; 58min ago 
Docs: man:systemd-sysv-generator(8) 
Process: 9473 ExecStop=/etc/init.d/cloudera-scm-agent stop (code=exited, sta-tus=0/SUCCESS) 
Process: 9496 ExecStart=/etc/init.d/cloudera-scm-agent start (code=exited, sta-tus=0/SUCCESS) 

Aug 24 15:47:17 PC355406 systemd[1]: Starting LSB: Cloudera SCM Agent... 
Aug 24 15:47:17 PC355406 su[9516]: Successful su for cloudera-scm by root 
Aug 24 15:47:17 PC355406 su[9516]: + ??? root:cloudera-scm 
Aug 24 15:47:17 PC355406 su[9516]: pam_unix(su:session): session opened for user cloudera-scm by (uid=0) 
Aug 24 15:47:19 PC355406 cloudera-scm-agent[9496]: Starting cloudera-scm-agent: * cloudera-scm-agent started 
Aug 24 15:47:19 PC355406 systemd[1]: Started LSB: Cloudera SCM Agent. 
END (0) 
BEGIN /usr/sbin/service cloudera-scm-agent restart 
END (0) 
agent logs: 
BEGIN tail -n 50 /var/log/cloudera-scm-agent//cloudera-scm-agent.out | sed 's/^/>>/' 
>>[24/Aug/2017 12:55:20 +0000] 1442 MainThread agent INFO Re-using pre-existing di-rectory: /run/cloudera-scm-agent 
>>/usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/cmf-5.12.0-py2.7.egg/cmf/redaction.py:260: SyntaxWarning: name 'REDACTOR' is assigned to be-fore global declaration 
>> global REDACTOR 
>>/usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/cmf-5.12.0-py2.7.egg/cmf/redaction.py:261: SyntaxWarning: name 'NOP_REDACTOR' is assigned to before global declaration 
>> global NOP_REDACTOR 
>>[24/Aug/2017 13:03:49 +0000] 1426 MainThread agent INFO SCM Agent Version: 5.12.0 
>>[24/Aug/2017 13:03:49 +0000] 1426 MainThread agent WARNING Expected mode 0751 for /run/cloudera-scm-agent but was 0755 
>>[24/Aug/2017 13:03:49 +0000] 1426 MainThread agent INFO Re-using pre-existing di-rectory: /run/cloudera-scm-agent 
>>/usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/cmf-5.12.0-py2.7.egg/cmf/redaction.py:260: SyntaxWarning: name 'REDACTOR' is assigned to be-fore global declaration 
>> global REDACTOR 
>>/usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/cmf-5.12.0-py2.7.egg/cmf/redaction.py:261: SyntaxWarning: name 'NOP_REDACTOR' is assigned to before global declaration 
>> global NOP_REDACTOR 
>>[24/Aug/2017 13:06:32 +0000] 4147 MainThread agent INFO SCM Agent Version: 5.12.0 
>>[24/Aug/2017 13:06:32 +0000] 4147 MainThread agent WARNING Expected mode 0751 for /run/cloudera-scm-agent but was 0755 
>>[24/Aug/2017 13:06:32 +0000] 4147 MainThread agent INFO Re-using pre-existing di-rectory: /run/cloudera-scm-agent 
>>/usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/cmf-5.12.0-py2.7.egg/cmf/redaction.py:260: SyntaxWarning: name 'REDACTOR' is assigned to be-fore global declaration 
>> global REDACTOR 
>>/usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/cmf-5.12.0-py2.7.egg/cmf/redaction.py:261: SyntaxWarning: name 'NOP_REDACTOR' is assigned to before global declaration 
>> global NOP_REDACTOR 
>>[24/Aug/2017 15:38:40 +0000] 6308 MainThread agent INFO SCM Agent Version: 5.12.0 
>>[24/Aug/2017 15:38:40 +0000] 6308 MainThread agent WARNING Expected mode 0751 for /run/cloudera-scm-agent but was 0755 
>>[24/Aug/2017 15:38:40 +0000] 6308 MainThread agent INFO Re-using pre-existing di-rectory: /run/cloudera-scm-agent 
>>/usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/cmf-5.12.0-py2.7.egg/cmf/redaction.py:260: SyntaxWarning: name 'REDACTOR' is assigned to be-fore global declaration 
>> global REDACTOR 
>>/usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/cmf-5.12.0-py2.7.egg/cmf/redaction.py:261: SyntaxWarning: name 'NOP_REDACTOR' is assigned to before global declaration 
>> global NOP_REDACTOR 
>>[24/Aug/2017 15:40:25 +0000] 7651 MainThread agent INFO SCM Agent Version: 5.12.0 
>>[24/Aug/2017 15:40:25 +0000] 7651 MainThread agent WARNING Expected mode 0751 for /run/cloudera-scm-agent but was 0755 
>>[24/Aug/2017 15:40:25 +0000] 7651 MainThread agent INFO Re-using pre-existing di-rectory: /run/cloudera-scm-agent 
>>/usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/cmf-5.12.0-py2.7.egg/cmf/redaction.py:260: SyntaxWarning: name 'REDACTOR' is assigned to be-fore global declaration 
>> global REDACTOR 
>>/usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/cmf-5.12.0-py2.7.egg/cmf/redaction.py:261: SyntaxWarning: name 'NOP_REDACTOR' is assigned to before global declaration 
>> global NOP_REDACTOR 
>>[24/Aug/2017 15:43:14 +0000] 8111 MainThread agent INFO SCM Agent Version: 5.12.0 
>>[24/Aug/2017 15:43:14 +0000] 8111 MainThread agent WARNING Expected mode 0751 for /run/cloudera-scm-agent but was 0755 
>>[24/Aug/2017 15:43:14 +0000] 8111 MainThread agent INFO Re-using pre-existing di-rectory: /run/cloudera-scm-agent 
>>/usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/cmf-5.12.0-py2.7.egg/cmf/redaction.py:260: SyntaxWarning: name 'REDACTOR' is assigned to be-fore global declaration 
>> global REDACTOR 
>>/usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/cmf-5.12.0-py2.7.egg/cmf/redaction.py:261: SyntaxWarning: name 'NOP_REDACTOR' is assigned to before global declaration 
>> global NOP_REDACTOR 
>>[24/Aug/2017 15:47:19 +0000] 9518 MainThread agent INFO SCM Agent Version: 5.12.0 
>>[24/Aug/2017 15:47:19 +0000] 9518 MainThread agent WARNING Expected mode 0751 for /run/cloudera-scm-agent but was 0755 
>>[24/Aug/2017 15:47:19 +0000] 9518 MainThread agent INFO Re-using pre-existing di-rectory: /run/cloudera-scm-agent 
>>/usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/cmf-5.12.0-py2.7.egg/cmf/redaction.py:260: SyntaxWarning: name 'REDACTOR' is assigned to be-fore global declaration 
>> global REDACTOR 
>>/usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/cmf-5.12.0-py2.7.egg/cmf/redaction.py:261: SyntaxWarning: name 'NOP_REDACTOR' is assigned to before global declaration 
>> global NOP_REDACTOR 
>>[24/Aug/2017 16:46:11 +0000] 11744 MainThread agent INFO SCM Agent Version: 5.12.0 
>>[24/Aug/2017 16:46:11 +0000] 11744 MainThread agent WARNING Expected mode 0751 for /run/cloudera-scm-agent but was 0755 
>>[24/Aug/2017 16:46:11 +0000] 11744 MainThread agent INFO Re-using pre-existing directory: /run/cloudera-scm-agent 
>>[24/Aug/2017 12:55:20 +0000] 1442 MainThread agent INFO Re-using pre-existing di-rectory: /run/cloudera-scm-agent 
>>/usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/cmf-5.12.0-py2.7.egg/cmf/redaction.py:260: SyntaxWarning: name 'REDACTOR' is assigned to be-fore global declaration 
>> global REDACTOR 
>>/usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/cmf-5.12.0-py2.7.egg/cmf/redaction.py:261: SyntaxWarning: name 'NOP_REDACTOR' is assigned to before global declaration 
>> global NOP_REDACTOR 
>>[24/Aug/2017 13:03:49 +0000] 1426 MainThread agent INFO SCM Agent Version: 5.12.0 
>>[24/Aug/2017 13:03:49 +0000] 1426 MainThread agent WARNING Expected mode 0751 for /run/cloudera-scm-agent but was 0755 
>>[24/Aug/2017 13:03:49 +0000] 1426 MainThread agent INFO Re-using pre-existing di-rectory: /run/cloudera-scm-agent 
>>/usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/cmf-5.12.0-py2.7.egg/cmf/redaction.py:260: SyntaxWarning: name 'REDACTOR' is assigned to be-fore global declaration 
>> global REDACTOR 
>>/usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/cmf-5.12.0-py2.7.egg/cmf/redaction.py:261: SyntaxWarning: name 'NOP_REDACTOR' is assigned to before global declaration 
>> global NOP_REDACTOR 
>>[24/Aug/2017 13:06:32 +0000] 4147 MainThread agent INFO SCM Agent Version: 5.12.0 
>>[24/Aug/2017 13:06:32 +0000] 4147 MainThread agent WARNING Expected mode 0751 for /run/cloudera-scm-agent but was 0755 
>>[24/Aug/2017 13:06:32 +0000] 4147 MainThread agent INFO Re-using pre-existing di-rectory: /run/cloudera-scm-agent 
>>/usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/cmf-5.12.0-py2.7.egg/cmf/redaction.py:260: SyntaxWarning: name 'REDACTOR' is assigned to be-fore global declaration 
>> global REDACTOR 
>>/usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/cmf-5.12.0-py2.7.egg/cmf/redaction.py:261: SyntaxWarning: name 'NOP_REDACTOR' is assigned to before global declaration 
>> global NOP_REDACTOR 
>>[24/Aug/2017 15:38:40 +0000] 6308 MainThread agent INFO SCM Agent Version: 5.12.0 
>>[24/Aug/2017 15:38:40 +0000] 6308 MainThread agent WARNING Expected mode 0751 for /run/cloudera-scm-agent but was 0755 
>>[24/Aug/2017 15:38:40 +0000] 6308 MainThread agent INFO Re-using pre-existing di-rectory: /run/cloudera-scm-agent 
>>/usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/cmf-5.12.0-py2.7.egg/cmf/redaction.py:260: SyntaxWarning: name 'REDACTOR' is assigned to be-fore global declaration 
>> global REDACTOR 
>>/usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/cmf-5.12.0-py2.7.egg/cmf/redaction.py:261: SyntaxWarning: name 'NOP_REDACTOR' is assigned to before global declaration 
>> global NOP_REDACTOR 
>>[24/Aug/2017 15:40:25 +0000] 7651 MainThread agent INFO SCM Agent Version: 5.12.0 
>>[24/Aug/2017 15:40:25 +0000] 7651 MainThread agent WARNING Expected mode 0751 for /run/cloudera-scm-agent but was 0755 
>>[24/Aug/2017 15:40:25 +0000] 7651 MainThread agent INFO Re-using pre-existing di-rectory: /run/cloudera-scm-agent 
>>/usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/cmf-5.12.0-py2.7.egg/cmf/redaction.py:260: SyntaxWarning: name 'REDACTOR' is assigned to be-fore global declaration 
>> global REDACTOR 
>>/usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/cmf-5.12.0-py2.7.egg/cmf/redaction.py:261: SyntaxWarning: name 'NOP_REDACTOR' is assigned to before global declaration 
>> global NOP_REDACTOR 
>>[24/Aug/2017 15:43:14 +0000] 8111 MainThread agent INFO SCM Agent Version: 5.12.0 
>>[24/Aug/2017 15:43:14 +0000] 8111 MainThread agent WARNING Expected mode 0751 for /run/cloudera-scm-agent but was 0755 
>>[24/Aug/2017 15:43:14 +0000] 8111 MainThread agent INFO Re-using pre-existing di-rectory: /run/cloudera-scm-agent 
>>/usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/cmf-5.12.0-py2.7.egg/cmf/redaction.py:260: SyntaxWarning: name 'REDACTOR' is assigned to be-fore global declaration 
>> global REDACTOR 
>>/usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/cmf-5.12.0-py2.7.egg/cmf/redaction.py:261: SyntaxWarning: name 'NOP_REDACTOR' is assigned to before global declaration 
>> global NOP_REDACTOR 
>>[24/Aug/2017 15:47:19 +0000] 9518 MainThread agent INFO SCM Agent Version: 5.12.0 
>>[24/Aug/2017 15:47:19 +0000] 9518 MainThread agent WARNING Expected mode 0751 for /run/cloudera-scm-agent but was 0755 
>>[24/Aug/2017 15:47:19 +0000] 9518 MainThread agent INFO Re-using pre-existing di-rectory: /run/cloudera-scm-agent 
>>/usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/cmf-5.12.0-py2.7.egg/cmf/redaction.py:260: SyntaxWarning: name 'REDACTOR' is assigned to be-fore global declaration 
>> global REDACTOR 
>>/usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/cmf-5.12.0-py2.7.egg/cmf/redaction.py:261: SyntaxWarning: name 'NOP_REDACTOR' is assigned to before global declaration 
>> global NOP_REDACTOR 
>>[24/Aug/2017 16:46:11 +0000] 11744 MainThread agent INFO SCM Agent Version: 5.12.0 
>>[24/Aug/2017 16:46:11 +0000] 11744 MainThread agent WARNING Expected mode 0751 for /run/cloudera-scm-agent but was 0755 
>>[24/Aug/2017 16:46:11 +0000] 11744 MainThread agent INFO Re-using pre-existing directory: /run/cloudera-scm-agent 
END (0) 
BEGIN tail -n 50 /var/log/cloudera-scm-agent//cloudera-scm-agent.log | sed 's/^/>>/' 
>>[24/Aug/2017 15:47:19 +0000] 9533 MainThread agent INFO Because agent not run-ning as root, all processes will run with current user. 
>>[24/Aug/2017 15:47:21 +0000] 9533 MainThread agent INFO Re-using pre-existing di-rectory: /run/cloudera-scm-agent/cgroups 
>>[24/Aug/2017 15:47:21 +0000] 9533 MainThread cgroups INFO Found existing subsys-tem blkio at /sys/fs/cgroup/blkio 
>>[24/Aug/2017 15:47:21 +0000] 9533 MainThread cgroups INFO Found existing subsys-tem memory at /sys/fs/cgroup/memory 
>>[24/Aug/2017 15:47:21 +0000] 9533 MainThread cgroups INFO Found existing subsys-tem cpu at /sys/fs/cgroup/cpu,cpuacct 
>>[24/Aug/2017 15:47:21 +0000] 9533 MainThread cgroups INFO Found existing subsys-tem cpuacct at /sys/fs/cgroup/cpu,cpuacct 
>>[24/Aug/2017 15:47:21 +0000] 9533 MainThread cgroups WARNING Could not read capabilities from /proc/cgroups. error: sudo: no tty present and no askpass program speci-fied 
>> 
>>[24/Aug/2017 15:47:21 +0000] 9533 MainThread agent INFO No cgroups capabilities found 
>>[24/Aug/2017 15:47:21 +0000] 9533 MainThread agent INFO Setting up supervisord event monitor. 
>>[24/Aug/2017 15:47:21 +0000] 9533 MainThread filesystem_map INFO Monitored nodev filesystem types: ['nfs', 'nfs4', 'tmpfs'] 
>>[24/Aug/2017 15:47:21 +0000] 9533 MainThread filesystem_map INFO Using timeout of 2.000000 
>>[24/Aug/2017 15:47:21 +0000] 9533 MainThread filesystem_map INFO Using join timeout of 0.100000 
>>[24/Aug/2017 15:47:21 +0000] 9533 MainThread filesystem_map INFO Using tolerance of 60.000000 
>>[24/Aug/2017 15:47:21 +0000] 9533 MainThread filesystem_map INFO Local filesystem types whitelist: ['ext2', 'ext3', 'ext4', 'xfs'] 
>>[24/Aug/2017 15:47:21 +0000] 9533 MainThread kt_renewer INFO Agent wide creden-tial cache set to /run/cloudera-scm-agent/krb5cc_cm_agent_123 
>>[24/Aug/2017 15:47:21 +0000] 9533 MainThread agent INFO Using met-rics_url_timeout_seconds of 30.000000 
>>[24/Aug/2017 15:47:21 +0000] 9533 MainThread agent INFO Using task_metrics_timeout_seconds of 5.000000 
>>[24/Aug/2017 15:47:21 +0000] 9533 MainThread agent INFO Using max_collection_wait_seconds of 10.000000 
>>[24/Aug/2017 15:47:21 +0000] 9533 MainThread metrics INFO Importing tasktracker metric schema from file /usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/cmf-5.12.0-py2.7.egg/cmf/monitor/tasktracker/schema.json 
>>[24/Aug/2017 15:47:21 +0000] 9533 MainThread ntp_monitor INFO Using timeout of 2.000000
>>[24/Aug/2017 15:47:21 +0000] 9533 MainThread dns_names INFO Using timeout of 30.000000 
>>[24/Aug/2017 15:47:21 +0000] 9533 MainThread __init__ INFO Created DNS monitor. 
>>[24/Aug/2017 15:47:21 +0000] 9533 MainThread stacks_collection_manager INFO Us-ing max_uncompressed_file_size_bytes: 5242880 
>>[24/Aug/2017 15:47:21 +0000] 9533 MainThread __init__ INFO Importing metric sche-ma from file /usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/cmf-5.12.0-py2.7.egg/cmf/monitor/schema.json 
>>[24/Aug/2017 15:47:21 +0000] 9533 MainThread agent INFO Supervised processes will add the following to their environment (in addition to the supervisor's env): {'CDH_PARQUET_HOME': '/usr/lib/parquet', 'JSVC_HOME': '/usr/libexec/bigtop-utils', 'CMF_PACKAGE_DIR': '/usr/lib/cmf/service', 'CDH_HADOOP_BIN': '/usr/bin/hadoop', 'MGMT_HOME': '/usr/share/cmf', 'CDH_IMPALA_HOME': '/usr/lib/impala', 'CDH_YARN_HOME': '/usr/lib/hadoop-yarn', 'CDH_HDFS_HOME': '/usr/lib/hadoop-hdfs', 'PATH': '/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/usr/share/maven', 'CDH_HUE_PLUGINS_HOME': '/usr/lib/hadoop', 'CM_STATUS_CODES': u'STATUS_NONE HDFS_DFS_DIR_NOT_EMPTY HBASE_TABLE_DISABLED HBASE_TABLE_ENABLED JOBTRACKER_IN_STANDBY_MODE YARN_RM_IN_STANDBY_MODE', 'KEYTRUSTEE_KP_HOME': '/usr/share/keytrustee-keyprovider', 'CLOUDERA_ORACLE_CONNECTOR_JAR': '/usr/share/java/oracle-connector-java.jar', 'CDH_SQOOP2_HOME': '/usr/lib/sqoop2', 'KEYTRUS-TEE_SERVER_HOME': '/usr/lib/keyt>>[24/Aug/2017 15:47:19 +0000] 9533 MainThread agent INFO Because agent not running as root, all processes will run with current user. 
>>[24/Aug/2017 15:47:21 +0000] 9533 MainThread agent INFO Re-using pre-existing di-rectory: /run/cloudera-scm-agent/cgroups 
>>[24/Aug/2017 15:47:21 +0000] 9533 MainThread cgroups INFO Found existing subsys-tem blkio at /sys/fs/cgroup/blkio 
>>[24/Aug/2017 15:47:21 +0000] 9533 MainThread cgroups INFO Found existing subsys-tem memory at /sys/fs/cgroup/memory 
>>[24/Aug/2017 15:47:21 +0000] 9533 MainThread cgroups INFO Found existing subsys-tem cpu at /sys/fs/cgroup/cpu,cpuacct 
>>[24/Aug/2017 15:47:21 +0000] 9533 MainThread cgroups INFO Found existing subsys-tem cpuacct at /sys/fs/cgroup/cpu,cpuacct 
>>[24/Aug/2017 15:47:21 +0000] 9533 MainThread cgroups WARNING Could not read capabilities from /proc/cgroups. error: sudo: no tty present and no askpass program speci-fied 
>> 
>>[24/Aug/2017 15:47:21 +0000] 9533 MainThread agent INFO No cgroups capabilities found 
>>[24/Aug/2017 15:47:21 +0000] 9533 MainThread agent INFO Setting up supervisord event monitor. 
>>[24/Aug/2017 15:47:21 +0000] 9533 MainThread filesystem_map INFO Monitored nodev filesystem types: ['nfs', 'nfs4', 'tmpfs'] 
>>[24/Aug/2017 15:47:21 +0000] 9533 MainThread filesystem_map INFO Using timeout of 2.000000 
>>[24/Aug/2017 15:47:21 +0000] 9533 MainThread filesystem_map INFO Using join timeout of 0.100000 
>>[24/Aug/2017 15:47:21 +0000] 9533 MainThread filesystem_map INFO Using tolerance of 60.000000 
>>[24/Aug/2017 15:47:21 +0000] 9533 MainThread filesystem_map INFO Local filesystem types whitelist: ['ext2', 'ext3', 'ext4', 'xfs'] 
>>[24/Aug/2017 15:47:21 +0000] 9533 MainThread kt_renewer INFO Agent wide creden-tial cache set to /run/cloudera-scm-agent/krb5cc_cm_agent_123 
>>[24/Aug/2017 15:47:21 +0000] 9533 MainThread agent INFO Using met-rics_url_timeout_seconds of 30.000000 
>>[24/Aug/2017 15:47:21 +0000] 9533 MainThread agent INFO Using task_metrics_timeout_seconds of 5.000000 
>>[24/Aug/2017 15:47:21 +0000] 9533 MainThread agent INFO Using max_collection_wait_seconds of 10.000000 
>>[24/Aug/2017 15:47:21 +0000] 9533 MainThread metrics INFO Importing tasktracker metric schema from file /usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/cmf-5.12.0-py2.7.egg/cmf/monitor/tasktracker/schema.json 
>>[24/Aug/2017 15:47:21 +0000] 9533 MainThread ntp_monitor INFO Using timeout of 2.000000
>>[24/Aug/2017 15:47:21 +0000] 9533 MainThread dns_names INFO Using timeout of 30.000000 
>>[24/Aug/2017 15:47:21 +0000] 9533 MainThread __init__ INFO Created DNS monitor. 
>>[24/Aug/2017 15:47:21 +0000] 9533 MainThread stacks_collection_manager INFO Us-ing max_uncompressed_file_size_bytes: 5242880 
>>[24/Aug/2017 15:47:21 +0000] 9533 MainThread __init__ INFO Importing metric sche-ma from file /usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/cmf-5.12.0-py2.7.egg/cmf/monitor/schema.json 
>>[24/Aug/2017 15:47:21 +0000] 9533 MainThread agent INFO Supervised processes will add the following to their environment (in addition to the supervisor's env): {'CDH_PARQUET_HOME': '/usr/lib/parquet', 'JSVC_HOME': '/usr/libexec/bigtop-utils', 'CMF_PACKAGE_DIR': '/usr/lib/cmf/service', 'CDH_HADOOP_BIN': '/usr/bin/hadoop', 'MGMT_HOME': '/usr/share/cmf', 'CDH_IMPALA_HOME': '/usr/lib/impala', 'CDH_YARN_HOME': '/usr/lib/hadoop-yarn', 'CDH_HDFS_HOME': '/usr/lib/hadoop-hdfs', 'PATH': '/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/usr/share/maven', 'CDH_HUE_PLUGINS_HOME': '/usr/lib/hadoop', 'CM_STATUS_CODES': u'STATUS_NONE HDFS_DFS_DIR_NOT_EMPTY HBASE_TABLE_DISABLED HBASE_TABLE_ENABLED JOBTRACKER_IN_STANDBY_MODE YARN_RM_IN_STANDBY_MODE', 'KEYTRUSTEE_KP_HOME': '/usr/share/keytrustee-keyprovider', 'CLOUDERA_ORACLE_CONNECTOR_JAR': '/usr/share/java/oracle-connector-java.jar', 'CDH_SQOOP2_HOME': '/usr/lib/sqoop2', 'KEYTRUS-TEE_SERVER_HOME': '/usr/lib/keytrustee-server', 'CDH_MR2_HOME': '/usr/lib/hadoop-mapreduce', 'HIVE_DEFAULT_XML': '/etc/hive/conf.dist/hive-default.xml', 'CLOUDERA_POSTGRESQL_JDBC_JAR': '/usr/share/cmf/lib/postgresql-9.0-801.jdbc4.jar', 'CDH_KMS_HOME': '/usr/lib/hadoop-kms', 'CDH_HBASE_HOME': '/usr/lib/hbase', 'CDH_SQOOP_HOME': '/usr/lib/sqoop', 'WEBHCAT_DEFAULT_XML': '/etc/hive-webhcat/conf.dist/webhcat-default.xml', 'CDH_OOZIE_HOME': '/usr/lib/oozie', 'SUDO': 'sudo', 'CDH_ZOOKEEPER_HOME': '/usr/lib/zookeeper', 'CDH_HUE_HOME': '/usr/lib/hue', 'CLOUDERA_MYSQL_CONNECTOR_JAR': '/usr/share/java/mysql-connector-java.jar', 'CDH_HBASE_INDEXER_HOME': '/usr/lib/hbase-solr', 'CDH_MR1_HOME': '/usr/lib/hadoop-0.20-mapreduce', 'CDH_SOLR_HOME': '/usr/lib/solr', 'CDH_PIG_HOME': '/usr/lib/pig', 'CDH_SENTRY_HOME': '/usr/lib/sentry', 'CDH_CRUNCH_HOME': '/usr/lib/crunch', 'CDH_LLAMA_HOME': '/usr/lib/llama/', 'CDH_HTTPFS_HOME': '/usr/lib/hadoop-httpfs', 'CDH_HADOOP_HOME': '/usr/lib/hadoop', 'CDH_HIVE_HOME': '/usr/lib/hive', 'ORACLE_HOME': '/usr/share/oracle/instantclient', 'CDH_HCAT_HOME': '/usr/lib/hive-hcatalog', 'CDH_KAFKA_HOME': '/usr/lib/kafka', 'CDH_SPARK_HOME': '/usr/lib/spark', 'TOMCAT_HOME': '/usr/lib/bigtop-tomcat', 'CDH_FLUME_HOME': '/usr/lib/flume-ng'} 
>>[24/Aug/2017 15:47:21 +0000] 9533 MainThread agent INFO To override these varia-bles, use /etc/cloudera-scm-agent/config.ini. Environment variables for CDH locations are not used when CDH is installed from parcels. 
>>[24/Aug/2017 15:47:21 +0000] 9533 MainThread agent INFO Re-using pre-existing di-rectory: /run/cloudera-scm-agent/process 
>>[24/Aug/2017 15:47:21 +0000] 9533 MainThread agent INFO Re-using pre-existing di-rectory: /run/cloudera-scm-agent/supervisor 
>>[24/Aug/2017 15:47:21 +0000] 9533 MainThread agent INFO Re-using pre-existing di-rectory: /run/cloudera-scm-agent/flood 
>>[24/Aug/2017 15:47:21 +0000] 9533 MainThread agent INFO Re-using pre-existing di-rectory: /run/cloudera-scm-agent/supervisor/include 
>>[24/Aug/2017 15:47:21 +0000] 9533 MainThread agent ERROR Failed to connect to previous supervisor. 
>>Traceback (most recent call last): 
>> File "/usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/cmf-5.12.0-py2.7.egg/cmf/agent.py", line 2109, in find_or_start_supervisor 
>> self.configure_supervisor_clients() 
>> File "/usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/cmf-5.12.0-py2.7.egg/cmf/agent.py", line 2290, in configure_supervisor_clients 
>> supervisor_options.realize(args=["-c", os.path.join(self.supervisor_dir, "supervi-sord.conf")]) 
>> File "/usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/supervisor-3.0-py2.7.egg/supervisor/options.py", line 1599, in realize 
>> Options.realize(self, *arg, **kw) 
>> File "/usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/supervisor-3.0-py2.7.egg/supervisor/options.py", line 333, in realize 
>> self.process_config() 
>> File "/usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/supervisor-3.0-py2.7.egg/supervisor/options.py", line 341, in process_config 
>> self.process_config_file(do_usage) 
>> File "/usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/supervisor-3.0-py2.7.egg/supervisor/options.py", line 376, in process_config_file 
>> self.usage(str(msg)) 
>> File "/usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/supervisor-3.0-py2.7.egg/supervisor/options.py", line 164, in usage 
>> self.exit(2) 
>>SystemExit: 2 
>>[24/Aug/2017 15:47:21 +0000] 9533 Dummy-1 daemonize WARNING Stopping dae-mon. 
>>[24/Aug/2017 15:47:21 +0000] 9533 Dummy-1 agent INFO Stopping agent... 
rustee-server', 'CDH_MR2_HOME': '/usr/lib/hadoop-mapreduce', 'HIVE_DEFAULT_XML': '/etc/hive/conf.dist/hive-default.xml', 'CLOUDERA_POSTGRESQL_JDBC_JAR': '/usr/share/cmf/lib/postgresql-9.0-801.jdbc4.jar', 'CDH_KMS_HOME': '/usr/lib/hadoop-kms', 'CDH_HBASE_HOME': '/usr/lib/hbase', 'CDH_SQOOP_HOME': '/usr/lib/sqoop', 'WEBHCAT_DEFAULT_XML': '/etc/hive-webhcat/conf.dist/webhcat-default.xml', 'CDH_OOZIE_HOME': '/usr/lib/oozie', 'SUDO': 'sudo', 'CDH_ZOOKEEPER_HOME': '/usr/lib/zookeeper', 'CDH_HUE_HOME': '/usr/lib/hue', 'CLOUDERA_MYSQL_CONNECTOR_JAR': '/usr/share/java/mysql-connector-java.jar', 'CDH_HBASE_INDEXER_HOME': '/usr/lib/hbase-solr', 'CDH_MR1_HOME': '/usr/lib/hadoop-0.20-mapreduce', 'CDH_SOLR_HOME': '/usr/lib/solr', 'CDH_PIG_HOME': '/usr/lib/pig', 'CDH_SENTRY_HOME': '/usr/lib/sentry', 'CDH_CRUNCH_HOME': '/usr/lib/crunch', 'CDH_LLAMA_HOME': '/usr/lib/llama/', 'CDH_HTTPFS_HOME': '/usr/lib/hadoop-httpfs', 'CDH_HADOOP_HOME': '/usr/lib/hadoop', 'CDH_HIVE_HOME': '/usr/lib/hive', 'ORACLE_HOME': '/usr/share/oracle/instantclient', 'CDH_HCAT_HOME': '/usr/lib/hive-hcatalog', 'CDH_KAFKA_HOME': '/usr/lib/kafka', 'CDH_SPARK_HOME': '/usr/lib/spark', 'TOMCAT_HOME': '/usr/lib/bigtop-tomcat', 'CDH_FLUME_HOME': '/usr/lib/flume-ng'} 
>>[24/Aug/2017 15:47:21 +0000] 9533 MainThread agent INFO To override these varia-bles, use /etc/cloudera-scm-agent/config.ini. Environment variables for CDH locations are not used when CDH is installed from parcels. 
>>[24/Aug/2017 15:47:21 +0000] 9533 MainThread agent INFO Re-using pre-existing di-rectory: /run/cloudera-scm-agent/process 
>>[24/Aug/2017 15:47:21 +0000] 9533 MainThread agent INFO Re-using pre-existing di-rectory: /run/cloudera-scm-agent/supervisor 
>>[24/Aug/2017 15:47:21 +0000] 9533 MainThread agent INFO Re-using pre-existing di-rectory: /run/cloudera-scm-agent/flood 
>>[24/Aug/2017 15:47:21 +0000] 9533 MainThread agent INFO Re-using pre-existing di-rectory: /run/cloudera-scm-agent/supervisor/include 
>>[24/Aug/2017 15:47:21 +0000] 9533 MainThread agent ERROR Failed to connect to previous supervisor. 
>>Traceback (most recent call last): 
>> File "/usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/cmf-5.12.0-py2.7.egg/cmf/agent.py", line 2109, in find_or_start_supervisor 
>> self.configure_supervisor_clients() 
>> File "/usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/cmf-5.12.0-py2.7.egg/cmf/agent.py", line 2290, in configure_supervisor_clients 
>> supervisor_options.realize(args=["-c", os.path.join(self.supervisor_dir, "supervi-sord.conf")]) 
>> File "/usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/supervisor-3.0-py2.7.egg/supervisor/options.py", line 1599, in realize 
>> Options.realize(self, *arg, **kw) 
>> File "/usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/supervisor-3.0-py2.7.egg/supervisor/options.py", line 333, in realize 
>> self.process_config() 
>> File "/usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/supervisor-3.0-py2.7.egg/supervisor/options.py", line 341, in process_config 
>> self.process_config_file(do_usage) 
>> File "/usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/supervisor-3.0-py2.7.egg/supervisor/options.py", line 376, in process_config_file 
>> self.usage(str(msg)) 
>> File "/usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/supervisor-3.0-py2.7.egg/supervisor/options.py", line 164, in usage 
>> self.exit(2) 
>>SystemExit: 2 
>>[24/Aug/2017 15:47:21 +0000] 9533 Dummy-1 daemonize WARNING Stopping dae-mon. 
>>[24/Aug/2017 15:47:21 +0000] 9533 Dummy-1 agent INFO Stopping agent... 
END (0) 
end of agent logs. 
scm agent restarted 
Installation script completed successfully.
all done 
closing logging file descriptor

 I have check all the 5 options but still improvement.

 

Thanks,

Amit Kumar