Created 08-24-2017 04:44 AM
Error Message: Installation failed. Failed to receive heartbeat from agent. • Ensure that the host's hostname is configured properly. • Ensure that port 7182 is accessible on the Cloudera Manager Server (check firewall rules). • Ensure that ports 9000 and 9001 are not in use on the host being added. • Check agent logs in /var/log/cloudera-scm-agent/ on the host being added. (Some of the logs can be found in the installation details). • If Use TLS Encryption for Agentsis enabled in Cloudera Manager (Administration -> Settings -> Security), ensure that /etc/cloudera-scm-agent/config.inihas use_tls=1 on the host being added. Restart the corresponding agent and click the Retry link here. Log file: /tmp/scm_prepare_node.bK5vQRgw using SSH_CLIENT to get the SCM hostname: 10.x.y.z 38830 22 opening logging file descriptor Starting installation script... Acquiring installation lock... BEGIN flock 4 END (0) Detecting root privileges... effective UID is 0 Detecting distribution... BEGIN grep 'Ubuntu' /etc/lsb-release DISTRIB_ID=Ubuntu DISTRIB_DESCRIPTION="Ubuntu 16.04.2 LTS" END (0) BEGIN grep DISTRIB_CODENAME /etc/lsb-release END (0) DISTRIB_CODENAME=xenial BEGIN echo DISTRIB_CODENAME=xenial | cut -d = -f 2 xenial END (0) Detecting Cloudera Manager Server... BEGIN host -t PTR 10.x.y.z Host z.y.x.10.in-addr.arpa. not found: 3(NXDOMAIN) END (1) BEGIN which python /usr/bin/python END (0) BEGIN python -c 'import socket; import sys; s = socket.socket(socket.AF_INET); s.settimeout(5.0); s.connect((sys.argv[1], int(sys.argv[2]))); s.close();' 10.x.y.z 7182 END (0) BEGIN which wget /usr/bin/wget END (0) BEGIN wget -qO- -T 1 -t 1 http://169.254.169.254/latest/meta-data/public-hostname && /bin/echo END (4) Installing package repositories... validating format of repository file /tmp/scm_prepare_node.bK5vQRgw/repos/ubuntu_xenial/cloudera-manager.list installing repository file /tmp/scm_prepare_node.bK5vQRgw/repos/ubuntu_xenial/cloudera-manager.list repository file /tmp/scm_prepare_node.bK5vQRgw/repos/ubuntu_xenial/cloudera-manager.list installed BEGIN apt-key add /tmp/scm_prepare_node.bK5vQRgw/archive.key OK END (0) installing priority file /tmp/scm_prepare_node.bK5vQRgw/priorities/ubuntu_xenial/cloudera.pref priority file /tmp/scm_prepare_node.bK5vQRgw/priorities/ubuntu_xenial/cloudera.pref in-stalled Refreshing package metadata... BEGIN apt-get update Hit:1 http://archive.cloudera.com/cm5/ubuntu/xenial/amd64/cm xenial-cm5 InRelease Hit:2 https://archive.cloudera.com/cdh5/ubuntu/precise/amd64/cdh precise-cdh5 InRe-lease Hit:3 http://repo.mysql.com/apt/ubuntu xenial InRelease Hit:4 https://archive.cloudera.com/cm5/ubuntu/xenial/amd64/cm xenial-cm5.12.0 InRe-lease Hit:5 http://in.archive.ubuntu.com/ubuntu xenial InRelease Get:6 http://security.ubuntu.com/ubuntu xenial-security InRelease [102 kB] Get:7 http://in.archive.ubuntu.com/ubuntu xenial-updates InRelease [102 kB] Get:8 http://security.ubuntu.com/ubuntu xenial-security/main amd64 DEP-11 Metadata [60.2 kB] Get:9 http://security.ubuntu.com/ubuntu xenial-security/main DEP-11 64x64 Icons [52.0 kB] Get:10 http://in.archive.ubuntu.com/ubuntu xenial-backports InRelease [102 kB] Get:11 http://in.archive.ubuntu.com/ubuntu xenial-updates/main amd64 DEP-11 Metada-ta [305 kB] Get:12 http://security.ubuntu.com/ubuntu xenial-security/universe amd64 DEP-11 Metadata [48.8 kB] Get:13 http://security.ubuntu.com/ubuntu xenial-security/universe DEP-11 64x64 Icons [64.2 kB] Get:14 http://in.archive.ubuntu.com/ubuntu xenial-updates/main DEP-11 64x64 Icons [206 kB] Get:15 http://in.archive.ubuntu.com/ubuntu xenial-updates/universe amd64 DEP-11 Metadata [171 kB] Get:16 http://in.archive.ubuntu.com/ubuntu xenial-updates/universe DEP-11 64x64 Icons [224 kB] Get:17 http://in.archive.ubuntu.com/ubuntu xenial-updates/multiverse amd64 DEP-11 Metadata [5,892 B] Get:18 http://in.archive.ubuntu.com/ubuntu xenial-backports/main amd64 DEP-11 Metadata [3,324 B] Get:19 http://in.archive.ubuntu.com/ubuntu xenial-backports/universe amd64 DEP-11 Metadata [5,136 B] Fetched 1,451 kB in 6s (241 kB/s) Reading package lists... W: http://archive.cloudera.com/cm5/ubuntu/xenial/amd64/cm/dists/xenial-cm5/InRelease: Signature by key F36A89E33CC1BD0F71079007327574EE02A818DD uses weak digest algorithm (SHA1) W: https://archive.cloudera.com/cdh5/ubuntu/precise/amd64/cdh/dists/precise-cdh5/InRelease: Signature by key F36A89E33CC1BD0F71079007327574EE02A818DD uses weak digest algorithm (SHA1) W: https://archive.cloudera.com/cm5/ubuntu/xenial/amd64/cm/dists/xenial-cm5.12.0/InRelease: Signature by key F36A89E33CC1BD0F71079007327574EE02A818DD uses weak digest algorithm (SHA1) END (0) BEGIN apt-get update Hit:1 http://repo.mysql.com/apt/ubuntu xenial InRelease Hit:2 http://archive.cloudera.com/cm5/ubuntu/xenial/amd64/cm xenial-cm5 InRelease Hit:3 https://archive.cloudera.com/cdh5/ubuntu/precise/amd64/cdh precise-cdh5 InRe-lease Hit:4 https://archive.cloudera.com/cm5/ubuntu/xenial/amd64/cm xenial-cm5.12.0 InRe-lease Hit:5 http://security.ubuntu.com/ubuntu xenial-security InRelease Hit:6 http://in.archive.ubuntu.com/ubuntu xenial InRelease Hit:7 http://in.archive.ubuntu.com/ubuntu xenial-updates InRelease Hit:8 http://in.archive.ubuntu.com/ubuntu xenial-backports InRelease Reading package lists... W: http://archive.cloudera.com/cm5/ubuntu/xenial/amd64/cm/dists/xenial-cm5/InRelease: Signature by key F36A89E33CC1BD0F71079007327574EE02A818DD uses weak digest algorithm (SHA1) W: https://archive.cloudera.com/cdh5/ubuntu/precise/amd64/cdh/dists/precise-cdh5/InRelease: Signature by key F36A89E33CC1BD0F71079007327574EE02A818DD uses weak digest algorithm (SHA1) W: https://archive.cloudera.com/cm5/ubuntu/xenial/amd64/cm/dists/xenial-cm5.12.0/InRelease: Signature by key F36A89E33CC1BD0F71079007327574EE02A818DD uses weak digest algorithm (SHA1) END (0) Installing cloudera-manager-agent package... BEGIN dpkg -l cloudera-manager-agent | grep -E '^ii[[:space:]]*cloudera-manager-agent[[:space:]]*' ii cloudera-manager-agent 5.12.0-1.cm5120.p0.120~xenial-cm5 amd64 The Cloudera Manager Agent END (0) BEGIN echo oracle-j2sdk1.6 oracle-j2sdk1.7 cloudera-manager-agent cloudera-manager-daemons | grep cloudera-manager-agent oracle-j2sdk1.6 oracle-j2sdk1.7 cloudera-manager-agent cloudera-manager-daemons END (0) BEGIN apt-cache show cloudera-manager-agent Package: cloudera-manager-agent Source: enterprise Version: 5.12.0-1.cm5120.p0.120~xenial-cm5 Architecture: amd64 Maintainer: Cloudera Inc. Installed-Size: 44039 Depends: libc6 (>= 2.17), libcomerr2 (>= 1.01), libgcc1 (>= 1:3.0), libgssapi-krb5-2 (>= 1.10+dfsg~), libkrb5-3 (>= 1.6.dfsg.2), libssl1.0.0 (>= 1.0.2~beta3), libstdc++6 (>= 5.2), zlib1g (>= 1:1.2.0), lsb-base, psmisc, bash, libsasl2-modules, libsasl2-modules-gssapi-mit, libxslt1.1, libsqlite3-0, openssl, libssl-dev, libfuse2, fuse-utils | fuse, rpcbind, cloudera-manager-daemons (= 5.12.0-1.cm5120.p0.120~xenial-cm5), perl, python-psycopg2, py-thon-mysqldb, apache2, iproute2 Homepage: http://www.cloudera.com Priority: extra Section: misc Filename: pool/contrib/e/enterprise/cloudera-manager-agent_5.12.0-1.cm5120.p0.120~xenial-cm5_amd64.deb Size: 11186376 SHA256: 69618949fb10d631ac301f21f62ecab0a3631eec456b6de43ef9c6a17c107498 SHA1: 6b137a4328780d56f964403ff8c56fe7577935a0 MD5sum: f7c9fc2b393b6d61563ea34ca15b6e61 Description: The Cloudera Manager Agent The Agent is deployed to machines running services managed by Cloudera Manager. Description-md5: 482a592ee859d31443f58aa3e48fe303 END (0) Version: 5.12.0-1.cm5120.p0.120~xenial-cm5 BEGIN apt-get -o Dpkg::Options::=--force-confdef -o Dpkg::Options::=--force-confold -y in-stall cloudera-manager-agent Reading package lists... Building dependency tree... Reading state information... cloudera-manager-agent is already the newest version (5.12.0-1.cm5120.p0.120~xenial-cm5). 0 upgraded, 0 newly installed, 0 to remove and 347 not upgraded. END (0) remote package cloudera-manager-agent installed Installing cloudera-manager-daemons package... BEGIN dpkg -l cloudera-manager-daemons | grep -E '^ii[[:space:]]*cloudera-manager-daemons[[:space:]]*' ii cloudera-manager-daemons 5.12.0-1.cm5120.p0.120~xenial-cm5 all Provides daemons for monitoring Hadoop and related tools. END (0) BEGIN echo oracle-j2sdk1.6 oracle-j2sdk1.7 cloudera-manager-agent cloudera-manager-daemons | grep cloudera-manager-daemons oracle-j2sdk1.6 oracle-j2sdk1.7 cloudera-manager-agent cloudera-manager-daemons END (0) BEGIN apt-cache show cloudera-manager-daemons Package: cloudera-manager-daemons Source: enterprise Version: 5.12.0-1.cm5120.p0.120~xenial-cm5 Architecture: all Maintainer: Cloudera Inc. Installed-Size: 869404 Depends: perl Homepage: http://www.cloudera.com Priority: extra Section: misc Filename: pool/contrib/e/enterprise/cloudera-manager-daemons_5.12.0-1.cm5120.p0.120~xenial-cm5_all.deb Size: 737883268 SHA256: cf168ac13387bef54c61034e7cfef49539b1616cfb876f91db5dfe458d237780 SHA1: a18ed00de131d0c358411104fb3d886e0c211101 MD5sum: 47813b5493281f58b36ca33868229394 Description: Provides daemons for monitoring Hadoop and related tools. Provides daemons for monitoring Hadoop and related tools. Description-md5: 35bb5bc8fc2f296f791c3bda9e345340 END (0) Version: 5.12.0-1.cm5120.p0.120~xenial-cm5 BEGIN apt-get -o Dpkg::Options::=--force-confdef -o Dpkg::Options::=--force-confold -y in-stall cloudera-manager-daemons Reading package lists... Building dependency tree... Reading state information... cloudera-manager-daemons is already the newest version (5.12.0-1.cm5120.p0.120~xenial-cm5). 0 upgraded, 0 newly installed, 0 to remove and 347 not upgraded. END (0) remote package cloudera-manager-daemons installed Installing Unlimited Strength Encryption policy files. Installation not requested. Step will be skipped. Configuring Cloudera Manager Agent... BEGIN grep server_host=10.x.y.z /etc/cloudera-scm-agent/config.ini server_host=10.x.y.z END (0) scm agent is already configured BEGIN sed -e 's/#\(USER=.*\)/\1/' -i /etc/default/cloudera-scm-agent END (0) Starting Cloudera Manager Agent... BEGIN /usr/sbin/service cloudera-scm-agent status * cloudera-scm-agent.service - LSB: Cloudera SCM Agent Loaded: loaded (/etc/init.d/cloudera-scm-agent; bad; vendor preset: enabled) Active: active (exited) since Thu 2017-08-24 15:47:19 IST; 58min ago Docs: man:systemd-sysv-generator(8) Process: 9473 ExecStop=/etc/init.d/cloudera-scm-agent stop (code=exited, sta-tus=0/SUCCESS) Process: 9496 ExecStart=/etc/init.d/cloudera-scm-agent start (code=exited, sta-tus=0/SUCCESS) Aug 24 15:47:17 PC355406 systemd[1]: Starting LSB: Cloudera SCM Agent... Aug 24 15:47:17 PC355406 su[9516]: Successful su for cloudera-scm by root Aug 24 15:47:17 PC355406 su[9516]: + ??? root:cloudera-scm Aug 24 15:47:17 PC355406 su[9516]: pam_unix(su:session): session opened for user cloudera-scm by (uid=0) Aug 24 15:47:19 PC355406 cloudera-scm-agent[9496]: Starting cloudera-scm-agent: * cloudera-scm-agent started Aug 24 15:47:19 PC355406 systemd[1]: Started LSB: Cloudera SCM Agent. END (0) BEGIN /usr/sbin/service cloudera-scm-agent restart END (0) agent logs: BEGIN tail -n 50 /var/log/cloudera-scm-agent//cloudera-scm-agent.out | sed 's/^/>>/' >>[24/Aug/2017 12:55:20 +0000] 1442 MainThread agent INFO Re-using pre-existing di-rectory: /run/cloudera-scm-agent >>/usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/cmf-5.12.0-py2.7.egg/cmf/redaction.py:260: SyntaxWarning: name 'REDACTOR' is assigned to be-fore global declaration >> global REDACTOR >>/usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/cmf-5.12.0-py2.7.egg/cmf/redaction.py:261: SyntaxWarning: name 'NOP_REDACTOR' is assigned to before global declaration >> global NOP_REDACTOR >>[24/Aug/2017 13:03:49 +0000] 1426 MainThread agent INFO SCM Agent Version: 5.12.0 >>[24/Aug/2017 13:03:49 +0000] 1426 MainThread agent WARNING Expected mode 0751 for /run/cloudera-scm-agent but was 0755 >>[24/Aug/2017 13:03:49 +0000] 1426 MainThread agent INFO Re-using pre-existing di-rectory: /run/cloudera-scm-agent >>/usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/cmf-5.12.0-py2.7.egg/cmf/redaction.py:260: SyntaxWarning: name 'REDACTOR' is assigned to be-fore global declaration >> global REDACTOR >>/usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/cmf-5.12.0-py2.7.egg/cmf/redaction.py:261: SyntaxWarning: name 'NOP_REDACTOR' is assigned to before global declaration >> global NOP_REDACTOR >>[24/Aug/2017 13:06:32 +0000] 4147 MainThread agent INFO SCM Agent Version: 5.12.0 >>[24/Aug/2017 13:06:32 +0000] 4147 MainThread agent WARNING Expected mode 0751 for /run/cloudera-scm-agent but was 0755 >>[24/Aug/2017 13:06:32 +0000] 4147 MainThread agent INFO Re-using pre-existing di-rectory: /run/cloudera-scm-agent >>/usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/cmf-5.12.0-py2.7.egg/cmf/redaction.py:260: SyntaxWarning: name 'REDACTOR' is assigned to be-fore global declaration >> global REDACTOR >>/usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/cmf-5.12.0-py2.7.egg/cmf/redaction.py:261: SyntaxWarning: name 'NOP_REDACTOR' is assigned to before global declaration >> global NOP_REDACTOR >>[24/Aug/2017 15:38:40 +0000] 6308 MainThread agent INFO SCM Agent Version: 5.12.0 >>[24/Aug/2017 15:38:40 +0000] 6308 MainThread agent WARNING Expected mode 0751 for /run/cloudera-scm-agent but was 0755 >>[24/Aug/2017 15:38:40 +0000] 6308 MainThread agent INFO Re-using pre-existing di-rectory: /run/cloudera-scm-agent >>/usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/cmf-5.12.0-py2.7.egg/cmf/redaction.py:260: SyntaxWarning: name 'REDACTOR' is assigned to be-fore global declaration >> global REDACTOR >>/usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/cmf-5.12.0-py2.7.egg/cmf/redaction.py:261: SyntaxWarning: name 'NOP_REDACTOR' is assigned to before global declaration >> global NOP_REDACTOR >>[24/Aug/2017 15:40:25 +0000] 7651 MainThread agent INFO SCM Agent Version: 5.12.0 >>[24/Aug/2017 15:40:25 +0000] 7651 MainThread agent WARNING Expected mode 0751 for /run/cloudera-scm-agent but was 0755 >>[24/Aug/2017 15:40:25 +0000] 7651 MainThread agent INFO Re-using pre-existing di-rectory: /run/cloudera-scm-agent >>/usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/cmf-5.12.0-py2.7.egg/cmf/redaction.py:260: SyntaxWarning: name 'REDACTOR' is assigned to be-fore global declaration >> global REDACTOR >>/usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/cmf-5.12.0-py2.7.egg/cmf/redaction.py:261: SyntaxWarning: name 'NOP_REDACTOR' is assigned to before global declaration >> global NOP_REDACTOR >>[24/Aug/2017 15:43:14 +0000] 8111 MainThread agent INFO SCM Agent Version: 5.12.0 >>[24/Aug/2017 15:43:14 +0000] 8111 MainThread agent WARNING Expected mode 0751 for /run/cloudera-scm-agent but was 0755 >>[24/Aug/2017 15:43:14 +0000] 8111 MainThread agent INFO Re-using pre-existing di-rectory: /run/cloudera-scm-agent >>/usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/cmf-5.12.0-py2.7.egg/cmf/redaction.py:260: SyntaxWarning: name 'REDACTOR' is assigned to be-fore global declaration >> global REDACTOR >>/usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/cmf-5.12.0-py2.7.egg/cmf/redaction.py:261: SyntaxWarning: name 'NOP_REDACTOR' is assigned to before global declaration >> global NOP_REDACTOR >>[24/Aug/2017 15:47:19 +0000] 9518 MainThread agent INFO SCM Agent Version: 5.12.0 >>[24/Aug/2017 15:47:19 +0000] 9518 MainThread agent WARNING Expected mode 0751 for /run/cloudera-scm-agent but was 0755 >>[24/Aug/2017 15:47:19 +0000] 9518 MainThread agent INFO Re-using pre-existing di-rectory: /run/cloudera-scm-agent >>/usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/cmf-5.12.0-py2.7.egg/cmf/redaction.py:260: SyntaxWarning: name 'REDACTOR' is assigned to be-fore global declaration >> global REDACTOR >>/usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/cmf-5.12.0-py2.7.egg/cmf/redaction.py:261: SyntaxWarning: name 'NOP_REDACTOR' is assigned to before global declaration >> global NOP_REDACTOR >>[24/Aug/2017 16:46:11 +0000] 11744 MainThread agent INFO SCM Agent Version: 5.12.0 >>[24/Aug/2017 16:46:11 +0000] 11744 MainThread agent WARNING Expected mode 0751 for /run/cloudera-scm-agent but was 0755 >>[24/Aug/2017 16:46:11 +0000] 11744 MainThread agent INFO Re-using pre-existing directory: /run/cloudera-scm-agent >>[24/Aug/2017 12:55:20 +0000] 1442 MainThread agent INFO Re-using pre-existing di-rectory: /run/cloudera-scm-agent >>/usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/cmf-5.12.0-py2.7.egg/cmf/redaction.py:260: SyntaxWarning: name 'REDACTOR' is assigned to be-fore global declaration >> global REDACTOR >>/usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/cmf-5.12.0-py2.7.egg/cmf/redaction.py:261: SyntaxWarning: name 'NOP_REDACTOR' is assigned to before global declaration >> global NOP_REDACTOR >>[24/Aug/2017 13:03:49 +0000] 1426 MainThread agent INFO SCM Agent Version: 5.12.0 >>[24/Aug/2017 13:03:49 +0000] 1426 MainThread agent WARNING Expected mode 0751 for /run/cloudera-scm-agent but was 0755 >>[24/Aug/2017 13:03:49 +0000] 1426 MainThread agent INFO Re-using pre-existing di-rectory: /run/cloudera-scm-agent >>/usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/cmf-5.12.0-py2.7.egg/cmf/redaction.py:260: SyntaxWarning: name 'REDACTOR' is assigned to be-fore global declaration >> global REDACTOR >>/usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/cmf-5.12.0-py2.7.egg/cmf/redaction.py:261: SyntaxWarning: name 'NOP_REDACTOR' is assigned to before global declaration >> global NOP_REDACTOR >>[24/Aug/2017 13:06:32 +0000] 4147 MainThread agent INFO SCM Agent Version: 5.12.0 >>[24/Aug/2017 13:06:32 +0000] 4147 MainThread agent WARNING Expected mode 0751 for /run/cloudera-scm-agent but was 0755 >>[24/Aug/2017 13:06:32 +0000] 4147 MainThread agent INFO Re-using pre-existing di-rectory: /run/cloudera-scm-agent >>/usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/cmf-5.12.0-py2.7.egg/cmf/redaction.py:260: SyntaxWarning: name 'REDACTOR' is assigned to be-fore global declaration >> global REDACTOR >>/usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/cmf-5.12.0-py2.7.egg/cmf/redaction.py:261: SyntaxWarning: name 'NOP_REDACTOR' is assigned to before global declaration >> global NOP_REDACTOR >>[24/Aug/2017 15:38:40 +0000] 6308 MainThread agent INFO SCM Agent Version: 5.12.0 >>[24/Aug/2017 15:38:40 +0000] 6308 MainThread agent WARNING Expected mode 0751 for /run/cloudera-scm-agent but was 0755 >>[24/Aug/2017 15:38:40 +0000] 6308 MainThread agent INFO Re-using pre-existing di-rectory: /run/cloudera-scm-agent >>/usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/cmf-5.12.0-py2.7.egg/cmf/redaction.py:260: SyntaxWarning: name 'REDACTOR' is assigned to be-fore global declaration >> global REDACTOR >>/usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/cmf-5.12.0-py2.7.egg/cmf/redaction.py:261: SyntaxWarning: name 'NOP_REDACTOR' is assigned to before global declaration >> global NOP_REDACTOR >>[24/Aug/2017 15:40:25 +0000] 7651 MainThread agent INFO SCM Agent Version: 5.12.0 >>[24/Aug/2017 15:40:25 +0000] 7651 MainThread agent WARNING Expected mode 0751 for /run/cloudera-scm-agent but was 0755 >>[24/Aug/2017 15:40:25 +0000] 7651 MainThread agent INFO Re-using pre-existing di-rectory: /run/cloudera-scm-agent >>/usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/cmf-5.12.0-py2.7.egg/cmf/redaction.py:260: SyntaxWarning: name 'REDACTOR' is assigned to be-fore global declaration >> global REDACTOR >>/usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/cmf-5.12.0-py2.7.egg/cmf/redaction.py:261: SyntaxWarning: name 'NOP_REDACTOR' is assigned to before global declaration >> global NOP_REDACTOR >>[24/Aug/2017 15:43:14 +0000] 8111 MainThread agent INFO SCM Agent Version: 5.12.0 >>[24/Aug/2017 15:43:14 +0000] 8111 MainThread agent WARNING Expected mode 0751 for /run/cloudera-scm-agent but was 0755 >>[24/Aug/2017 15:43:14 +0000] 8111 MainThread agent INFO Re-using pre-existing di-rectory: /run/cloudera-scm-agent >>/usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/cmf-5.12.0-py2.7.egg/cmf/redaction.py:260: SyntaxWarning: name 'REDACTOR' is assigned to be-fore global declaration >> global REDACTOR >>/usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/cmf-5.12.0-py2.7.egg/cmf/redaction.py:261: SyntaxWarning: name 'NOP_REDACTOR' is assigned to before global declaration >> global NOP_REDACTOR >>[24/Aug/2017 15:47:19 +0000] 9518 MainThread agent INFO SCM Agent Version: 5.12.0 >>[24/Aug/2017 15:47:19 +0000] 9518 MainThread agent WARNING Expected mode 0751 for /run/cloudera-scm-agent but was 0755 >>[24/Aug/2017 15:47:19 +0000] 9518 MainThread agent INFO Re-using pre-existing di-rectory: /run/cloudera-scm-agent >>/usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/cmf-5.12.0-py2.7.egg/cmf/redaction.py:260: SyntaxWarning: name 'REDACTOR' is assigned to be-fore global declaration >> global REDACTOR >>/usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/cmf-5.12.0-py2.7.egg/cmf/redaction.py:261: SyntaxWarning: name 'NOP_REDACTOR' is assigned to before global declaration >> global NOP_REDACTOR >>[24/Aug/2017 16:46:11 +0000] 11744 MainThread agent INFO SCM Agent Version: 5.12.0 >>[24/Aug/2017 16:46:11 +0000] 11744 MainThread agent WARNING Expected mode 0751 for /run/cloudera-scm-agent but was 0755 >>[24/Aug/2017 16:46:11 +0000] 11744 MainThread agent INFO Re-using pre-existing directory: /run/cloudera-scm-agent END (0) BEGIN tail -n 50 /var/log/cloudera-scm-agent//cloudera-scm-agent.log | sed 's/^/>>/' >>[24/Aug/2017 15:47:19 +0000] 9533 MainThread agent INFO Because agent not run-ning as root, all processes will run with current user. >>[24/Aug/2017 15:47:21 +0000] 9533 MainThread agent INFO Re-using pre-existing di-rectory: /run/cloudera-scm-agent/cgroups >>[24/Aug/2017 15:47:21 +0000] 9533 MainThread cgroups INFO Found existing subsys-tem blkio at /sys/fs/cgroup/blkio >>[24/Aug/2017 15:47:21 +0000] 9533 MainThread cgroups INFO Found existing subsys-tem memory at /sys/fs/cgroup/memory >>[24/Aug/2017 15:47:21 +0000] 9533 MainThread cgroups INFO Found existing subsys-tem cpu at /sys/fs/cgroup/cpu,cpuacct >>[24/Aug/2017 15:47:21 +0000] 9533 MainThread cgroups INFO Found existing subsys-tem cpuacct at /sys/fs/cgroup/cpu,cpuacct >>[24/Aug/2017 15:47:21 +0000] 9533 MainThread cgroups WARNING Could not read capabilities from /proc/cgroups. error: sudo: no tty present and no askpass program speci-fied >> >>[24/Aug/2017 15:47:21 +0000] 9533 MainThread agent INFO No cgroups capabilities found >>[24/Aug/2017 15:47:21 +0000] 9533 MainThread agent INFO Setting up supervisord event monitor. >>[24/Aug/2017 15:47:21 +0000] 9533 MainThread filesystem_map INFO Monitored nodev filesystem types: ['nfs', 'nfs4', 'tmpfs'] >>[24/Aug/2017 15:47:21 +0000] 9533 MainThread filesystem_map INFO Using timeout of 2.000000 >>[24/Aug/2017 15:47:21 +0000] 9533 MainThread filesystem_map INFO Using join timeout of 0.100000 >>[24/Aug/2017 15:47:21 +0000] 9533 MainThread filesystem_map INFO Using tolerance of 60.000000 >>[24/Aug/2017 15:47:21 +0000] 9533 MainThread filesystem_map INFO Local filesystem types whitelist: ['ext2', 'ext3', 'ext4', 'xfs'] >>[24/Aug/2017 15:47:21 +0000] 9533 MainThread kt_renewer INFO Agent wide creden-tial cache set to /run/cloudera-scm-agent/krb5cc_cm_agent_123 >>[24/Aug/2017 15:47:21 +0000] 9533 MainThread agent INFO Using met-rics_url_timeout_seconds of 30.000000 >>[24/Aug/2017 15:47:21 +0000] 9533 MainThread agent INFO Using task_metrics_timeout_seconds of 5.000000 >>[24/Aug/2017 15:47:21 +0000] 9533 MainThread agent INFO Using max_collection_wait_seconds of 10.000000 >>[24/Aug/2017 15:47:21 +0000] 9533 MainThread metrics INFO Importing tasktracker metric schema from file /usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/cmf-5.12.0-py2.7.egg/cmf/monitor/tasktracker/schema.json >>[24/Aug/2017 15:47:21 +0000] 9533 MainThread ntp_monitor INFO Using timeout of 2.000000 >>[24/Aug/2017 15:47:21 +0000] 9533 MainThread dns_names INFO Using timeout of 30.000000 >>[24/Aug/2017 15:47:21 +0000] 9533 MainThread __init__ INFO Created DNS monitor. >>[24/Aug/2017 15:47:21 +0000] 9533 MainThread stacks_collection_manager INFO Us-ing max_uncompressed_file_size_bytes: 5242880 >>[24/Aug/2017 15:47:21 +0000] 9533 MainThread __init__ INFO Importing metric sche-ma from file /usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/cmf-5.12.0-py2.7.egg/cmf/monitor/schema.json >>[24/Aug/2017 15:47:21 +0000] 9533 MainThread agent INFO Supervised processes will add the following to their environment (in addition to the supervisor's env): {'CDH_PARQUET_HOME': '/usr/lib/parquet', 'JSVC_HOME': '/usr/libexec/bigtop-utils', 'CMF_PACKAGE_DIR': '/usr/lib/cmf/service', 'CDH_HADOOP_BIN': '/usr/bin/hadoop', 'MGMT_HOME': '/usr/share/cmf', 'CDH_IMPALA_HOME': '/usr/lib/impala', 'CDH_YARN_HOME': '/usr/lib/hadoop-yarn', 'CDH_HDFS_HOME': '/usr/lib/hadoop-hdfs', 'PATH': '/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/usr/share/maven', 'CDH_HUE_PLUGINS_HOME': '/usr/lib/hadoop', 'CM_STATUS_CODES': u'STATUS_NONE HDFS_DFS_DIR_NOT_EMPTY HBASE_TABLE_DISABLED HBASE_TABLE_ENABLED JOBTRACKER_IN_STANDBY_MODE YARN_RM_IN_STANDBY_MODE', 'KEYTRUSTEE_KP_HOME': '/usr/share/keytrustee-keyprovider', 'CLOUDERA_ORACLE_CONNECTOR_JAR': '/usr/share/java/oracle-connector-java.jar', 'CDH_SQOOP2_HOME': '/usr/lib/sqoop2', 'KEYTRUS-TEE_SERVER_HOME': '/usr/lib/keyt>>[24/Aug/2017 15:47:19 +0000] 9533 MainThread agent INFO Because agent not running as root, all processes will run with current user. >>[24/Aug/2017 15:47:21 +0000] 9533 MainThread agent INFO Re-using pre-existing di-rectory: /run/cloudera-scm-agent/cgroups >>[24/Aug/2017 15:47:21 +0000] 9533 MainThread cgroups INFO Found existing subsys-tem blkio at /sys/fs/cgroup/blkio >>[24/Aug/2017 15:47:21 +0000] 9533 MainThread cgroups INFO Found existing subsys-tem memory at /sys/fs/cgroup/memory >>[24/Aug/2017 15:47:21 +0000] 9533 MainThread cgroups INFO Found existing subsys-tem cpu at /sys/fs/cgroup/cpu,cpuacct >>[24/Aug/2017 15:47:21 +0000] 9533 MainThread cgroups INFO Found existing subsys-tem cpuacct at /sys/fs/cgroup/cpu,cpuacct >>[24/Aug/2017 15:47:21 +0000] 9533 MainThread cgroups WARNING Could not read capabilities from /proc/cgroups. error: sudo: no tty present and no askpass program speci-fied >> >>[24/Aug/2017 15:47:21 +0000] 9533 MainThread agent INFO No cgroups capabilities found >>[24/Aug/2017 15:47:21 +0000] 9533 MainThread agent INFO Setting up supervisord event monitor. >>[24/Aug/2017 15:47:21 +0000] 9533 MainThread filesystem_map INFO Monitored nodev filesystem types: ['nfs', 'nfs4', 'tmpfs'] >>[24/Aug/2017 15:47:21 +0000] 9533 MainThread filesystem_map INFO Using timeout of 2.000000 >>[24/Aug/2017 15:47:21 +0000] 9533 MainThread filesystem_map INFO Using join timeout of 0.100000 >>[24/Aug/2017 15:47:21 +0000] 9533 MainThread filesystem_map INFO Using tolerance of 60.000000 >>[24/Aug/2017 15:47:21 +0000] 9533 MainThread filesystem_map INFO Local filesystem types whitelist: ['ext2', 'ext3', 'ext4', 'xfs'] >>[24/Aug/2017 15:47:21 +0000] 9533 MainThread kt_renewer INFO Agent wide creden-tial cache set to /run/cloudera-scm-agent/krb5cc_cm_agent_123 >>[24/Aug/2017 15:47:21 +0000] 9533 MainThread agent INFO Using met-rics_url_timeout_seconds of 30.000000 >>[24/Aug/2017 15:47:21 +0000] 9533 MainThread agent INFO Using task_metrics_timeout_seconds of 5.000000 >>[24/Aug/2017 15:47:21 +0000] 9533 MainThread agent INFO Using max_collection_wait_seconds of 10.000000 >>[24/Aug/2017 15:47:21 +0000] 9533 MainThread metrics INFO Importing tasktracker metric schema from file /usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/cmf-5.12.0-py2.7.egg/cmf/monitor/tasktracker/schema.json >>[24/Aug/2017 15:47:21 +0000] 9533 MainThread ntp_monitor INFO Using timeout of 2.000000 >>[24/Aug/2017 15:47:21 +0000] 9533 MainThread dns_names INFO Using timeout of 30.000000 >>[24/Aug/2017 15:47:21 +0000] 9533 MainThread __init__ INFO Created DNS monitor. >>[24/Aug/2017 15:47:21 +0000] 9533 MainThread stacks_collection_manager INFO Us-ing max_uncompressed_file_size_bytes: 5242880 >>[24/Aug/2017 15:47:21 +0000] 9533 MainThread __init__ INFO Importing metric sche-ma from file /usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/cmf-5.12.0-py2.7.egg/cmf/monitor/schema.json >>[24/Aug/2017 15:47:21 +0000] 9533 MainThread agent INFO Supervised processes will add the following to their environment (in addition to the supervisor's env): {'CDH_PARQUET_HOME': '/usr/lib/parquet', 'JSVC_HOME': '/usr/libexec/bigtop-utils', 'CMF_PACKAGE_DIR': '/usr/lib/cmf/service', 'CDH_HADOOP_BIN': '/usr/bin/hadoop', 'MGMT_HOME': '/usr/share/cmf', 'CDH_IMPALA_HOME': '/usr/lib/impala', 'CDH_YARN_HOME': '/usr/lib/hadoop-yarn', 'CDH_HDFS_HOME': '/usr/lib/hadoop-hdfs', 'PATH': '/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/usr/share/maven', 'CDH_HUE_PLUGINS_HOME': '/usr/lib/hadoop', 'CM_STATUS_CODES': u'STATUS_NONE HDFS_DFS_DIR_NOT_EMPTY HBASE_TABLE_DISABLED HBASE_TABLE_ENABLED JOBTRACKER_IN_STANDBY_MODE YARN_RM_IN_STANDBY_MODE', 'KEYTRUSTEE_KP_HOME': '/usr/share/keytrustee-keyprovider', 'CLOUDERA_ORACLE_CONNECTOR_JAR': '/usr/share/java/oracle-connector-java.jar', 'CDH_SQOOP2_HOME': '/usr/lib/sqoop2', 'KEYTRUS-TEE_SERVER_HOME': '/usr/lib/keytrustee-server', 'CDH_MR2_HOME': '/usr/lib/hadoop-mapreduce', 'HIVE_DEFAULT_XML': '/etc/hive/conf.dist/hive-default.xml', 'CLOUDERA_POSTGRESQL_JDBC_JAR': '/usr/share/cmf/lib/postgresql-9.0-801.jdbc4.jar', 'CDH_KMS_HOME': '/usr/lib/hadoop-kms', 'CDH_HBASE_HOME': '/usr/lib/hbase', 'CDH_SQOOP_HOME': '/usr/lib/sqoop', 'WEBHCAT_DEFAULT_XML': '/etc/hive-webhcat/conf.dist/webhcat-default.xml', 'CDH_OOZIE_HOME': '/usr/lib/oozie', 'SUDO': 'sudo', 'CDH_ZOOKEEPER_HOME': '/usr/lib/zookeeper', 'CDH_HUE_HOME': '/usr/lib/hue', 'CLOUDERA_MYSQL_CONNECTOR_JAR': '/usr/share/java/mysql-connector-java.jar', 'CDH_HBASE_INDEXER_HOME': '/usr/lib/hbase-solr', 'CDH_MR1_HOME': '/usr/lib/hadoop-0.20-mapreduce', 'CDH_SOLR_HOME': '/usr/lib/solr', 'CDH_PIG_HOME': '/usr/lib/pig', 'CDH_SENTRY_HOME': '/usr/lib/sentry', 'CDH_CRUNCH_HOME': '/usr/lib/crunch', 'CDH_LLAMA_HOME': '/usr/lib/llama/', 'CDH_HTTPFS_HOME': '/usr/lib/hadoop-httpfs', 'CDH_HADOOP_HOME': '/usr/lib/hadoop', 'CDH_HIVE_HOME': '/usr/lib/hive', 'ORACLE_HOME': '/usr/share/oracle/instantclient', 'CDH_HCAT_HOME': '/usr/lib/hive-hcatalog', 'CDH_KAFKA_HOME': '/usr/lib/kafka', 'CDH_SPARK_HOME': '/usr/lib/spark', 'TOMCAT_HOME': '/usr/lib/bigtop-tomcat', 'CDH_FLUME_HOME': '/usr/lib/flume-ng'} >>[24/Aug/2017 15:47:21 +0000] 9533 MainThread agent INFO To override these varia-bles, use /etc/cloudera-scm-agent/config.ini. Environment variables for CDH locations are not used when CDH is installed from parcels. >>[24/Aug/2017 15:47:21 +0000] 9533 MainThread agent INFO Re-using pre-existing di-rectory: /run/cloudera-scm-agent/process >>[24/Aug/2017 15:47:21 +0000] 9533 MainThread agent INFO Re-using pre-existing di-rectory: /run/cloudera-scm-agent/supervisor >>[24/Aug/2017 15:47:21 +0000] 9533 MainThread agent INFO Re-using pre-existing di-rectory: /run/cloudera-scm-agent/flood >>[24/Aug/2017 15:47:21 +0000] 9533 MainThread agent INFO Re-using pre-existing di-rectory: /run/cloudera-scm-agent/supervisor/include >>[24/Aug/2017 15:47:21 +0000] 9533 MainThread agent ERROR Failed to connect to previous supervisor. >>Traceback (most recent call last): >> File "/usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/cmf-5.12.0-py2.7.egg/cmf/agent.py", line 2109, in find_or_start_supervisor >> self.configure_supervisor_clients() >> File "/usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/cmf-5.12.0-py2.7.egg/cmf/agent.py", line 2290, in configure_supervisor_clients >> supervisor_options.realize(args=["-c", os.path.join(self.supervisor_dir, "supervi-sord.conf")]) >> File "/usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/supervisor-3.0-py2.7.egg/supervisor/options.py", line 1599, in realize >> Options.realize(self, *arg, **kw) >> File "/usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/supervisor-3.0-py2.7.egg/supervisor/options.py", line 333, in realize >> self.process_config() >> File "/usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/supervisor-3.0-py2.7.egg/supervisor/options.py", line 341, in process_config >> self.process_config_file(do_usage) >> File "/usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/supervisor-3.0-py2.7.egg/supervisor/options.py", line 376, in process_config_file >> self.usage(str(msg)) >> File "/usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/supervisor-3.0-py2.7.egg/supervisor/options.py", line 164, in usage >> self.exit(2) >>SystemExit: 2 >>[24/Aug/2017 15:47:21 +0000] 9533 Dummy-1 daemonize WARNING Stopping dae-mon. >>[24/Aug/2017 15:47:21 +0000] 9533 Dummy-1 agent INFO Stopping agent... rustee-server', 'CDH_MR2_HOME': '/usr/lib/hadoop-mapreduce', 'HIVE_DEFAULT_XML': '/etc/hive/conf.dist/hive-default.xml', 'CLOUDERA_POSTGRESQL_JDBC_JAR': '/usr/share/cmf/lib/postgresql-9.0-801.jdbc4.jar', 'CDH_KMS_HOME': '/usr/lib/hadoop-kms', 'CDH_HBASE_HOME': '/usr/lib/hbase', 'CDH_SQOOP_HOME': '/usr/lib/sqoop', 'WEBHCAT_DEFAULT_XML': '/etc/hive-webhcat/conf.dist/webhcat-default.xml', 'CDH_OOZIE_HOME': '/usr/lib/oozie', 'SUDO': 'sudo', 'CDH_ZOOKEEPER_HOME': '/usr/lib/zookeeper', 'CDH_HUE_HOME': '/usr/lib/hue', 'CLOUDERA_MYSQL_CONNECTOR_JAR': '/usr/share/java/mysql-connector-java.jar', 'CDH_HBASE_INDEXER_HOME': '/usr/lib/hbase-solr', 'CDH_MR1_HOME': '/usr/lib/hadoop-0.20-mapreduce', 'CDH_SOLR_HOME': '/usr/lib/solr', 'CDH_PIG_HOME': '/usr/lib/pig', 'CDH_SENTRY_HOME': '/usr/lib/sentry', 'CDH_CRUNCH_HOME': '/usr/lib/crunch', 'CDH_LLAMA_HOME': '/usr/lib/llama/', 'CDH_HTTPFS_HOME': '/usr/lib/hadoop-httpfs', 'CDH_HADOOP_HOME': '/usr/lib/hadoop', 'CDH_HIVE_HOME': '/usr/lib/hive', 'ORACLE_HOME': '/usr/share/oracle/instantclient', 'CDH_HCAT_HOME': '/usr/lib/hive-hcatalog', 'CDH_KAFKA_HOME': '/usr/lib/kafka', 'CDH_SPARK_HOME': '/usr/lib/spark', 'TOMCAT_HOME': '/usr/lib/bigtop-tomcat', 'CDH_FLUME_HOME': '/usr/lib/flume-ng'} >>[24/Aug/2017 15:47:21 +0000] 9533 MainThread agent INFO To override these varia-bles, use /etc/cloudera-scm-agent/config.ini. Environment variables for CDH locations are not used when CDH is installed from parcels. >>[24/Aug/2017 15:47:21 +0000] 9533 MainThread agent INFO Re-using pre-existing di-rectory: /run/cloudera-scm-agent/process >>[24/Aug/2017 15:47:21 +0000] 9533 MainThread agent INFO Re-using pre-existing di-rectory: /run/cloudera-scm-agent/supervisor >>[24/Aug/2017 15:47:21 +0000] 9533 MainThread agent INFO Re-using pre-existing di-rectory: /run/cloudera-scm-agent/flood >>[24/Aug/2017 15:47:21 +0000] 9533 MainThread agent INFO Re-using pre-existing di-rectory: /run/cloudera-scm-agent/supervisor/include >>[24/Aug/2017 15:47:21 +0000] 9533 MainThread agent ERROR Failed to connect to previous supervisor. >>Traceback (most recent call last): >> File "/usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/cmf-5.12.0-py2.7.egg/cmf/agent.py", line 2109, in find_or_start_supervisor >> self.configure_supervisor_clients() >> File "/usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/cmf-5.12.0-py2.7.egg/cmf/agent.py", line 2290, in configure_supervisor_clients >> supervisor_options.realize(args=["-c", os.path.join(self.supervisor_dir, "supervi-sord.conf")]) >> File "/usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/supervisor-3.0-py2.7.egg/supervisor/options.py", line 1599, in realize >> Options.realize(self, *arg, **kw) >> File "/usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/supervisor-3.0-py2.7.egg/supervisor/options.py", line 333, in realize >> self.process_config() >> File "/usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/supervisor-3.0-py2.7.egg/supervisor/options.py", line 341, in process_config >> self.process_config_file(do_usage) >> File "/usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/supervisor-3.0-py2.7.egg/supervisor/options.py", line 376, in process_config_file >> self.usage(str(msg)) >> File "/usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/supervisor-3.0-py2.7.egg/supervisor/options.py", line 164, in usage >> self.exit(2) >>SystemExit: 2 >>[24/Aug/2017 15:47:21 +0000] 9533 Dummy-1 daemonize WARNING Stopping dae-mon. >>[24/Aug/2017 15:47:21 +0000] 9533 Dummy-1 agent INFO Stopping agent... END (0) end of agent logs. scm agent restarted Installation script completed successfully. all done closing logging file descriptor My /etc/hosts file is: 127.0.0.1 localhost #127.0.0.1 PC355406 10.x.y.z PC355406 # The following lines are desirable for IPv6 capable hosts ::1 ip6-localhost ip6-loopback fe00::0 ip6-localnet ff00::0 ip6-mcastprefix ff02::1 ip6-allnodes ff02::2 ip6-allrouters Kindly Provide me a solution.
Created on 08-29-2017 02:09 AM - edited 08-29-2017 02:17 AM
if its a testing enviroment see if you can disable firewall or iptable .
restart the cloudera manager daemons
finally check the jvm version on the cluster make sure you dont have multiple java hanging out in the cluster
since i dont have direct access to your cluster i am throwing all my guess.
are you following the path A installation of Cloudera manager using binary file . ?
https://www.cloudera.com/documentation/enterprise/5-5-x/topics/cm_ig_install_path_a.html
Created 08-29-2017 02:54 AM
based on your stack trace, it's likely you're running into the same issue as a fellow community member [0], can you try the workaround posted in the [1]
[24/Aug/2017 15:47:21 +0000] 9533 MainThread agent ERROR Failed to connect to previous supervisor. >>Tr...f/agent/build/env/lib/python2.7/site-packages/cmf-5.12.0-py2.7.egg/cmf/agent.py", line 2109, in find_or_start_supervisor >> self.configure_supervisor_clients() >> File "/usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/cmf-5.12.0-py2.7.egg/cmf/agent.py", line 2290, in configure_supervisor_clients >> supervisor_options.realize(args=["-c", os.path.join(self.supervisor_dir, "supervi-sord.conf")]) >> File "/usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/supervisor-3.0-py2.7.egg/supervisor/options.py", line 1599, in realize >> Options.realize(self, *arg, **kw) >> File "/usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/supervisor-3.0-py2.7.egg/supervisor/options.py", line 333, in realize >> self.process_config() >> File "/usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/supervisor-3.0-py2.7.egg/supervisor/options.py", line 341, in process_config >> self.process_config_file(do_usage) >> File "/usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/supervisor-3.0-py2.7.egg/supervisor/options.py", line 376, in process_config_file >> self.usage(str(msg)) >> File "/usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/supervisor-3.0-py2.7.egg/supervisor/options.py", line 164, in usage >> self.exit(2) >>SystemExit: 2 >>[24/Aug/2017 15:47:21 +0000] 9533 Dummy-1 daemonize WARNING Stopping dae-mon. >>[24/Aug/2017 15:47:21 +0000] 9533 Dummy-1 agent INFO Stopping agent...
Created 08-29-2017 03:53 AM
Hi
I have tried the solution you told me to run umount /run/user/42/gvfs command so i got this:
root@PC355406:/# for mnt in $(mount|cut -d ' ' -f 3); do stat $mnt 1>/dev/null 2>&1; rc=$?; if [ $rc -ne 0 ]; then echo "error accessing $mnt"; fi; done error accessing /run/user/1000/gvfs root@PC355406:/# mount sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime) proc on /proc type proc (rw,nosuid,nodev,noexec,relatime) udev on /dev type devtmpfs (rw,nosuid,relatime,size=8151824k,nr_inodes=2037956,mode=755) devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000) tmpfs on /run type tmpfs (rw,nosuid,noexec,relatime,size=1635248k,mode=755) /dev/sda1 on / type ext4 (rw,relatime,errors=remount-ro,data=ordered) securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime) tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev) tmpfs on /run/lock type tmpfs (rw,nosuid,nodev,noexec,relatime,size=5120k) tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755) cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/lib/systemd/systemd-cgroups-agent,name=systemd) pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime) cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices) cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio) cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids) cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset) cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct) cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb) cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio) cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event) cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory) cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer) systemd-1 on /proc/sys/fs/binfmt_misc type autofs (rw,relatime,fd=26,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=13687) mqueue on /dev/mqueue type mqueue (rw,relatime) debugfs on /sys/kernel/debug type debugfs (rw,relatime) hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime) fusectl on /sys/fs/fuse/connections type fusectl (rw,relatime) tmpfs on /run/user/123 type tmpfs (rw,nosuid,nodev,relatime,size=1635248k,mode=700,uid=123,gid=130) tmpfs on /run/user/1000 type tmpfs (rw,nosuid,nodev,relatime,size=1635248k,mode=700,uid=1000,gid=1000) gvfsd-fuse on /run/user/1000/gvfs type fuse.gvfsd-fuse (rw,nosuid,nodev,relatime,user_id=1000,group_id=1000) root@PC355406:/# df -h Filesystem Size Used Avail Use% Mounted on udev 7.8G 0 7.8G 0% /dev tmpfs 1.6G 9.7M 1.6G 1% /run /dev/sda1 902G 8.7G 847G 2% / tmpfs 7.8G 55M 7.8G 1% /dev/shm tmpfs 5.0M 4.0K 5.0M 1% /run/lock tmpfs 7.8G 0 7.8G 0% /sys/fs/cgroup tmpfs 1.6G 0 1.6G 0% /run/user/123 tmpfs 1.6G 68K 1.6G 1% /run/user/1000 root@PC355406:/# umount /run/user/42/gvfs umount: /run/user/42/gvfs: mountpoint not found root@PC355406:/# umount /run/user/42 umount: /run/user/42: mountpoint not found root@PC355406:/# file /etc/alternatives/java /etc/alternatives/javac /etc/alternatives/java: symbolic link to /usr/local/java/jdk1.8.0_144/bin/java /etc/alternatives/javac: symbolic link to /usr/lib/jvm/j2sdk1.6-oracle/bin/javac root@PC355406:/# update-java-alternatives -l j2sdk1.6-oracle 315 /usr/lib/jvm/j2sdk1.6-oracle java-1.8.0-openjdk-amd64 1081 /usr/lib/jvm/java-1.8.0-openjdk-amd64 root@PC355406:/# java -version java version "1.8.0_144" Java(TM) SE Runtime Environment (build 1.8.0_144-b01) Java HotSpot(TM) 64-Bit Server VM (build 25.144-b01, mixed mode) root@PC355406:/# javac -version javac 1.6.0_31 root@PC355406:/# gedit /etc/hosts ** (gedit:10775): WARNING **: Set document metadata failed: Setting attribute metadata::gedit-position not supported
Inside this my java version is also shown.
Also now i tried to install the cluster i got this error log:
/tmp/scm_prepare_node.tPO3N5DM using SSH_CLIENT to get the SCM hostname: 10.237.36.112 52464 22 opening logging file descriptor Starting installation script... Acquiring installation lock... BEGIN flock 4 END (0) Detecting root privileges... effective UID is 1000 BEGIN which pbrun END (1) BEGIN sudo -S id uid=0(root) gid=0(root) groups=0(root) END (0) Using 'sudo ' to acquire root privileges Detecting distribution... BEGIN grep 'Ubuntu' /etc/lsb-release END (0) DISTRIB_ID=Ubuntu DISTRIB_DESCRIPTION="Ubuntu 16.04.2 LTS" BEGIN grep DISTRIB_CODENAME /etc/lsb-release END (0) DISTRIB_CODENAME=xenial BEGIN echo DISTRIB_CODENAME=xenial | cut -d = -f 2 xenial END (0) Detecting Cloudera Manager Server... BEGIN host -t PTR 10.237.36.112 END (1) Host 112.36.237.10.in-addr.arpa. not found: 3(NXDOMAIN) BEGIN which python END (0) BEGIN python -c 'import socket; import sys; s = socket.socket(socket.AF_INET); s.settimeout(5.0); s.connect((sys.argv[1], int(sys.argv[2]))); s.close();' 10.237.36.112 7182 /usr/bin/python END (0) BEGIN which wget END (0) /usr/bin/wget BEGIN wget -qO- -T 1 -t 1 http://169.254.169.254/latest/meta-data/public-hostname && /bin/echo END (4) Installing package repositories... validating format of repository file /tmp/scm_prepare_node.tPO3N5DM/repos/ubuntu_xenial/cloudera-manager.list installing repository file /tmp/scm_prepare_node.tPO3N5DM/repos/ubuntu_xenial/cloudera-manager.list repository file /tmp/scm_prepare_node.tPO3N5DM/repos/ubuntu_xenial/cloudera-manager.list installed BEGIN sudo apt-key add /tmp/scm_prepare_node.tPO3N5DM/archive.key OK END (0) installing priority file /tmp/scm_prepare_node.tPO3N5DM/priorities/ubuntu_xenial/cloudera.pref priority file /tmp/scm_prepare_node.tPO3N5DM/priorities/ubuntu_xenial/cloudera.pref installed Refreshing package metadata... BEGIN sudo apt-get update Hit:1 http://repo.mysql.com/apt/ubuntu xenial InRelease Hit:2 http://archive.cloudera.com/cm5/ubuntu/xenial/amd64/cm xenial-cm5 InRelease Hit:3 https://archive.cloudera.com/cdh5/ubuntu/precise/amd64/cdh precise-cdh5 InRelease Hit:4 http://security.ubuntu.com/ubuntu xenial-security InRelease Hit:5 https://archive.cloudera.com/cm5/ubuntu/xenial/amd64/cm xenial-cm5.12.0 InRelease Hit:6 http://in.archive.ubuntu.com/ubuntu xenial InRelease Hit:7 http://in.archive.ubuntu.com/ubuntu xenial-updates InRelease Hit:8 http://in.archive.ubuntu.com/ubuntu xenial-backports InRelease W: http://archive.cloudera.com/cm5/ubuntu/xenial/amd64/cm/dists/xenial-cm5/InRelease: Signature by key F36A89E33CC1BD0F71079007327574EE02A818DD uses weak digest algorithm (SHA1) W: https://archive.cloudera.com/cdh5/ubuntu/precise/amd64/cdh/dists/precise-cdh5/InRelease: Signature by key F36A89E33CC1BD0F71079007327574EE02A818DD uses weak digest algorithm (SHA1) W: https://archive.cloudera.com/cm5/ubuntu/xenial/amd64/cm/dists/xenial-cm5.12.0/InRelease: Signature by key F36A89E33CC1BD0F71079007327574EE02A818DD uses weak digest algorithm (SHA1) E: Could not get lock /var/lib/dpkg/lock - open (11: Resource temporarily unavailable) E: Unable to lock the administration directory (/var/lib/dpkg/), is another process using it? END (100) BEGIN sudo apt-get update Hit:1 http://repo.mysql.com/apt/ubuntu xenial InRelease Hit:2 http://archive.cloudera.com/cm5/ubuntu/xenial/amd64/cm xenial-cm5 InRelease Hit:3 https://archive.cloudera.com/cdh5/ubuntu/precise/amd64/cdh precise-cdh5 InRelease Hit:4 https://archive.cloudera.com/cm5/ubuntu/xenial/amd64/cm xenial-cm5.12.0 InRelease Hit:5 http://in.archive.ubuntu.com/ubuntu xenial InRelease Hit:6 http://security.ubuntu.com/ubuntu xenial-security InRelease Hit:7 http://in.archive.ubuntu.com/ubuntu xenial-updates InRelease Hit:8 http://in.archive.ubuntu.com/ubuntu xenial-backports InRelease W: http://archive.cloudera.com/cm5/ubuntu/xenial/amd64/cm/dists/xenial-cm5/InRelease: Signature by key F36A89E33CC1BD0F71079007327574EE02A818DD uses weak digest algorithm (SHA1) W: https://archive.cloudera.com/cdh5/ubuntu/precise/amd64/cdh/dists/precise-cdh5/InRelease: Signature by key F36A89E33CC1BD0F71079007327574EE02A818DD uses weak digest algorithm (SHA1) W: https://archive.cloudera.com/cm5/ubuntu/xenial/amd64/cm/dists/xenial-cm5.12.0/InRelease: Signature by key F36A89E33CC1BD0F71079007327574EE02A818DD uses weak digest algorithm (SHA1) E: Could not get lock /var/lib/dpkg/lock - open (11: Resource temporarily unavailable) E: Unable to lock the administration directory (/var/lib/dpkg/), is another process using it? END (100) Installing cloudera-manager-agent package... BEGIN sudo dpkg -l cloudera-manager-agent | grep -E '^ii[[:space:]]*cloudera-manager-agent[[:space:]]*' ii cloudera-manager-agent 5.12.0-1.cm5120.p0.120~xenial-cm5 amd64 The Cloudera Manager Agent END (0) BEGIN echo oracle-j2sdk1.6 oracle-j2sdk1.7 cloudera-manager-agent cloudera-manager-daemons | grep cloudera-manager-agent oracle-j2sdk1.6 oracle-j2sdk1.7 cloudera-manager-agent cloudera-manager-daemons END (0) BEGIN sudo apt-cache show cloudera-manager-agent Package: cloudera-manager-agent Source: enterprise Version: 5.12.0-1.cm5120.p0.120~xenial-cm5 Architecture: amd64 Maintainer: Cloudera Inc. <https://issues.cloudera.org> Installed-Size: 44039 Depends: libc6 (>= 2.17), libcomerr2 (>= 1.01), libgcc1 (>= 1:3.0), libgssapi-krb5-2 (>= 1.10+dfsg~), libkrb5-3 (>= 1.6.dfsg.2), libssl1.0.0 (>= 1.0.2~beta3), libstdc++6 (>= 5.2), zlib1g (>= 1:1.2.0), lsb-base, psmisc, bash, libsasl2-modules, libsasl2-modules-gssapi-mit, libxslt1.1, libsqlite3-0, openssl, libssl-dev, libfuse2, fuse-utils | fuse, rpcbind, cloudera-manager-daemons (= 5.12.0-1.cm5120.p0.120~xenial-cm5), perl, python-psycopg2, python-mysqldb, apache2, iproute2 Homepage: http://www.cloudera.com Priority: extra Section: misc Filename: pool/contrib/e/enterprise/cloudera-manager-agent_5.12.0-1.cm5120.p0.120~xenial-cm5_amd64.deb Size: 11186376 SHA256: 69618949fb10d631ac301f21f62ecab0a3631eec456b6de43ef9c6a17c107498 SHA1: 6b137a4328780d56f964403ff8c56fe7577935a0 MD5sum: f7c9fc2b393b6d61563ea34ca15b6e61 Description: The Cloudera Manager Agent The Agent is deployed to machines running services managed by Cloudera Manager. Description-md5: 482a592ee859d31443f58aa3e48fe303 END (0) Version: 5.12.0-1.cm5120.p0.120~xenial-cm5 BEGIN sudo apt-get -o Dpkg::Options::=--force-confdef -o Dpkg::Options::=--force-confold -y install cloudera-manager-agent E: Could not get lock /var/lib/dpkg/lock - open (11: Resource temporarily unavailable) E: Unable to lock the administration directory (/var/lib/dpkg/), is another process using it? END (100) remote package cloudera-manager-agent could not be installed, giving up waiting for rollback request
Please help me with that.
Also i am using path A installation only.
Created on 08-29-2017 04:46 AM - edited 08-29-2017 04:47 AM
Hi my iptables are :
sudo sysv-rc-conf iptables –list root@PC355406:/# sudo sysv-rc-conf iptables --list acpid 2:on 3:on 4:on 5:on alsa-utils 0:off 1:off 6:off S:on anacron 2:on 3:on 4:on 5:on apache-htcac 0:off 1:off 2:off 3:off 4:off 5:off 6:off apache2 0:off 1:off 2:on 3:on 4:on 5:on 6:off apparmor S:on apport 2:on 3:on 4:on 5:on avahi-daemon 0:off 1:off 2:on 3:on 4:on 5:on 6:off bluetooth 0:off 1:off 2:on 3:on 4:on 5:on 6:off brltty S:on cloudera-scm 0:off 1:off 2:on 3:on 4:on 5:on 6:off cloudera-scm 0:off 1:off 2:on 3:on 4:on 5:on 6:off cloudera-scm 0:off 1:off 2:on 3:on 4:on 5:on 6:off console-setu S:on cron 2:on 3:on 4:on 5:on cups 1:off 2:on 3:on 4:on 5:on cups-browsed 0:off 1:off 2:on 3:on 4:on 5:on 6:off dbus 2:on 3:on 4:on 5:on dns-clean S:on grub-common 2:on 3:on 4:on 5:on halt 0:off irqbalance 0:off 1:off 2:on 3:on 4:on 5:on 6:off kerneloops 0:off 1:off 2:on 3:on 4:on 5:on 6:off keyboard-set S:on killprocs 1:on kmod S:on lightdm 0:off 1:off 2:on 3:on 4:on 5:on 6:off mysql 0:off 1:off 2:on 3:on 4:on 5:on 6:off network-mana networking 0:off 6:off S:on ondemand 2:on 3:on 4:on 5:on plymouth 0:off 2:on 3:on 4:on 5:on 6:off plymouth-log S:on postgresql 0:off 1:off 2:on 3:on 4:on 5:on 6:off pppd-dns S:on procps S:on rc.local 2:on 3:on 4:on 5:on reboot 6:off resolvconf 0:off 6:off S:on rpcbind 0:off 1:off 6:off S:on rsync 2:on 3:on 4:on 5:on rsyslog 0:off 1:off 2:on 3:on 4:on 5:on 6:off saned 1:off 2:on 3:on 4:on 5:on sendsigs 0:off 6:off single 1:on speech-dispa 0:off 1:off 2:on 3:on 4:on 5:on 6:off ssh 2:on 3:on 4:on 5:on sysstat 2:on 3:on 4:on 5:on thermald 0:off 1:off 2:on 3:on 4:on 5:on 6:off udev S:on ufw 1:off S:on umountfs 0:off 6:off umountroot 0:off 6:off unattended-u 0:off 6:off urandom 0:off 6:off S:on uuidd 0:off 1:off 2:on 3:on 4:on 5:on 6:off whoopsie 1:off 2:on 3:on 4:on 5:on x11-common S:on
also java versions are:
root@PC355406:/# file /etc/alternatives/java /etc/alternatives/javac /etc/alternatives/java: symbolic link to /usr/local/java/jdk1.8.0_144/bin/java /etc/alternatives/javac: symbolic link to /usr/lib/jvm/j2sdk1.6-oracle/bin/javac root@PC355406:/# update-java-alternatives -l j2sdk1.6-oracle 315 /usr/lib/jvm/j2sdk1.6-oracle java-1.8.0-openjdk-amd64 1081 /usr/lib/jvm/java-1.8.0-openjdk-amd64 root@PC355406:/# java -version java version "1.8.0_144" Java(TM) SE Runtime Environment (build 1.8.0_144-b01) Java HotSpot(TM) 64-Bit Server VM (build 25.144-b01, mixed mode) root@PC355406:/# javac -version javac 1.6.0_31
and i am following the path A installation process only.
Kindly tell me if any changes required.
Thanks
Created 08-31-2017 10:42 AM
The bash for loop that you executed indicated which mount point is inaccessible, you should try umounting that and see if you can progress.
root@PC355406:/# for mnt in $(mount|cut -d ' ' -f 3); do stat $mnt 1>/dev/null 2>&1; rc=$?; if [ $rc -ne 0 ]; then echo "error accessing $mnt"; fi; done error accessing /run/user/1000/gvfs
Created 09-01-2017 03:23 AM
Hi,
I have unmounted that and now after executing that loop there is no error but still i am not able to install cluster. Same erro is there.
Please help.
Thanks,
Amit
Created 09-01-2017 02:28 PM
Hi Amit,
The solution I've provided was for the issue you've reported initially/at the begining of this thread, I can see that you are reporting multiple issues. Would you mind clarifying what you meant "Same error is there.", this is so I or a community member can guide you accordingly.
Thank you,
M
Created 09-03-2017 09:20 PM
Hi,
By mentioning "same error", i mean to say that i am still not able to install cluster in cloudera as it is still giving me the error "Unable to find heartbeat". There are 5 possible error mentioned in details which i already removed ("As i off i think so"). Above i have sent the logs of error i am getting alongwith my iptables view and /etc/cloudera-scm-agent/config.ini file so that u can tell me whats exactly the error is. Also i have sent the details of my etc/hosts file and my hostname.
Kindly help me with issue.
Thanks,
Amit Kumar
Created 09-05-2017 09:43 AM
Hi Amit,
Looking into the errors your've posted the initial issue can be likely resolved using the workaround I've posted initially. The second issue is likely that an old apt thread is locking the package manager, see below. You might need to kill the other process which is holding the lock, once you've done so it will allow the package manager to proceed with the installation.
...
E: Could not get lock /var/lib/dpkg/lock - open (11: Resource temporarily unavailable) E: Unable to lock the administration directory (/var/lib/dpkg/), is another process using it?
...
Best,
Michalis
Created 09-05-2017 09:27 PM
Hi,
That error is resolved thanks for help. But i am stuck at "Failed to receive heartbeat from agent".
/tmp/scm_prepare_node.bK5vQRgw using SSH_CLIENT to get the SCM hostname: 10.x.y.z 38830 22 opening logging file descriptor Starting installation script... Acquiring installation lock... BEGIN flock 4 END (0) Detecting root privileges... effective UID is 0 Detecting distribution... BEGIN grep 'Ubuntu' /etc/lsb-release DISTRIB_ID=Ubuntu DISTRIB_DESCRIPTION="Ubuntu 16.04.2 LTS" END (0) BEGIN grep DISTRIB_CODENAME /etc/lsb-release END (0) DISTRIB_CODENAME=xenial BEGIN echo DISTRIB_CODENAME=xenial | cut -d = -f 2 xenial END (0) Detecting Cloudera Manager Server... BEGIN host -t PTR 10.x.y.z Host z.y.x.10.in-addr.arpa. not found: 3(NXDOMAIN) END (1) BEGIN which python /usr/bin/python END (0) BEGIN python -c 'import socket; import sys; s = socket.socket(socket.AF_INET); s.settimeout(5.0); s.connect((sys.argv[1], int(sys.argv[2]))); s.close();' 10.x.y.z 7182 END (0) BEGIN which wget /usr/bin/wget END (0) BEGIN wget -qO- -T 1 -t 1 http://169.254.169.254/latest/meta-data/public-hostname && /bin/echo END (4) Installing package repositories... validating format of repository file /tmp/scm_prepare_node.bK5vQRgw/repos/ubuntu_xenial/cloudera-manager.list installing repository file /tmp/scm_prepare_node.bK5vQRgw/repos/ubuntu_xenial/cloudera-manager.list repository file /tmp/scm_prepare_node.bK5vQRgw/repos/ubuntu_xenial/cloudera-manager.list installed BEGIN apt-key add /tmp/scm_prepare_node.bK5vQRgw/archive.key OK END (0) installing priority file /tmp/scm_prepare_node.bK5vQRgw/priorities/ubuntu_xenial/cloudera.pref priority file /tmp/scm_prepare_node.bK5vQRgw/priorities/ubuntu_xenial/cloudera.pref in-stalled Refreshing package metadata... BEGIN apt-get update Hit:1 http://archive.cloudera.com/cm5/ubuntu/xenial/amd64/cm xenial-cm5 InRelease Hit:2 https://archive.cloudera.com/cdh5/ubuntu/precise/amd64/cdh precise-cdh5 InRe-lease Hit:3 http://repo.mysql.com/apt/ubuntu xenial InRelease Hit:4 https://archive.cloudera.com/cm5/ubuntu/xenial/amd64/cm xenial-cm5.12.0 InRe-lease Hit:5 http://in.archive.ubuntu.com/ubuntu xenial InRelease Get:6 http://security.ubuntu.com/ubuntu xenial-security InRelease [102 kB] Get:7 http://in.archive.ubuntu.com/ubuntu xenial-updates InRelease [102 kB] Get:8 http://security.ubuntu.com/ubuntu xenial-security/main amd64 DEP-11 Metadata [60.2 kB] Get:9 http://security.ubuntu.com/ubuntu xenial-security/main DEP-11 64x64 Icons [52.0 kB] Get:10 http://in.archive.ubuntu.com/ubuntu xenial-backports InRelease [102 kB] Get:11 http://in.archive.ubuntu.com/ubuntu xenial-updates/main amd64 DEP-11 Metada-ta [305 kB] Get:12 http://security.ubuntu.com/ubuntu xenial-security/universe amd64 DEP-11 Metadata [48.8 kB] Get:13 http://security.ubuntu.com/ubuntu xenial-security/universe DEP-11 64x64 Icons [64.2 kB] Get:14 http://in.archive.ubuntu.com/ubuntu xenial-updates/main DEP-11 64x64 Icons [206 kB] Get:15 http://in.archive.ubuntu.com/ubuntu xenial-updates/universe amd64 DEP-11 Metadata [171 kB] Get:16 http://in.archive.ubuntu.com/ubuntu xenial-updates/universe DEP-11 64x64 Icons [224 kB] Get:17 http://in.archive.ubuntu.com/ubuntu xenial-updates/multiverse amd64 DEP-11 Metadata [5,892 B] Get:18 http://in.archive.ubuntu.com/ubuntu xenial-backports/main amd64 DEP-11 Metadata [3,324 B] Get:19 http://in.archive.ubuntu.com/ubuntu xenial-backports/universe amd64 DEP-11 Metadata [5,136 B] Fetched 1,451 kB in 6s (241 kB/s) Reading package lists... W: http://archive.cloudera.com/cm5/ubuntu/xenial/amd64/cm/dists/xenial-cm5/InRelease: Signature by key F36A89E33CC1BD0F71079007327574EE02A818DD uses weak digest algorithm (SHA1) W: https://archive.cloudera.com/cdh5/ubuntu/precise/amd64/cdh/dists/precise-cdh5/InRelease: Signature by key F36A89E33CC1BD0F71079007327574EE02A818DD uses weak digest algorithm (SHA1) W: https://archive.cloudera.com/cm5/ubuntu/xenial/amd64/cm/dists/xenial-cm5.12.0/InRelease: Signature by key F36A89E33CC1BD0F71079007327574EE02A818DD uses weak digest algorithm (SHA1) END (0) BEGIN apt-get update Hit:1 http://repo.mysql.com/apt/ubuntu xenial InRelease Hit:2 http://archive.cloudera.com/cm5/ubuntu/xenial/amd64/cm xenial-cm5 InRelease Hit:3 https://archive.cloudera.com/cdh5/ubuntu/precise/amd64/cdh precise-cdh5 InRe-lease Hit:4 https://archive.cloudera.com/cm5/ubuntu/xenial/amd64/cm xenial-cm5.12.0 InRe-lease Hit:5 http://security.ubuntu.com/ubuntu xenial-security InRelease Hit:6 http://in.archive.ubuntu.com/ubuntu xenial InRelease Hit:7 http://in.archive.ubuntu.com/ubuntu xenial-updates InRelease Hit:8 http://in.archive.ubuntu.com/ubuntu xenial-backports InRelease Reading package lists... W: http://archive.cloudera.com/cm5/ubuntu/xenial/amd64/cm/dists/xenial-cm5/InRelease: Signature by key F36A89E33CC1BD0F71079007327574EE02A818DD uses weak digest algorithm (SHA1) W: https://archive.cloudera.com/cdh5/ubuntu/precise/amd64/cdh/dists/precise-cdh5/InRelease: Signature by key F36A89E33CC1BD0F71079007327574EE02A818DD uses weak digest algorithm (SHA1) W: https://archive.cloudera.com/cm5/ubuntu/xenial/amd64/cm/dists/xenial-cm5.12.0/InRelease: Signature by key F36A89E33CC1BD0F71079007327574EE02A818DD uses weak digest algorithm (SHA1) END (0) Installing cloudera-manager-agent package... BEGIN dpkg -l cloudera-manager-agent | grep -E '^ii[[:space:]]*cloudera-manager-agent[[:space:]]*' ii cloudera-manager-agent 5.12.0-1.cm5120.p0.120~xenial-cm5 amd64 The Cloudera Manager Agent END (0) BEGIN echo oracle-j2sdk1.6 oracle-j2sdk1.7 cloudera-manager-agent cloudera-manager-daemons | grep cloudera-manager-agent oracle-j2sdk1.6 oracle-j2sdk1.7 cloudera-manager-agent cloudera-manager-daemons END (0) BEGIN apt-cache show cloudera-manager-agent Package: cloudera-manager-agent Source: enterprise Version: 5.12.0-1.cm5120.p0.120~xenial-cm5 Architecture: amd64 Maintainer: Cloudera Inc. <https://issues.cloudera.org> Installed-Size: 44039 Depends: libc6 (>= 2.17), libcomerr2 (>= 1.01), libgcc1 (>= 1:3.0), libgssapi-krb5-2 (>= 1.10+dfsg~), libkrb5-3 (>= 1.6.dfsg.2), libssl1.0.0 (>= 1.0.2~beta3), libstdc++6 (>= 5.2), zlib1g (>= 1:1.2.0), lsb-base, psmisc, bash, libsasl2-modules, libsasl2-modules-gssapi-mit, libxslt1.1, libsqlite3-0, openssl, libssl-dev, libfuse2, fuse-utils | fuse, rpcbind, cloudera-manager-daemons (= 5.12.0-1.cm5120.p0.120~xenial-cm5), perl, python-psycopg2, py-thon-mysqldb, apache2, iproute2 Homepage: http://www.cloudera.com Priority: extra Section: misc Filename: pool/contrib/e/enterprise/cloudera-manager-agent_5.12.0-1.cm5120.p0.120~xenial-cm5_amd64.deb Size: 11186376 SHA256: 69618949fb10d631ac301f21f62ecab0a3631eec456b6de43ef9c6a17c107498 SHA1: 6b137a4328780d56f964403ff8c56fe7577935a0 MD5sum: f7c9fc2b393b6d61563ea34ca15b6e61 Description: The Cloudera Manager Agent The Agent is deployed to machines running services managed by Cloudera Manager. Description-md5: 482a592ee859d31443f58aa3e48fe303 END (0) Version: 5.12.0-1.cm5120.p0.120~xenial-cm5 BEGIN apt-get -o Dpkg::Options::=--force-confdef -o Dpkg::Options::=--force-confold -y in-stall cloudera-manager-agent Reading package lists... Building dependency tree... Reading state information... cloudera-manager-agent is already the newest version (5.12.0-1.cm5120.p0.120~xenial-cm5). 0 upgraded, 0 newly installed, 0 to remove and 347 not upgraded. END (0) remote package cloudera-manager-agent installed Installing cloudera-manager-daemons package... BEGIN dpkg -l cloudera-manager-daemons | grep -E '^ii[[:space:]]*cloudera-manager-daemons[[:space:]]*' ii cloudera-manager-daemons 5.12.0-1.cm5120.p0.120~xenial-cm5 all Provides daemons for monitoring Hadoop and related tools. END (0) BEGIN echo oracle-j2sdk1.6 oracle-j2sdk1.7 cloudera-manager-agent cloudera-manager-daemons | grep cloudera-manager-daemons oracle-j2sdk1.6 oracle-j2sdk1.7 cloudera-manager-agent cloudera-manager-daemons END (0) BEGIN apt-cache show cloudera-manager-daemons Package: cloudera-manager-daemons Source: enterprise Version: 5.12.0-1.cm5120.p0.120~xenial-cm5 Architecture: all Maintainer: Cloudera Inc. <https://issues.cloudera.org> Installed-Size: 869404 Depends: perl Homepage: http://www.cloudera.com Priority: extra Section: misc Filename: pool/contrib/e/enterprise/cloudera-manager-daemons_5.12.0-1.cm5120.p0.120~xenial-cm5_all.deb Size: 737883268 SHA256: cf168ac13387bef54c61034e7cfef49539b1616cfb876f91db5dfe458d237780 SHA1: a18ed00de131d0c358411104fb3d886e0c211101 MD5sum: 47813b5493281f58b36ca33868229394 Description: Provides daemons for monitoring Hadoop and related tools. Provides daemons for monitoring Hadoop and related tools. Description-md5: 35bb5bc8fc2f296f791c3bda9e345340 END (0) Version: 5.12.0-1.cm5120.p0.120~xenial-cm5 BEGIN apt-get -o Dpkg::Options::=--force-confdef -o Dpkg::Options::=--force-confold -y in-stall cloudera-manager-daemons Reading package lists... Building dependency tree... Reading state information... cloudera-manager-daemons is already the newest version (5.12.0-1.cm5120.p0.120~xenial-cm5). 0 upgraded, 0 newly installed, 0 to remove and 347 not upgraded. END (0) remote package cloudera-manager-daemons installed Installing Unlimited Strength Encryption policy files. Installation not requested. Step will be skipped. Configuring Cloudera Manager Agent... BEGIN grep server_host=10.x.y.z /etc/cloudera-scm-agent/config.ini server_host=10.x.y.z END (0) scm agent is already configured BEGIN sed -e 's/#\(USER=.*\)/\1/' -i /etc/default/cloudera-scm-agent END (0) Starting Cloudera Manager Agent... BEGIN /usr/sbin/service cloudera-scm-agent status * cloudera-scm-agent.service - LSB: Cloudera SCM Agent Loaded: loaded (/etc/init.d/cloudera-scm-agent; bad; vendor preset: enabled) Active: active (exited) since Thu 2017-08-24 15:47:19 IST; 58min ago Docs: man:systemd-sysv-generator(8) Process: 9473 ExecStop=/etc/init.d/cloudera-scm-agent stop (code=exited, sta-tus=0/SUCCESS) Process: 9496 ExecStart=/etc/init.d/cloudera-scm-agent start (code=exited, sta-tus=0/SUCCESS) Aug 24 15:47:17 PC355406 systemd[1]: Starting LSB: Cloudera SCM Agent... Aug 24 15:47:17 PC355406 su[9516]: Successful su for cloudera-scm by root Aug 24 15:47:17 PC355406 su[9516]: + ??? root:cloudera-scm Aug 24 15:47:17 PC355406 su[9516]: pam_unix(su:session): session opened for user cloudera-scm by (uid=0) Aug 24 15:47:19 PC355406 cloudera-scm-agent[9496]: Starting cloudera-scm-agent: * cloudera-scm-agent started Aug 24 15:47:19 PC355406 systemd[1]: Started LSB: Cloudera SCM Agent. END (0) BEGIN /usr/sbin/service cloudera-scm-agent restart END (0) agent logs: BEGIN tail -n 50 /var/log/cloudera-scm-agent//cloudera-scm-agent.out | sed 's/^/>>/' >>[24/Aug/2017 12:55:20 +0000] 1442 MainThread agent INFO Re-using pre-existing di-rectory: /run/cloudera-scm-agent >>/usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/cmf-5.12.0-py2.7.egg/cmf/redaction.py:260: SyntaxWarning: name 'REDACTOR' is assigned to be-fore global declaration >> global REDACTOR >>/usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/cmf-5.12.0-py2.7.egg/cmf/redaction.py:261: SyntaxWarning: name 'NOP_REDACTOR' is assigned to before global declaration >> global NOP_REDACTOR >>[24/Aug/2017 13:03:49 +0000] 1426 MainThread agent INFO SCM Agent Version: 5.12.0 >>[24/Aug/2017 13:03:49 +0000] 1426 MainThread agent WARNING Expected mode 0751 for /run/cloudera-scm-agent but was 0755 >>[24/Aug/2017 13:03:49 +0000] 1426 MainThread agent INFO Re-using pre-existing di-rectory: /run/cloudera-scm-agent >>/usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/cmf-5.12.0-py2.7.egg/cmf/redaction.py:260: SyntaxWarning: name 'REDACTOR' is assigned to be-fore global declaration >> global REDACTOR >>/usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/cmf-5.12.0-py2.7.egg/cmf/redaction.py:261: SyntaxWarning: name 'NOP_REDACTOR' is assigned to before global declaration >> global NOP_REDACTOR >>[24/Aug/2017 13:06:32 +0000] 4147 MainThread agent INFO SCM Agent Version: 5.12.0 >>[24/Aug/2017 13:06:32 +0000] 4147 MainThread agent WARNING Expected mode 0751 for /run/cloudera-scm-agent but was 0755 >>[24/Aug/2017 13:06:32 +0000] 4147 MainThread agent INFO Re-using pre-existing di-rectory: /run/cloudera-scm-agent >>/usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/cmf-5.12.0-py2.7.egg/cmf/redaction.py:260: SyntaxWarning: name 'REDACTOR' is assigned to be-fore global declaration >> global REDACTOR >>/usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/cmf-5.12.0-py2.7.egg/cmf/redaction.py:261: SyntaxWarning: name 'NOP_REDACTOR' is assigned to before global declaration >> global NOP_REDACTOR >>[24/Aug/2017 15:38:40 +0000] 6308 MainThread agent INFO SCM Agent Version: 5.12.0 >>[24/Aug/2017 15:38:40 +0000] 6308 MainThread agent WARNING Expected mode 0751 for /run/cloudera-scm-agent but was 0755 >>[24/Aug/2017 15:38:40 +0000] 6308 MainThread agent INFO Re-using pre-existing di-rectory: /run/cloudera-scm-agent >>/usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/cmf-5.12.0-py2.7.egg/cmf/redaction.py:260: SyntaxWarning: name 'REDACTOR' is assigned to be-fore global declaration >> global REDACTOR >>/usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/cmf-5.12.0-py2.7.egg/cmf/redaction.py:261: SyntaxWarning: name 'NOP_REDACTOR' is assigned to before global declaration >> global NOP_REDACTOR >>[24/Aug/2017 15:40:25 +0000] 7651 MainThread agent INFO SCM Agent Version: 5.12.0 >>[24/Aug/2017 15:40:25 +0000] 7651 MainThread agent WARNING Expected mode 0751 for /run/cloudera-scm-agent but was 0755 >>[24/Aug/2017 15:40:25 +0000] 7651 MainThread agent INFO Re-using pre-existing di-rectory: /run/cloudera-scm-agent >>/usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/cmf-5.12.0-py2.7.egg/cmf/redaction.py:260: SyntaxWarning: name 'REDACTOR' is assigned to be-fore global declaration >> global REDACTOR >>/usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/cmf-5.12.0-py2.7.egg/cmf/redaction.py:261: SyntaxWarning: name 'NOP_REDACTOR' is assigned to before global declaration >> global NOP_REDACTOR >>[24/Aug/2017 15:43:14 +0000] 8111 MainThread agent INFO SCM Agent Version: 5.12.0 >>[24/Aug/2017 15:43:14 +0000] 8111 MainThread agent WARNING Expected mode 0751 for /run/cloudera-scm-agent but was 0755 >>[24/Aug/2017 15:43:14 +0000] 8111 MainThread agent INFO Re-using pre-existing di-rectory: /run/cloudera-scm-agent >>/usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/cmf-5.12.0-py2.7.egg/cmf/redaction.py:260: SyntaxWarning: name 'REDACTOR' is assigned to be-fore global declaration >> global REDACTOR >>/usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/cmf-5.12.0-py2.7.egg/cmf/redaction.py:261: SyntaxWarning: name 'NOP_REDACTOR' is assigned to before global declaration >> global NOP_REDACTOR >>[24/Aug/2017 15:47:19 +0000] 9518 MainThread agent INFO SCM Agent Version: 5.12.0 >>[24/Aug/2017 15:47:19 +0000] 9518 MainThread agent WARNING Expected mode 0751 for /run/cloudera-scm-agent but was 0755 >>[24/Aug/2017 15:47:19 +0000] 9518 MainThread agent INFO Re-using pre-existing di-rectory: /run/cloudera-scm-agent >>/usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/cmf-5.12.0-py2.7.egg/cmf/redaction.py:260: SyntaxWarning: name 'REDACTOR' is assigned to be-fore global declaration >> global REDACTOR >>/usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/cmf-5.12.0-py2.7.egg/cmf/redaction.py:261: SyntaxWarning: name 'NOP_REDACTOR' is assigned to before global declaration >> global NOP_REDACTOR >>[24/Aug/2017 16:46:11 +0000] 11744 MainThread agent INFO SCM Agent Version: 5.12.0 >>[24/Aug/2017 16:46:11 +0000] 11744 MainThread agent WARNING Expected mode 0751 for /run/cloudera-scm-agent but was 0755 >>[24/Aug/2017 16:46:11 +0000] 11744 MainThread agent INFO Re-using pre-existing directory: /run/cloudera-scm-agent >>[24/Aug/2017 12:55:20 +0000] 1442 MainThread agent INFO Re-using pre-existing di-rectory: /run/cloudera-scm-agent >>/usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/cmf-5.12.0-py2.7.egg/cmf/redaction.py:260: SyntaxWarning: name 'REDACTOR' is assigned to be-fore global declaration >> global REDACTOR >>/usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/cmf-5.12.0-py2.7.egg/cmf/redaction.py:261: SyntaxWarning: name 'NOP_REDACTOR' is assigned to before global declaration >> global NOP_REDACTOR >>[24/Aug/2017 13:03:49 +0000] 1426 MainThread agent INFO SCM Agent Version: 5.12.0 >>[24/Aug/2017 13:03:49 +0000] 1426 MainThread agent WARNING Expected mode 0751 for /run/cloudera-scm-agent but was 0755 >>[24/Aug/2017 13:03:49 +0000] 1426 MainThread agent INFO Re-using pre-existing di-rectory: /run/cloudera-scm-agent >>/usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/cmf-5.12.0-py2.7.egg/cmf/redaction.py:260: SyntaxWarning: name 'REDACTOR' is assigned to be-fore global declaration >> global REDACTOR >>/usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/cmf-5.12.0-py2.7.egg/cmf/redaction.py:261: SyntaxWarning: name 'NOP_REDACTOR' is assigned to before global declaration >> global NOP_REDACTOR >>[24/Aug/2017 13:06:32 +0000] 4147 MainThread agent INFO SCM Agent Version: 5.12.0 >>[24/Aug/2017 13:06:32 +0000] 4147 MainThread agent WARNING Expected mode 0751 for /run/cloudera-scm-agent but was 0755 >>[24/Aug/2017 13:06:32 +0000] 4147 MainThread agent INFO Re-using pre-existing di-rectory: /run/cloudera-scm-agent >>/usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/cmf-5.12.0-py2.7.egg/cmf/redaction.py:260: SyntaxWarning: name 'REDACTOR' is assigned to be-fore global declaration >> global REDACTOR >>/usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/cmf-5.12.0-py2.7.egg/cmf/redaction.py:261: SyntaxWarning: name 'NOP_REDACTOR' is assigned to before global declaration >> global NOP_REDACTOR >>[24/Aug/2017 15:38:40 +0000] 6308 MainThread agent INFO SCM Agent Version: 5.12.0 >>[24/Aug/2017 15:38:40 +0000] 6308 MainThread agent WARNING Expected mode 0751 for /run/cloudera-scm-agent but was 0755 >>[24/Aug/2017 15:38:40 +0000] 6308 MainThread agent INFO Re-using pre-existing di-rectory: /run/cloudera-scm-agent >>/usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/cmf-5.12.0-py2.7.egg/cmf/redaction.py:260: SyntaxWarning: name 'REDACTOR' is assigned to be-fore global declaration >> global REDACTOR >>/usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/cmf-5.12.0-py2.7.egg/cmf/redaction.py:261: SyntaxWarning: name 'NOP_REDACTOR' is assigned to before global declaration >> global NOP_REDACTOR >>[24/Aug/2017 15:40:25 +0000] 7651 MainThread agent INFO SCM Agent Version: 5.12.0 >>[24/Aug/2017 15:40:25 +0000] 7651 MainThread agent WARNING Expected mode 0751 for /run/cloudera-scm-agent but was 0755 >>[24/Aug/2017 15:40:25 +0000] 7651 MainThread agent INFO Re-using pre-existing di-rectory: /run/cloudera-scm-agent >>/usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/cmf-5.12.0-py2.7.egg/cmf/redaction.py:260: SyntaxWarning: name 'REDACTOR' is assigned to be-fore global declaration >> global REDACTOR >>/usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/cmf-5.12.0-py2.7.egg/cmf/redaction.py:261: SyntaxWarning: name 'NOP_REDACTOR' is assigned to before global declaration >> global NOP_REDACTOR >>[24/Aug/2017 15:43:14 +0000] 8111 MainThread agent INFO SCM Agent Version: 5.12.0 >>[24/Aug/2017 15:43:14 +0000] 8111 MainThread agent WARNING Expected mode 0751 for /run/cloudera-scm-agent but was 0755 >>[24/Aug/2017 15:43:14 +0000] 8111 MainThread agent INFO Re-using pre-existing di-rectory: /run/cloudera-scm-agent >>/usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/cmf-5.12.0-py2.7.egg/cmf/redaction.py:260: SyntaxWarning: name 'REDACTOR' is assigned to be-fore global declaration >> global REDACTOR >>/usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/cmf-5.12.0-py2.7.egg/cmf/redaction.py:261: SyntaxWarning: name 'NOP_REDACTOR' is assigned to before global declaration >> global NOP_REDACTOR >>[24/Aug/2017 15:47:19 +0000] 9518 MainThread agent INFO SCM Agent Version: 5.12.0 >>[24/Aug/2017 15:47:19 +0000] 9518 MainThread agent WARNING Expected mode 0751 for /run/cloudera-scm-agent but was 0755 >>[24/Aug/2017 15:47:19 +0000] 9518 MainThread agent INFO Re-using pre-existing di-rectory: /run/cloudera-scm-agent >>/usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/cmf-5.12.0-py2.7.egg/cmf/redaction.py:260: SyntaxWarning: name 'REDACTOR' is assigned to be-fore global declaration >> global REDACTOR >>/usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/cmf-5.12.0-py2.7.egg/cmf/redaction.py:261: SyntaxWarning: name 'NOP_REDACTOR' is assigned to before global declaration >> global NOP_REDACTOR >>[24/Aug/2017 16:46:11 +0000] 11744 MainThread agent INFO SCM Agent Version: 5.12.0 >>[24/Aug/2017 16:46:11 +0000] 11744 MainThread agent WARNING Expected mode 0751 for /run/cloudera-scm-agent but was 0755 >>[24/Aug/2017 16:46:11 +0000] 11744 MainThread agent INFO Re-using pre-existing directory: /run/cloudera-scm-agent END (0) BEGIN tail -n 50 /var/log/cloudera-scm-agent//cloudera-scm-agent.log | sed 's/^/>>/' >>[24/Aug/2017 15:47:19 +0000] 9533 MainThread agent INFO Because agent not run-ning as root, all processes will run with current user. >>[24/Aug/2017 15:47:21 +0000] 9533 MainThread agent INFO Re-using pre-existing di-rectory: /run/cloudera-scm-agent/cgroups >>[24/Aug/2017 15:47:21 +0000] 9533 MainThread cgroups INFO Found existing subsys-tem blkio at /sys/fs/cgroup/blkio >>[24/Aug/2017 15:47:21 +0000] 9533 MainThread cgroups INFO Found existing subsys-tem memory at /sys/fs/cgroup/memory >>[24/Aug/2017 15:47:21 +0000] 9533 MainThread cgroups INFO Found existing subsys-tem cpu at /sys/fs/cgroup/cpu,cpuacct >>[24/Aug/2017 15:47:21 +0000] 9533 MainThread cgroups INFO Found existing subsys-tem cpuacct at /sys/fs/cgroup/cpu,cpuacct >>[24/Aug/2017 15:47:21 +0000] 9533 MainThread cgroups WARNING Could not read capabilities from /proc/cgroups. error: sudo: no tty present and no askpass program speci-fied >> >>[24/Aug/2017 15:47:21 +0000] 9533 MainThread agent INFO No cgroups capabilities found >>[24/Aug/2017 15:47:21 +0000] 9533 MainThread agent INFO Setting up supervisord event monitor. >>[24/Aug/2017 15:47:21 +0000] 9533 MainThread filesystem_map INFO Monitored nodev filesystem types: ['nfs', 'nfs4', 'tmpfs'] >>[24/Aug/2017 15:47:21 +0000] 9533 MainThread filesystem_map INFO Using timeout of 2.000000 >>[24/Aug/2017 15:47:21 +0000] 9533 MainThread filesystem_map INFO Using join timeout of 0.100000 >>[24/Aug/2017 15:47:21 +0000] 9533 MainThread filesystem_map INFO Using tolerance of 60.000000 >>[24/Aug/2017 15:47:21 +0000] 9533 MainThread filesystem_map INFO Local filesystem types whitelist: ['ext2', 'ext3', 'ext4', 'xfs'] >>[24/Aug/2017 15:47:21 +0000] 9533 MainThread kt_renewer INFO Agent wide creden-tial cache set to /run/cloudera-scm-agent/krb5cc_cm_agent_123 >>[24/Aug/2017 15:47:21 +0000] 9533 MainThread agent INFO Using met-rics_url_timeout_seconds of 30.000000 >>[24/Aug/2017 15:47:21 +0000] 9533 MainThread agent INFO Using task_metrics_timeout_seconds of 5.000000 >>[24/Aug/2017 15:47:21 +0000] 9533 MainThread agent INFO Using max_collection_wait_seconds of 10.000000 >>[24/Aug/2017 15:47:21 +0000] 9533 MainThread metrics INFO Importing tasktracker metric schema from file /usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/cmf-5.12.0-py2.7.egg/cmf/monitor/tasktracker/schema.json >>[24/Aug/2017 15:47:21 +0000] 9533 MainThread ntp_monitor INFO Using timeout of 2.000000 >>[24/Aug/2017 15:47:21 +0000] 9533 MainThread dns_names INFO Using timeout of 30.000000 >>[24/Aug/2017 15:47:21 +0000] 9533 MainThread __init__ INFO Created DNS monitor. >>[24/Aug/2017 15:47:21 +0000] 9533 MainThread stacks_collection_manager INFO Us-ing max_uncompressed_file_size_bytes: 5242880 >>[24/Aug/2017 15:47:21 +0000] 9533 MainThread __init__ INFO Importing metric sche-ma from file /usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/cmf-5.12.0-py2.7.egg/cmf/monitor/schema.json >>[24/Aug/2017 15:47:21 +0000] 9533 MainThread agent INFO Supervised processes will add the following to their environment (in addition to the supervisor's env): {'CDH_PARQUET_HOME': '/usr/lib/parquet', 'JSVC_HOME': '/usr/libexec/bigtop-utils', 'CMF_PACKAGE_DIR': '/usr/lib/cmf/service', 'CDH_HADOOP_BIN': '/usr/bin/hadoop', 'MGMT_HOME': '/usr/share/cmf', 'CDH_IMPALA_HOME': '/usr/lib/impala', 'CDH_YARN_HOME': '/usr/lib/hadoop-yarn', 'CDH_HDFS_HOME': '/usr/lib/hadoop-hdfs', 'PATH': '/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/usr/share/maven', 'CDH_HUE_PLUGINS_HOME': '/usr/lib/hadoop', 'CM_STATUS_CODES': u'STATUS_NONE HDFS_DFS_DIR_NOT_EMPTY HBASE_TABLE_DISABLED HBASE_TABLE_ENABLED JOBTRACKER_IN_STANDBY_MODE YARN_RM_IN_STANDBY_MODE', 'KEYTRUSTEE_KP_HOME': '/usr/share/keytrustee-keyprovider', 'CLOUDERA_ORACLE_CONNECTOR_JAR': '/usr/share/java/oracle-connector-java.jar', 'CDH_SQOOP2_HOME': '/usr/lib/sqoop2', 'KEYTRUS-TEE_SERVER_HOME': '/usr/lib/keyt>>[24/Aug/2017 15:47:19 +0000] 9533 MainThread agent INFO Because agent not running as root, all processes will run with current user. >>[24/Aug/2017 15:47:21 +0000] 9533 MainThread agent INFO Re-using pre-existing di-rectory: /run/cloudera-scm-agent/cgroups >>[24/Aug/2017 15:47:21 +0000] 9533 MainThread cgroups INFO Found existing subsys-tem blkio at /sys/fs/cgroup/blkio >>[24/Aug/2017 15:47:21 +0000] 9533 MainThread cgroups INFO Found existing subsys-tem memory at /sys/fs/cgroup/memory >>[24/Aug/2017 15:47:21 +0000] 9533 MainThread cgroups INFO Found existing subsys-tem cpu at /sys/fs/cgroup/cpu,cpuacct >>[24/Aug/2017 15:47:21 +0000] 9533 MainThread cgroups INFO Found existing subsys-tem cpuacct at /sys/fs/cgroup/cpu,cpuacct >>[24/Aug/2017 15:47:21 +0000] 9533 MainThread cgroups WARNING Could not read capabilities from /proc/cgroups. error: sudo: no tty present and no askpass program speci-fied >> >>[24/Aug/2017 15:47:21 +0000] 9533 MainThread agent INFO No cgroups capabilities found >>[24/Aug/2017 15:47:21 +0000] 9533 MainThread agent INFO Setting up supervisord event monitor. >>[24/Aug/2017 15:47:21 +0000] 9533 MainThread filesystem_map INFO Monitored nodev filesystem types: ['nfs', 'nfs4', 'tmpfs'] >>[24/Aug/2017 15:47:21 +0000] 9533 MainThread filesystem_map INFO Using timeout of 2.000000 >>[24/Aug/2017 15:47:21 +0000] 9533 MainThread filesystem_map INFO Using join timeout of 0.100000 >>[24/Aug/2017 15:47:21 +0000] 9533 MainThread filesystem_map INFO Using tolerance of 60.000000 >>[24/Aug/2017 15:47:21 +0000] 9533 MainThread filesystem_map INFO Local filesystem types whitelist: ['ext2', 'ext3', 'ext4', 'xfs'] >>[24/Aug/2017 15:47:21 +0000] 9533 MainThread kt_renewer INFO Agent wide creden-tial cache set to /run/cloudera-scm-agent/krb5cc_cm_agent_123 >>[24/Aug/2017 15:47:21 +0000] 9533 MainThread agent INFO Using met-rics_url_timeout_seconds of 30.000000 >>[24/Aug/2017 15:47:21 +0000] 9533 MainThread agent INFO Using task_metrics_timeout_seconds of 5.000000 >>[24/Aug/2017 15:47:21 +0000] 9533 MainThread agent INFO Using max_collection_wait_seconds of 10.000000 >>[24/Aug/2017 15:47:21 +0000] 9533 MainThread metrics INFO Importing tasktracker metric schema from file /usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/cmf-5.12.0-py2.7.egg/cmf/monitor/tasktracker/schema.json >>[24/Aug/2017 15:47:21 +0000] 9533 MainThread ntp_monitor INFO Using timeout of 2.000000 >>[24/Aug/2017 15:47:21 +0000] 9533 MainThread dns_names INFO Using timeout of 30.000000 >>[24/Aug/2017 15:47:21 +0000] 9533 MainThread __init__ INFO Created DNS monitor. >>[24/Aug/2017 15:47:21 +0000] 9533 MainThread stacks_collection_manager INFO Us-ing max_uncompressed_file_size_bytes: 5242880 >>[24/Aug/2017 15:47:21 +0000] 9533 MainThread __init__ INFO Importing metric sche-ma from file /usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/cmf-5.12.0-py2.7.egg/cmf/monitor/schema.json >>[24/Aug/2017 15:47:21 +0000] 9533 MainThread agent INFO Supervised processes will add the following to their environment (in addition to the supervisor's env): {'CDH_PARQUET_HOME': '/usr/lib/parquet', 'JSVC_HOME': '/usr/libexec/bigtop-utils', 'CMF_PACKAGE_DIR': '/usr/lib/cmf/service', 'CDH_HADOOP_BIN': '/usr/bin/hadoop', 'MGMT_HOME': '/usr/share/cmf', 'CDH_IMPALA_HOME': '/usr/lib/impala', 'CDH_YARN_HOME': '/usr/lib/hadoop-yarn', 'CDH_HDFS_HOME': '/usr/lib/hadoop-hdfs', 'PATH': '/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/usr/share/maven', 'CDH_HUE_PLUGINS_HOME': '/usr/lib/hadoop', 'CM_STATUS_CODES': u'STATUS_NONE HDFS_DFS_DIR_NOT_EMPTY HBASE_TABLE_DISABLED HBASE_TABLE_ENABLED JOBTRACKER_IN_STANDBY_MODE YARN_RM_IN_STANDBY_MODE', 'KEYTRUSTEE_KP_HOME': '/usr/share/keytrustee-keyprovider', 'CLOUDERA_ORACLE_CONNECTOR_JAR': '/usr/share/java/oracle-connector-java.jar', 'CDH_SQOOP2_HOME': '/usr/lib/sqoop2', 'KEYTRUS-TEE_SERVER_HOME': '/usr/lib/keytrustee-server', 'CDH_MR2_HOME': '/usr/lib/hadoop-mapreduce', 'HIVE_DEFAULT_XML': '/etc/hive/conf.dist/hive-default.xml', 'CLOUDERA_POSTGRESQL_JDBC_JAR': '/usr/share/cmf/lib/postgresql-9.0-801.jdbc4.jar', 'CDH_KMS_HOME': '/usr/lib/hadoop-kms', 'CDH_HBASE_HOME': '/usr/lib/hbase', 'CDH_SQOOP_HOME': '/usr/lib/sqoop', 'WEBHCAT_DEFAULT_XML': '/etc/hive-webhcat/conf.dist/webhcat-default.xml', 'CDH_OOZIE_HOME': '/usr/lib/oozie', 'SUDO': 'sudo', 'CDH_ZOOKEEPER_HOME': '/usr/lib/zookeeper', 'CDH_HUE_HOME': '/usr/lib/hue', 'CLOUDERA_MYSQL_CONNECTOR_JAR': '/usr/share/java/mysql-connector-java.jar', 'CDH_HBASE_INDEXER_HOME': '/usr/lib/hbase-solr', 'CDH_MR1_HOME': '/usr/lib/hadoop-0.20-mapreduce', 'CDH_SOLR_HOME': '/usr/lib/solr', 'CDH_PIG_HOME': '/usr/lib/pig', 'CDH_SENTRY_HOME': '/usr/lib/sentry', 'CDH_CRUNCH_HOME': '/usr/lib/crunch', 'CDH_LLAMA_HOME': '/usr/lib/llama/', 'CDH_HTTPFS_HOME': '/usr/lib/hadoop-httpfs', 'CDH_HADOOP_HOME': '/usr/lib/hadoop', 'CDH_HIVE_HOME': '/usr/lib/hive', 'ORACLE_HOME': '/usr/share/oracle/instantclient', 'CDH_HCAT_HOME': '/usr/lib/hive-hcatalog', 'CDH_KAFKA_HOME': '/usr/lib/kafka', 'CDH_SPARK_HOME': '/usr/lib/spark', 'TOMCAT_HOME': '/usr/lib/bigtop-tomcat', 'CDH_FLUME_HOME': '/usr/lib/flume-ng'} >>[24/Aug/2017 15:47:21 +0000] 9533 MainThread agent INFO To override these varia-bles, use /etc/cloudera-scm-agent/config.ini. Environment variables for CDH locations are not used when CDH is installed from parcels. >>[24/Aug/2017 15:47:21 +0000] 9533 MainThread agent INFO Re-using pre-existing di-rectory: /run/cloudera-scm-agent/process >>[24/Aug/2017 15:47:21 +0000] 9533 MainThread agent INFO Re-using pre-existing di-rectory: /run/cloudera-scm-agent/supervisor >>[24/Aug/2017 15:47:21 +0000] 9533 MainThread agent INFO Re-using pre-existing di-rectory: /run/cloudera-scm-agent/flood >>[24/Aug/2017 15:47:21 +0000] 9533 MainThread agent INFO Re-using pre-existing di-rectory: /run/cloudera-scm-agent/supervisor/include >>[24/Aug/2017 15:47:21 +0000] 9533 MainThread agent ERROR Failed to connect to previous supervisor. >>Traceback (most recent call last): >> File "/usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/cmf-5.12.0-py2.7.egg/cmf/agent.py", line 2109, in find_or_start_supervisor >> self.configure_supervisor_clients() >> File "/usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/cmf-5.12.0-py2.7.egg/cmf/agent.py", line 2290, in configure_supervisor_clients >> supervisor_options.realize(args=["-c", os.path.join(self.supervisor_dir, "supervi-sord.conf")]) >> File "/usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/supervisor-3.0-py2.7.egg/supervisor/options.py", line 1599, in realize >> Options.realize(self, *arg, **kw) >> File "/usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/supervisor-3.0-py2.7.egg/supervisor/options.py", line 333, in realize >> self.process_config() >> File "/usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/supervisor-3.0-py2.7.egg/supervisor/options.py", line 341, in process_config >> self.process_config_file(do_usage) >> File "/usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/supervisor-3.0-py2.7.egg/supervisor/options.py", line 376, in process_config_file >> self.usage(str(msg)) >> File "/usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/supervisor-3.0-py2.7.egg/supervisor/options.py", line 164, in usage >> self.exit(2) >>SystemExit: 2 >>[24/Aug/2017 15:47:21 +0000] 9533 Dummy-1 daemonize WARNING Stopping dae-mon. >>[24/Aug/2017 15:47:21 +0000] 9533 Dummy-1 agent INFO Stopping agent... rustee-server', 'CDH_MR2_HOME': '/usr/lib/hadoop-mapreduce', 'HIVE_DEFAULT_XML': '/etc/hive/conf.dist/hive-default.xml', 'CLOUDERA_POSTGRESQL_JDBC_JAR': '/usr/share/cmf/lib/postgresql-9.0-801.jdbc4.jar', 'CDH_KMS_HOME': '/usr/lib/hadoop-kms', 'CDH_HBASE_HOME': '/usr/lib/hbase', 'CDH_SQOOP_HOME': '/usr/lib/sqoop', 'WEBHCAT_DEFAULT_XML': '/etc/hive-webhcat/conf.dist/webhcat-default.xml', 'CDH_OOZIE_HOME': '/usr/lib/oozie', 'SUDO': 'sudo', 'CDH_ZOOKEEPER_HOME': '/usr/lib/zookeeper', 'CDH_HUE_HOME': '/usr/lib/hue', 'CLOUDERA_MYSQL_CONNECTOR_JAR': '/usr/share/java/mysql-connector-java.jar', 'CDH_HBASE_INDEXER_HOME': '/usr/lib/hbase-solr', 'CDH_MR1_HOME': '/usr/lib/hadoop-0.20-mapreduce', 'CDH_SOLR_HOME': '/usr/lib/solr', 'CDH_PIG_HOME': '/usr/lib/pig', 'CDH_SENTRY_HOME': '/usr/lib/sentry', 'CDH_CRUNCH_HOME': '/usr/lib/crunch', 'CDH_LLAMA_HOME': '/usr/lib/llama/', 'CDH_HTTPFS_HOME': '/usr/lib/hadoop-httpfs', 'CDH_HADOOP_HOME': '/usr/lib/hadoop', 'CDH_HIVE_HOME': '/usr/lib/hive', 'ORACLE_HOME': '/usr/share/oracle/instantclient', 'CDH_HCAT_HOME': '/usr/lib/hive-hcatalog', 'CDH_KAFKA_HOME': '/usr/lib/kafka', 'CDH_SPARK_HOME': '/usr/lib/spark', 'TOMCAT_HOME': '/usr/lib/bigtop-tomcat', 'CDH_FLUME_HOME': '/usr/lib/flume-ng'} >>[24/Aug/2017 15:47:21 +0000] 9533 MainThread agent INFO To override these varia-bles, use /etc/cloudera-scm-agent/config.ini. Environment variables for CDH locations are not used when CDH is installed from parcels. >>[24/Aug/2017 15:47:21 +0000] 9533 MainThread agent INFO Re-using pre-existing di-rectory: /run/cloudera-scm-agent/process >>[24/Aug/2017 15:47:21 +0000] 9533 MainThread agent INFO Re-using pre-existing di-rectory: /run/cloudera-scm-agent/supervisor >>[24/Aug/2017 15:47:21 +0000] 9533 MainThread agent INFO Re-using pre-existing di-rectory: /run/cloudera-scm-agent/flood >>[24/Aug/2017 15:47:21 +0000] 9533 MainThread agent INFO Re-using pre-existing di-rectory: /run/cloudera-scm-agent/supervisor/include >>[24/Aug/2017 15:47:21 +0000] 9533 MainThread agent ERROR Failed to connect to previous supervisor. >>Traceback (most recent call last): >> File "/usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/cmf-5.12.0-py2.7.egg/cmf/agent.py", line 2109, in find_or_start_supervisor >> self.configure_supervisor_clients() >> File "/usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/cmf-5.12.0-py2.7.egg/cmf/agent.py", line 2290, in configure_supervisor_clients >> supervisor_options.realize(args=["-c", os.path.join(self.supervisor_dir, "supervi-sord.conf")]) >> File "/usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/supervisor-3.0-py2.7.egg/supervisor/options.py", line 1599, in realize >> Options.realize(self, *arg, **kw) >> File "/usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/supervisor-3.0-py2.7.egg/supervisor/options.py", line 333, in realize >> self.process_config() >> File "/usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/supervisor-3.0-py2.7.egg/supervisor/options.py", line 341, in process_config >> self.process_config_file(do_usage) >> File "/usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/supervisor-3.0-py2.7.egg/supervisor/options.py", line 376, in process_config_file >> self.usage(str(msg)) >> File "/usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/supervisor-3.0-py2.7.egg/supervisor/options.py", line 164, in usage >> self.exit(2) >>SystemExit: 2 >>[24/Aug/2017 15:47:21 +0000] 9533 Dummy-1 daemonize WARNING Stopping dae-mon. >>[24/Aug/2017 15:47:21 +0000] 9533 Dummy-1 agent INFO Stopping agent... END (0) end of agent logs. scm agent restarted Installation script completed successfully. all done closing logging file descriptor
I have check all the 5 options but still improvement.
Thanks,
Amit Kumar