Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Failed to start Cloudera Manager Agent on AWS with error: No socket could be created on 9000 port

Failed to start Cloudera Manager Agent on AWS with error: No socket could be created on 9000 port

New Contributor
I am trying to install two node cluster..
 
first one is successfull, but second node after nearing installation throwing this error...
 
please help!!
 
/tmp/scm_prepare_node.Dahd0vZm
using SSH_CLIENT to get the SCM hostname: 10.55.201.8 53845 22
opening logging file descriptor
Starting installation script... Acquiring installation lock...
BEGIN flock 4
END (0)
Detecting root privileges...
effective UID is 0
Detecting distribution...
BEGIN grep Tikanga /etc/redhat-release
END (1)
BEGIN grep 'CentOS release 5' /etc/redhat-release
END (1)
BEGIN grep 'Scientific Linux release 5' /etc/redhat-release
END (1)
BEGIN grep Santiago /etc/redhat-release
END (1)
BEGIN grep 'CentOS Linux release 6' /etc/redhat-release
END (1)
BEGIN grep 'CentOS release 6' /etc/redhat-release
CentOS release 6.6 (Final)
END (0)
/etc/redhat-release ==> CentOS 6
Detecting Cloudera Manager Server...
BEGIN host -t PTR 10.55.201.8
Host 8.201.55.10.in-addr.arpa. not found: 3(NXDOMAIN)
END (1)
BEGIN which python
/usr/bin/python
END (0)
BEGIN python -c 'import socket; import sys; s = socket.socket(socket.AF_INET); s.settimeout(5.0); s.connect((sys.argv[1], int(sys.argv[2]))); s.close();' 10.55.201.8 7182
END (0)
BEGIN which wget
/usr/bin/wget
END (0)
BEGIN wget -qO- -T 1 -t 1 http://169.254.169.254/latest/meta-data/public-hostname && /bin/echo
END (4)
Installing package repositories...
validating format of repository file /tmp/scm_prepare_node.Dahd0vZm/repos/rhel6/cloudera-manager.repo
installing repository file /tmp/scm_prepare_node.Dahd0vZm/repos/rhel6/cloudera-manager.repo
repository file /tmp/scm_prepare_node.Dahd0vZm/repos/rhel6/cloudera-manager.repo installed
Refreshing package metadata...
BEGIN yum clean all
Loaded plugins: fastestmirror, refresh-packagekit, security
Cleaning repos: base cloudera-manager extras updates
Cleaning up Everything
END (0)
BEGIN rm -Rf /var/cache/yum/x86_64
END (0)
BEGIN yum makecache
Loaded plugins: fastestmirror, refresh-packagekit, security
Metadata Cache Created
END (0)
Installing jdk package...
BEGIN yum list installed jdk
Loaded plugins: fastestmirror, refresh-packagekit, security
Installed Packages
jdk.x86_64 2000:1.6.0_31-fcs @cloudera-manager
END (0)
BEGIN echo jdk oracle-j2sdk1.7 cloudera-manager-agent cloudera-manager-daemons | grep jdk
jdk oracle-j2sdk1.7 cloudera-manager-agent cloudera-manager-daemons
END (0)
BEGIN yum info jdk
Loaded plugins: fastestmirror, refresh-packagekit, security
Determining fastest mirrors
* base: centos-distro.cavecreek.net
* extras: centos.sonn.com
* updates: mirror.pac-12.org
Installed Packages
Name : jdk
Arch : x86_64
Epoch : 2000
Version : 1.6.0_31
Release : fcs
Size : 143 M
Repo : installed
From repo : cloudera-manager
Summary : Java(TM) Platform Standard Edition Development Kit
URL : http://java.sun.com/
License : Copyright (c) 2011, Oracle and/or its affiliates. All rights
: reserved. Also under other license(s) as shown at the Description
: field.
Description : The Java Platform Standard Edition Development Kit (JDK) includes
: both the runtime environment (Java virtual machine, the Java
: platform classes and supporting files) and development tools
: (compilers, debuggers, tool libraries and other tools).
:
: The JDK is a development environment for building applications,
: applets and components that can be deployed with the Java Platform
: Standard Edition Runtime Environment.

END (0)
BEGIN yum -y install jdk.x86_64
Loaded plugins: fastestmirror, refresh-packagekit, security
Setting up Install Process
Loading mirror speeds from cached hostfile
* base: centos-distro.cavecreek.net
* extras: centos.sonn.com
* updates: mirror.pac-12.org
Package 2000:jdk-1.6.0_31-fcs.x86_64 already installed and latest version
Nothing to do
END (0)
remote package jdk installed
Installing oracle-j2sdk1.7 package...
BEGIN yum list installed oracle-j2sdk1.7
Loaded plugins: fastestmirror, refresh-packagekit, security
Installed Packages
oracle-j2sdk1.7.x86_64 1.7.0+update67-1 @cloudera-manager
END (0)
BEGIN echo jdk oracle-j2sdk1.7 cloudera-manager-agent cloudera-manager-daemons | grep oracle-j2sdk1.7
jdk oracle-j2sdk1.7 cloudera-manager-agent cloudera-manager-daemons
END (0)
BEGIN yum info oracle-j2sdk1.7
Loaded plugins: fastestmirror, refresh-packagekit, security
Loading mirror speeds from cached hostfile
* base: centos-distro.cavecreek.net
* extras: centos.sonn.com
* updates: mirror.pac-12.org
Installed Packages
Name : oracle-j2sdk1.7
Arch : x86_64
Version : 1.7.0+update67
Release : 1
Size : 279 M
Repo : installed
From repo : cloudera-manager
Summary : no description given
URL : http://example.com/no-uri-given
License : unknown
Description : no description given

END (0)
BEGIN yum -y install oracle-j2sdk1.7.x86_64
Loaded plugins: fastestmirror, refresh-packagekit, security
Setting up Install Process
Loading mirror speeds from cached hostfile
* base: centos-distro.cavecreek.net
* extras: centos.sonn.com
* updates: mirror.pac-12.org
Package oracle-j2sdk1.7-1.7.0+update67-1.x86_64 already installed and latest version
Nothing to do
END (0)
remote package oracle-j2sdk1.7 installed
Installing cloudera-manager-agent package...
BEGIN yum list installed cloudera-manager-agent
Loaded plugins: fastestmirror, refresh-packagekit, security
Installed Packages
cloudera-manager-agent.x86_64 5.4.6-1.cm546.p0.8.el6 installed
END (0)
BEGIN echo jdk oracle-j2sdk1.7 cloudera-manager-agent cloudera-manager-daemons | grep cloudera-manager-agent
jdk oracle-j2sdk1.7 cloudera-manager-agent cloudera-manager-daemons
END (0)
BEGIN yum info cloudera-manager-agent
Loaded plugins: fastestmirror, refresh-packagekit, security
Loading mirror speeds from cached hostfile
* base: centos-distro.cavecreek.net
* extras: centos.sonn.com
* updates: mirror.pac-12.org
Installed Packages
Name : cloudera-manager-agent
Arch : x86_64
Version : 5.4.6
Release : 1.cm546.p0.8.el6
Size : 32 M
Repo : installed
Summary : The Cloudera Manager Agent
URL : http://www.cloudera.com
License : Proprietary
Description : The Cloudera Manager Agent.
:
: The Agent is deployed to machines running services managed by
: Cloudera Manager.

END (0)
Version : 5.4.6
Release : 1.cm546.p0.8.el6
BEGIN yum -y install cloudera-manager-agent
Loaded plugins: fastestmirror, refresh-packagekit, security
Setting up Install Process
Loading mirror speeds from cached hostfile
* base: centos-distro.cavecreek.net
* extras: centos.sonn.com
* updates: mirror.pac-12.org
Package cloudera-manager-agent-5.4.6-1.cm546.p0.8.el6.x86_64 already installed and latest version
Nothing to do
END (0)
remote package cloudera-manager-agent installed
Installing cloudera-manager-daemons package...
BEGIN yum list installed cloudera-manager-daemons
Loaded plugins: fastestmirror, refresh-packagekit, security
Installed Packages
cloudera-manager-daemons.x86_64 5.4.6-1.cm546.p0.8.el6 @cloudera-manager
END (0)
BEGIN echo jdk oracle-j2sdk1.7 cloudera-manager-agent cloudera-manager-daemons | grep cloudera-manager-daemons
jdk oracle-j2sdk1.7 cloudera-manager-agent cloudera-manager-daemons
END (0)
BEGIN yum info cloudera-manager-daemons
Loaded plugins: fastestmirror, refresh-packagekit, security
Loading mirror speeds from cached hostfile
* base: centos-distro.cavecreek.net
* extras: centos.sonn.com
* updates: mirror.pac-12.org
Installed Packages
Name : cloudera-manager-daemons
Arch : x86_64
Version : 5.4.6
Release : 1.cm546.p0.8.el6
Size : 902 M
Repo : installed
From repo : cloudera-manager
Summary : Provides daemons for monitoring Hadoop and related tools.
URL : http://www.cloudera.com
License : Proprietary
Description : This package includes daemons for monitoring and managing Hadoop.

END (0)
Version : 5.4.6
Release : 1.cm546.p0.8.el6
BEGIN yum -y install cloudera-manager-daemons
Loaded plugins: fastestmirror, refresh-packagekit, security
Setting up Install Process
Loading mirror speeds from cached hostfile
* base: centos-distro.cavecreek.net
* extras: centos.sonn.com
* updates: mirror.pac-12.org
Package cloudera-manager-daemons-5.4.6-1.cm546.p0.8.el6.x86_64 already installed and latest version
Nothing to do
END (0)
remote package cloudera-manager-daemons installed
Installing Unlimited Strength Encryption policy files.
Installation not requested. Step will be skipped.
Configuring Cloudera Manager Agent...
BEGIN grep server_host=10.55.201.8 /etc/cloudera-scm-agent/config.ini
END (1)
BEGIN sed -e 's/\(server_host=\).*/\110.55.201.8/' -i /etc/cloudera-scm-agent/config.ini
END (0)
scm agent configured
Starting Cloudera Manager Agent...
BEGIN /sbin/service cloudera-scm-agent status | grep running
END (1)
BEGIN /sbin/service cloudera-scm-agent start
Starting cloudera-scm-agent: [FAILED]
END (1)
agent logs:
BEGIN tail -n 50 /var/log/cloudera-scm-agent//cloudera-scm-agent.out | sed 's/^/>>/'
>>/usr/lib64/cmf/agent/src/cmf/parcel.py:17: DeprecationWarning: the sets module is deprecated
>> from sets import Set
>>[04/Sep/2015 12:39:37 +0000] 15204 MainThread agent INFO SCM Agent Version: 5.4.6
>>[04/Sep/2015 12:39:37 +0000] 15204 MainThread agent INFO Adding env vars that start with CMF_AGENT_
>>[04/Sep/2015 12:39:37 +0000] 15204 MainThread agent INFO Logging to /var/log/cloudera-scm-agent/cloudera-scm-agent.log
>>/usr/lib64/cmf/agent/src/cmf/parcel.py:17: DeprecationWarning: the sets module is deprecated
>> from sets import Set
>>[04/Sep/2015 12:39:37 +0000] 15204 MainThread agent INFO SCM Agent Version: 5.4.6
>>[04/Sep/2015 12:39:37 +0000] 15204 MainThread agent INFO Adding env vars that start with CMF_AGENT_
>>[04/Sep/2015 12:39:37 +0000] 15204 MainThread agent INFO Logging to /var/log/cloudera-scm-agent/cloudera-scm-agent.log
END (0)
BEGIN tail -n 50 /var/log/cloudera-scm-agent//cloudera-scm-agent.log | sed 's/^/>>/'
>>[04/Sep/2015 12:39:37 +0000] 15204 MainThread agent INFO Re-using pre-existing directory: /var/run/cloudera-scm-agent
>>[04/Sep/2015 12:39:39 +0000] 15204 MainThread agent INFO Re-using pre-existing directory: /var/run/cloudera-scm-agent/cgroups
>>[04/Sep/2015 12:39:39 +0000] 15204 MainThread cgroups INFO Found cgroups subsystem: cpu
>>[04/Sep/2015 12:39:39 +0000] 15204 MainThread cgroups INFO Found cgroups subsystem: cpuacct
>>[04/Sep/2015 12:39:39 +0000] 15204 MainThread cgroups INFO Found cgroups subsystem: memory
>>[04/Sep/2015 12:39:39 +0000] 15204 MainThread cgroups INFO Found cgroups subsystem: blkio
>>[04/Sep/2015 12:39:39 +0000] 15204 MainThread cgroups INFO Reusing /var/run/cloudera-scm-agent/cgroups/memory
>>[04/Sep/2015 12:39:39 +0000] 15204 MainThread cgroups INFO Reusing /var/run/cloudera-scm-agent/cgroups/cpu
>>[04/Sep/2015 12:39:39 +0000] 15204 MainThread cgroups INFO Reusing /var/run/cloudera-scm-agent/cgroups/cpuacct
>>[04/Sep/2015 12:39:39 +0000] 15204 MainThread cgroups INFO Reusing /var/run/cloudera-scm-agent/cgroups/blkio
>>[04/Sep/2015 12:39:39 +0000] 15204 MainThread agent INFO Found cgroups capabilities: {'has_memory': True, 'default_memory_limit_in_bytes': -1, 'default_memory_soft_limit_in_bytes': -1, 'writable_cgroup_dot_procs': True, 'default_cpu_rt_runtime_us': 950000, 'has_cpu': True, 'default_blkio_weight': 1000, 'default_cpu_shares': 1024, 'has_cpuacct': True, 'has_blkio': True}
>>[04/Sep/2015 12:39:39 +0000] 15204 MainThread agent INFO Setting up supervisord event monitor.
>>[04/Sep/2015 12:39:39 +0000] 15204 MainThread filesystem_map INFO Monitored nodev filesystem types: ['nfs', 'nfs4', 'tmpfs']
>>[04/Sep/2015 12:39:39 +0000] 15204 MainThread filesystem_map INFO Using timeout of 2.000000
>>[04/Sep/2015 12:39:39 +0000] 15204 MainThread filesystem_map INFO Using join timeout of 0.100000
>>[04/Sep/2015 12:39:39 +0000] 15204 MainThread filesystem_map INFO Using tolerance of 60.000000
>>[04/Sep/2015 12:39:39 +0000] 15204 MainThread filesystem_map INFO Local filesystem types whitelist: ['ext2', 'ext3', 'ext4']
>>[04/Sep/2015 12:39:39 +0000] 15204 MainThread agent INFO Using metrics_url_timeout_seconds of 30.000000
>>[04/Sep/2015 12:39:39 +0000] 15204 MainThread agent INFO Using task_metrics_timeout_seconds of 5.000000
>>[04/Sep/2015 12:39:39 +0000] 15204 MainThread agent INFO Using max_collection_wait_seconds of 10.000000
>>[04/Sep/2015 12:39:39 +0000] 15204 MainThread metrics INFO Importing tasktracker metric schema from file /usr/lib64/cmf/agent/src/cmf/monitor/tasktracker/schema.json
>>[04/Sep/2015 12:39:39 +0000] 15204 MainThread dns_names INFO Using timeout of 2.000000
>>[04/Sep/2015 12:39:39 +0000] 15204 MainThread ntp_monitor INFO Using timeout of 2.000000
>>[04/Sep/2015 12:39:39 +0000] 15204 MainThread stacks_collection_manager INFO Using max_uncompressed_file_size_bytes: 5242880
>>[04/Sep/2015 12:39:39 +0000] 15204 MainThread __init__ INFO Importing metric schema from file /usr/lib64/cmf/agent/src/cmf/monitor/schema.json
>>[04/Sep/2015 12:39:39 +0000] 15204 MainThread agent INFO Supervised processes will add the following to their environment (in addition to the supervisor's env): {'CDH_PARQUET_HOME': '/usr/lib/parquet', 'JSVC_HOME': '/usr/libexec/bigtop-utils', 'CMF_PACKAGE_DIR': '/usr/lib64/cmf/service', 'CDH_HADOOP_BIN': '/usr/bin/hadoop', 'MGMT_HOME': '/usr/share/cmf', 'CDH_IMPALA_HOME': '/usr/lib/impala', 'CDH_YARN_HOME': '/usr/lib/hadoop-yarn', 'CDH_HDFS_HOME': '/usr/lib/hadoop-hdfs', 'PATH': '/sbin:/usr/sbin:/bin:/usr/bin', 'CDH_HUE_PLUGINS_HOME': '/usr/lib/hadoop', 'CM_STATUS_CODES': u'STATUS_NONE HDFS_DFS_DIR_NOT_EMPTY HBASE_TABLE_DISABLED HBASE_TABLE_ENABLED JOBTRACKER_IN_STANDBY_MODE YARN_RM_IN_STANDBY_MODE', 'KEYTRUSTEE_KP_HOME': '/usr/share/keytrustee-keyprovider', 'CLOUDERA_ORACLE_CONNECTOR_JAR': '/usr/share/java/oracle-connector-java.jar', 'CDH_SQOOP2_HOME': '/usr/lib/sqoop2', 'CDH_MR2_HOME': '/usr/lib/hadoop-mapreduce', 'HIVE_DEFAULT_XML': '/etc/hive/conf.dist/hive-default.xml', 'CLOUDERA_POSTGRESQL_JDBC_JAR': '/usr/share/cmf/lib/postgresql-9.0-801.jdbc4.jar', 'CDH_KMS_HOME': '/usr/lib/hadoop-kms', 'CDH_HBASE_HOME': '/usr/lib/hbase', 'CDH_SQOOP_HOME': '/usr/lib/sqoop', 'WEBHCAT_DEFAULT_XML': '/etc/hive-webhcat/conf.dist/webhcat-default.xml', 'CDH_OOZIE_HOME': '/usr/lib/oozie', 'CDH_ZOOKEEPER_HOME': '/usr/lib/zookeeper', 'CDH_HUE_HOME': '/usr/lib/hue', 'CLOUDERA_MYSQL_CONNECTOR_JAR': '/usr/share/java/mysql-connector-java.jar', 'CDH_HBASE_INDEXER_HOME': '/usr/lib/hbase-solr', 'CDH_MR1_HOME': '/usr/lib/hadoop-0.20-mapreduce', 'CDH_SOLR_HOME': '/usr/lib/solr', 'CDH_PIG_HOME': '/usr/lib/pig', 'CDH_SENTRY_HOME': '/usr/lib/sentry', 'CDH_CRUNCH_HOME': '/usr/lib/crunch', 'CDH_LLAMA_HOME': '/usr/lib/llama/', 'CDH_HTTPFS_HOME': '/usr/lib/hadoop-httpfs', 'CDH_HADOOP_HOME': '/usr/lib/hadoop', 'CDH_HIVE_HOME': '/usr/lib/hive', 'CDH_HCAT_HOME': '/usr/lib/hive-hcatalog', 'CDH_KAFKA_HOME': '/usr/lib/kafka', 'CDH_SPARK_HOME': '/usr/lib/spark', 'TOMCAT_HOME': '/usr/lib/bigtop-tomcat', 'CDH_FLUME_HOME': '/usr/lib/flume-ng'}
>>[04/Sep/2015 12:39:39 +0000] 15204 MainThread agent INFO To override these variables, use /etc/cloudera-scm-agent/config.ini. Environment variables for CDH locations are not used when CDH is installed from parcels.
>>[04/Sep/2015 12:39:39 +0000] 15204 MainThread agent INFO Re-using pre-existing directory: /var/run/cloudera-scm-agent/process
>>[04/Sep/2015 12:39:39 +0000] 15204 MainThread agent INFO Re-using pre-existing directory: /var/run/cloudera-scm-agent/supervisor
>>[04/Sep/2015 12:39:39 +0000] 15204 MainThread agent INFO Re-using pre-existing directory: /var/run/cloudera-scm-agent/supervisor/include
>>[04/Sep/2015 12:39:39 +0000] 15204 MainThread agent INFO Supervisor version: 3.0
>>[04/Sep/2015 12:39:39 +0000] 15204 MainThread agent INFO Connecting to previous supervisor: agent-2148-1441392167.
>>[04/Sep/2015 12:39:39 +0000] 15204 MainThread status_server INFO Using maximum impala profile bundle size of 1073741824 bytes.
>>[04/Sep/2015 12:39:39 +0000] 15204 MainThread status_server INFO Using maximum stacks log bundle size of 1073741824 bytes.
>>[04/Sep/2015 12:39:39 +0000] 15204 MainThread _cplogging INFO [04/Sep/2015:12:39:39] ENGINE Bus STARTING
>>[04/Sep/2015 12:39:39 +0000] 15204 MainThread _cplogging INFO [04/Sep/2015:12:39:39] ENGINE Started monitor thread '_TimeoutMonitor'.
>>[04/Sep/2015 12:39:39 +0000] 15204 HTTPServer Thread-2 _cplogging ERROR [04/Sep/2015:12:39:39] ENGINE Error in HTTP server: shutting down
>>Traceback (most recent call last):
>> File "/usr/lib64/cmf/agent/build/env/lib/python2.6/site-packages/CherryPy-3.2.2-py2.6.egg/cherrypy/process/servers.py", line 187, in _start_http_thread
>> self.httpserver.start()
>> File "/usr/lib64/cmf/agent/build/env/lib/python2.6/site-packages/CherryPy-3.2.2-py2.6.egg/cherrypy/wsgiserver/wsgiserver2.py", line 1825, in start
>> raise socket.error(msg)
>>error: No socket could be created on ('slave.hadoop.com', 9000) -- [Errno 99] Cannot assign requested address
>>
>>[04/Sep/2015 12:39:39 +0000] 15204 HTTPServer Thread-2 _cplogging INFO [04/Sep/2015:12:39:39] ENGINE Bus STOPPING
>>[04/Sep/2015 12:39:39 +0000] 15204 HTTPServer Thread-2 _cplogging INFO [04/Sep/2015:12:39:39] ENGINE HTTP Server cherrypy._cpwsgi_server.CPWSGIServer(('slave.hadoop.com', 9000)) already shut down
>>[04/Sep/2015 12:39:39 +0000] 15204 HTTPServer Thread-2 _cplogging INFO [04/Sep/2015:12:39:39] ENGINE Stopped thread '_TimeoutMonitor'.
>>[04/Sep/2015 12:39:39 +0000] 15204 HTTPServer Thread-2 _cplogging INFO [04/Sep/2015:12:39:39] ENGINE Bus STOPPED
>>[04/Sep/2015 12:39:39 +0000] 15204 HTTPServer Thread-2 _cplogging INFO [04/Sep/2015:12:39:39] ENGINE Bus EXITING
>>[04/Sep/2015 12:39:39 +0000] 15204 HTTPServer Thread-2 _cplogging INFO [04/Sep/2015:12:39:39] ENGINE Bus EXITED
>>[04/Sep/2015 12:39:37 +0000] 15204 MainThread agent INFO Re-using pre-existing directory: /var/run/cloudera-scm-agent
>>[04/Sep/2015 12:39:39 +0000] 15204 MainThread agent INFO Re-using pre-existing directory: /var/run/cloudera-scm-agent/cgroups
>>[04/Sep/2015 12:39:39 +0000] 15204 MainThread cgroups INFO Found cgroups subsystem: cpu
>>[04/Sep/2015 12:39:39 +0000] 15204 MainThread cgroups INFO Found cgroups subsystem: cpuacct
>>[04/Sep/2015 12:39:39 +0000] 15204 MainThread cgroups INFO Found cgroups subsystem: memory
>>[04/Sep/2015 12:39:39 +0000] 15204 MainThread cgroups INFO Found cgroups subsystem: blkio
>>[04/Sep/2015 12:39:39 +0000] 15204 MainThread cgroups INFO Reusing /var/run/cloudera-scm-agent/cgroups/memory
>>[04/Sep/2015 12:39:39 +0000] 15204 MainThread cgroups INFO Reusing /var/run/cloudera-scm-agent/cgroups/cpu
>>[04/Sep/2015 12:39:39 +0000] 15204 MainThread cgroups INFO Reusing /var/run/cloudera-scm-agent/cgroups/cpuacct
>>[04/Sep/2015 12:39:39 +0000] 15204 MainThread cgroups INFO Reusing /var/run/cloudera-scm-agent/cgroups/blkio
>>[04/Sep/2015 12:39:39 +0000] 15204 MainThread agent INFO Found cgroups capabilities: {'has_memory': True, 'default_memory_limit_in_bytes': -1, 'default_memory_soft_limit_in_bytes': -1, 'writable_cgroup_dot_procs': True, 'default_cpu_rt_runtime_us': 950000, 'has_cpu': True, 'default_blkio_weight': 1000, 'default_cpu_shares': 1024, 'has_cpuacct': True, 'has_blkio': True}
>>[04/Sep/2015 12:39:39 +0000] 15204 MainThread agent INFO Setting up supervisord event monitor.
>>[04/Sep/2015 12:39:39 +0000] 15204 MainThread filesystem_map INFO Monitored nodev filesystem types: ['nfs', 'nfs4', 'tmpfs']
>>[04/Sep/2015 12:39:39 +0000] 15204 MainThread filesystem_map INFO Using timeout of 2.000000
>>[04/Sep/2015 12:39:39 +0000] 15204 MainThread filesystem_map INFO Using join timeout of 0.100000
>>[04/Sep/2015 12:39:39 +0000] 15204 MainThread filesystem_map INFO Using tolerance of 60.000000
>>[04/Sep/2015 12:39:39 +0000] 15204 MainThread filesystem_map INFO Local filesystem types whitelist: ['ext2', 'ext3', 'ext4']
>>[04/Sep/2015 12:39:39 +0000] 15204 MainThread agent INFO Using metrics_url_timeout_seconds of 30.000000
>>[04/Sep/2015 12:39:39 +0000] 15204 MainThread agent INFO Using task_metrics_timeout_seconds of 5.000000
>>[04/Sep/2015 12:39:39 +0000] 15204 MainThread agent INFO Using max_collection_wait_seconds of 10.000000
>>[04/Sep/2015 12:39:39 +0000] 15204 MainThread metrics INFO Importing tasktracker metric schema from file /usr/lib64/cmf/agent/src/cmf/monitor/tasktracker/schema.json
>>[04/Sep/2015 12:39:39 +0000] 15204 MainThread dns_names INFO Using timeout of 2.000000
>>[04/Sep/2015 12:39:39 +0000] 15204 MainThread ntp_monitor INFO Using timeout of 2.000000
>>[04/Sep/2015 12:39:39 +0000] 15204 MainThread stacks_collection_manager INFO Using max_uncompressed_file_size_bytes: 5242880
>>[04/Sep/2015 12:39:39 +0000] 15204 MainThread __init__ INFO Importing metric schema from file /usr/lib64/cmf/agent/src/cmf/monitor/schema.json
>>[04/Sep/2015 12:39:39 +0000] 15204 MainThread agent INFO Supervised processes will add the following to their environment (in addition to the supervisor's env): {'CDH_PARQUET_HOME': '/usr/lib/parquet', 'JSVC_HOME': '/usr/libexec/bigtop-utils', 'CMF_PACKAGE_DIR': '/usr/lib64/cmf/service', 'CDH_HADOOP_BIN': '/usr/bin/hadoop', 'MGMT_HOME': '/usr/share/cmf', 'CDH_IMPALA_HOME': '/usr/lib/impala', 'CDH_YARN_HOME': '/usr/lib/hadoop-yarn', 'CDH_HDFS_HOME': '/usr/lib/hadoop-hdfs', 'PATH': '/sbin:/usr/sbin:/bin:/usr/bin', 'CDH_HUE_PLUGINS_HOME': '/usr/lib/hadoop', 'CM_STATUS_CODES': u'STATUS_NONE HDFS_DFS_DIR_NOT_EMPTY HBASE_TABLE_DISABLED HBASE_TABLE_ENABLED JOBTRACKER_IN_STANDBY_MODE YARN_RM_IN_STANDBY_MODE', 'KEYTRUSTEE_KP_HOME': '/usr/share/keytrustee-keyprovider', 'CLOUDERA_ORACLE_CONNECTOR_JAR': '/usr/share/java/oracle-connector-java.jar', 'CDH_SQOOP2_HOME': '/usr/lib/sqoop2', 'CDH_MR2_HOME': '/usr/lib/hadoop-mapreduce', 'HIVE_DEFAULT_XML': '/etc/hive/conf.dist/hive-default.xml', 'CLOUDERA_POSTGRESQL_JDBC_JAR': '/usr/share/cmf/lib/postgresql-9.0-801.jdbc4.jar', 'CDH_KMS_HOME': '/usr/lib/hadoop-kms', 'CDH_HBASE_HOME': '/usr/lib/hbase', 'CDH_SQOOP_HOME': '/usr/lib/sqoop', 'WEBHCAT_DEFAULT_XML': '/etc/hive-webhcat/conf.dist/webhcat-default.xml', 'CDH_OOZIE_HOME': '/usr/lib/oozie', 'CDH_ZOOKEEPER_HOME': '/usr/lib/zookeeper', 'CDH_HUE_HOME': '/usr/lib/hue', 'CLOUDERA_MYSQL_CONNECTOR_JAR': '/usr/share/java/mysql-connector-java.jar', 'CDH_HBASE_INDEXER_HOME': '/usr/lib/hbase-solr', 'CDH_MR1_HOME': '/usr/lib/hadoop-0.20-mapreduce', 'CDH_SOLR_HOME': '/usr/lib/solr', 'CDH_PIG_HOME': '/usr/lib/pig', 'CDH_SENTRY_HOME': '/usr/lib/sentry', 'CDH_CRUNCH_HOME': '/usr/lib/crunch', 'CDH_LLAMA_HOME': '/usr/lib/llama/', 'CDH_HTTPFS_HOME': '/usr/lib/hadoop-httpfs', 'CDH_HADOOP_HOME': '/usr/lib/hadoop', 'CDH_HIVE_HOME': '/usr/lib/hive', 'CDH_HCAT_HOME': '/usr/lib/hive-hcatalog', 'CDH_KAFKA_HOME': '/usr/lib/kafka', 'CDH_SPARK_HOME': '/usr/lib/spark', 'TOMCAT_HOME': '/usr/lib/bigtop-tomcat', 'CDH_FLUME_HOME': '/usr/lib/flume-ng'}
>>[04/Sep/2015 12:39:39 +0000] 15204 MainThread agent INFO To override these variables, use /etc/cloudera-scm-agent/config.ini. Environment variables for CDH locations are not used when CDH is installed from parcels.
>>[04/Sep/2015 12:39:39 +0000] 15204 MainThread agent INFO Re-using pre-existing directory: /var/run/cloudera-scm-agent/process
>>[04/Sep/2015 12:39:39 +0000] 15204 MainThread agent INFO Re-using pre-existing directory: /var/run/cloudera-scm-agent/supervisor
>>[04/Sep/2015 12:39:39 +0000] 15204 MainThread agent INFO Re-using pre-existing directory: /var/run/cloudera-scm-agent/supervisor/include
>>[04/Sep/2015 12:39:39 +0000] 15204 MainThread agent INFO Supervisor version: 3.0
>>[04/Sep/2015 12:39:39 +0000] 15204 MainThread agent INFO Connecting to previous supervisor: agent-2148-1441392167.
>>[04/Sep/2015 12:39:39 +0000] 15204 MainThread status_server INFO Using maximum impala profile bundle size of 1073741824 bytes.
>>[04/Sep/2015 12:39:39 +0000] 15204 MainThread status_server INFO Using maximum stacks log bundle size of 1073741824 bytes.
>>[04/Sep/2015 12:39:39 +0000] 15204 MainThread _cplogging INFO [04/Sep/2015:12:39:39] ENGINE Bus STARTING
>>[04/Sep/2015 12:39:39 +0000] 15204 MainThread _cplogging INFO [04/Sep/2015:12:39:39] ENGINE Started monitor thread '_TimeoutMonitor'.
>>[04/Sep/2015 12:39:39 +0000] 15204 HTTPServer Thread-2 _cplogging ERROR [04/Sep/2015:12:39:39] ENGINE Error in HTTP server: shutting down
>>Traceback (most recent call last):
>> File "/usr/lib64/cmf/agent/build/env/lib/python2.6/site-packages/CherryPy-3.2.2-py2.6.egg/cherrypy/process/servers.py", line 187, in _start_http_thread
>> self.httpserver.start()
>> File "/usr/lib64/cmf/agent/build/env/lib/python2.6/site-packages/CherryPy-3.2.2-py2.6.egg/cherrypy/wsgiserver/wsgiserver2.py", line 1825, in start
>> raise socket.error(msg)
>>error: No socket could be created on ('slave.hadoop.com', 9000) -- [Errno 99] Cannot assign requested address
>>
>>[04/Sep/2015 12:39:39 +0000] 15204 HTTPServer Thread-2 _cplogging INFO [04/Sep/2015:12:39:39] ENGINE Bus STOPPING
>>[04/Sep/2015 12:39:39 +0000] 15204 HTTPServer Thread-2 _cplogging INFO [04/Sep/2015:12:39:39] ENGINE HTTP Server cherrypy._cpwsgi_server.CPWSGIServer(('slave.hadoop.com', 9000)) already shut down
>>[04/Sep/2015 12:39:39 +0000] 15204 HTTPServer Thread-2 _cplogging INFO [04/Sep/2015:12:39:39] ENGINE Stopped thread '_TimeoutMonitor'.
>>[04/Sep/2015 12:39:39 +0000] 15204 HTTPServer Thread-2 _cplogging INFO [04/Sep/2015:12:39:39] ENGINE Bus STOPPED
>>[04/Sep/2015 12:39:39 +0000] 15204 HTTPServer Thread-2 _cplogging INFO [04/Sep/2015:12:39:39] ENGINE Bus EXITING
>>[04/Sep/2015 12:39:39 +0000] 15204 HTTPServer Thread-2 _cplogging INFO [04/Sep/2015:12:39:39] ENGINE Bus EXITED
END (0)
end of agent logs.
scm agent could not be started, giving up
waiting for rollback request
 
 
host file of mine 
#127.0.0.1 localhost localhost.localdomain localhost4 localhost4.localdomain4
#::1 localhost localhost.localdomain localhost6 localhost6.localdomain6
10.1.201.8 M610-8 slave.hadoop.com
10.55.201.13 database13 master.hadoop.com
 
 
 
 
Don't have an account?
Coming from Hortonworks? Activate your account here