Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Issue in installing single user Cloudera Manager 5.3.0

Issue in installing single user Cloudera Manager 5.3.0

New Contributor

Hi,

 

I am trying to install Cloudera Manager 5.3.0 ON Ubuntu machine as a single node version by following the steps provided in steps provided in below link. Note that I have only one machine so I am trying to install all components in one machine.

 

http://www.cloudera.com/content/cloudera/en/documentation/core/latest/topics/cm_qs_quick_start.html#...

 

in the Cluster installtion page when I try to provide select the root as login option and provide the root password which I use for Ubuntu I get below error.

 

Installation failed on all hosts.

status: Installation failed. Failed to authenticate.

 

Then I tried by adding another user and provided the the corresponding user credental then I get the below error.

  Installation failed on all hosts.

status: Installation failed. Failed to detect root privileges.

 

I followed the below link to provide root access to the new user which I added.

 

http://www.liquidweb.com/kb/how-to-add-a-user-and-grant-root-privileges-on-ubuntu-14-04/

 

I am new to this installtion and any help in resolving this would of great help. I am not able to resolve this from last 2 days.

 

Thanks,

Arvind

 

3 REPLIES 3

Re: Issue in installing single user Cloudera Manager 5.3.0

Some Linux distributions by default disable root login via ssh. Try the
steps in this article and let us know if it helped

http://askubuntu.com/questions/469143/how-to-enable-ssh-root-access-on-ubuntu-14-04

Regards,
Gautam Gopalakrishnan

Re: Issue in installing single user Cloudera Manager 5.3.0

New Contributor

I was able to pass the authorization issue by selecting the "id_rsa" file and providing the my root password.

 

Now I am encountering another issue. In the Cluster installation page I am getting the below error-

 

Installation failed. Failed to receive heartbeat from agent.

  • Ensure that the host's hostname is configured properly.
  • Ensure that port 7182 is accessible on the Cloudera Manager Server (check firewall rules).
  • Ensure that ports 9000 and 9001 are free on the host being added.
  • Check agent logs in /var/log/cloudera-scm-agent/ on the host being added (some of the logs can be found in the installation details).

The cloudera-scm-agent.out log in /var/log/cloudera-scm-agent is as below -

 

 

[11/Jan/2015 09:02:56 +0000] 7433 MainThread agent        INFO     SCM Agent Version: 5.3.0
[11/Jan/2015 09:02:56 +0000] 7433 MainThread agent        INFO     Not starting a new session.
[11/Jan/2015 09:02:56 +0000] 7433 MainThread agent        INFO     Adding env vars that start with CMF_AGENT_
[11/Jan/2015 09:02:56 +0000] 7433 MainThread agent        ERROR    Could not open log file; writing to stderr.
Traceback (most recent call last):
  File "/usr/lib/cmf/agent/src/cmf/agent.py", line 3033, in setup_rolling_logging
    maxBytes=MAX_LOG_SIZE_BYTES, backupCount=LOG_BACKUP_COUNT)
  File "/usr/lib/python2.7/logging/handlers.py", line 117, in __init__
    BaseRotatingHandler.__init__(self, filename, mode, encoding, delay)
  File "/usr/lib/python2.7/logging/handlers.py", line 64, in __init__
    logging.FileHandler.__init__(self, filename, mode, encoding, delay)
  File "/usr/lib/python2.7/logging/__init__.py", line 903, in __init__
    StreamHandler.__init__(self, self._open())
  File "/usr/lib/python2.7/logging/__init__.py", line 928, in _open
    stream = open(self.baseFilename, self.mode)
IOError: [Errno 13] Permission denied: '/var/log/cloudera-scm-agent/cloudera-scm-agent.log'
[11/Jan/2015 09:02:56 +0000] 7433 MainThread agent        INFO     SCM Agent Version: 5.3.0
[11/Jan/2015 09:02:56 +0000] 7433 MainThread agent        INFO     Agent Protocol Version: 4
[11/Jan/2015 09:02:56 +0000] 7433 MainThread agent        INFO     Using Host ID: da8c7125-75ce-44b0-978f-5b190256cff4
[11/Jan/2015 09:02:56 +0000] 7433 MainThread agent        INFO     Using directory: /run/cloudera-scm-agent
[11/Jan/2015 09:02:56 +0000] 7433 MainThread agent        INFO     Using supervisor binary path: /usr/lib/cmf/agent/src/cmf/../../build/env/bin/supervisord
[11/Jan/2015 09:02:56 +0000] 7433 MainThread agent        INFO     Neither verify_cert_file nor verify_cert_dir are configured. Not performing validation of server certificates in HTTPS communication. These options can be configured in this agent's config.ini file to enable certificate validation.
[11/Jan/2015 09:02:56 +0000] 7433 MainThread agent        INFO     Agent Logging Level: INFO
[11/Jan/2015 09:02:56 +0000] 7433 MainThread agent        INFO     No command line vars
[11/Jan/2015 09:02:56 +0000] 7433 MainThread agent        INFO     Missing database jar: /usr/share/java/mysql-connector-java.jar (normal, if you're not using this database type)
[11/Jan/2015 09:02:56 +0000] 7433 MainThread agent        INFO     Missing database jar: /usr/share/java/oracle-connector-java.jar (normal, if you're not using this database type)
[11/Jan/2015 09:02:56 +0000] 7433 MainThread agent        INFO     Found database jar: /usr/share/cmf/lib/postgresql-9.0-801.jdbc4.jar
[11/Jan/2015 09:02:56 +0000] 7433 MainThread agent        INFO     Agent starting as pid 7433 user cloudera-scm(121) group cloudera-scm(130).
[11/Jan/2015 09:02:56 +0000] 7433 MainThread agent        INFO     Because agent not running as root, all processes will run with current user.
[11/Jan/2015 09:02:56 +0000] 7433 MainThread agent        WARNING  Expected mode 0751 for /run/cloudera-scm-agent but was 0755
[11/Jan/2015 09:02:56 +0000] 7433 MainThread agent        INFO     Re-using pre-existing directory: /run/cloudera-scm-agent
[11/Jan/2015 09:02:58 +0000] 7433 MainThread agent        INFO     Re-using pre-existing directory: /run/cloudera-scm-agent/cgroups
[11/Jan/2015 09:02:58 +0000] 7433 MainThread cgroups      WARNING  Could not read capabilities from /proc/cgroups. error: sudo: no tty present and no askpass program specified

[11/Jan/2015 09:02:58 +0000] 7433 MainThread agent        INFO     No cgroups capabilities found
[11/Jan/2015 09:02:58 +0000] 7433 MainThread agent        INFO     Setting up supervisord event monitor.
[11/Jan/2015 09:02:58 +0000] 7433 MainThread filesystem_map INFO     Monitored nodev filesystem types: ['nfs', 'nfs4', 'tmpfs']
[11/Jan/2015 09:02:58 +0000] 7433 MainThread filesystem_map INFO     Using timeout of 2.000000
[11/Jan/2015 09:02:58 +0000] 7433 MainThread filesystem_map INFO     Using join timeout of 0.100000
[11/Jan/2015 09:02:58 +0000] 7433 MainThread filesystem_map INFO     Using tolerance of 60.000000
[11/Jan/2015 09:02:58 +0000] 7433 MainThread filesystem_map INFO     Local filesystem types whitelist: ['ext2', 'ext3', 'ext4']
[11/Jan/2015 09:02:58 +0000] 7433 MainThread agent        INFO     Using metrics_url_timeout_seconds of 30.000000
[11/Jan/2015 09:02:58 +0000] 7433 MainThread agent        INFO     Using task_metrics_timeout_seconds of 5.000000
[11/Jan/2015 09:02:58 +0000] 7433 MainThread agent        INFO     Using max_collection_wait_seconds of 10.000000
[11/Jan/2015 09:02:58 +0000] 7433 MainThread metrics      INFO     Importing tasktracker metric schema from file /usr/lib/cmf/agent/src/cmf/monitor/tasktracker/schema.json
[11/Jan/2015 09:02:58 +0000] 7433 MainThread dns_names    INFO     Using timeout of 2.000000
[11/Jan/2015 09:02:58 +0000] 7433 MainThread ntp_monitor  INFO     Using timeout of 2.000000
[11/Jan/2015 09:02:58 +0000] 7433 MainThread stacks_collection_manager INFO     Using max_uncompressed_file_size_bytes: 5242880
[11/Jan/2015 09:02:58 +0000] 7433 MainThread __init__     INFO     Importing metric schema from file /usr/lib/cmf/agent/src/cmf/monitor/schema.json
[11/Jan/2015 09:02:58 +0000] 7433 MainThread agent        INFO     Supervised processes will add the following to their environment (in addition to the supervisor's env): {'CDH_PARQUET_HOME': '/usr/lib/parquet', 'JSVC_HOME': '/usr/libexec/bigtop-utils', 'CMF_PACKAGE_DIR': '/usr/lib/cmf/service', 'CDH_HADOOP_BIN': '/usr/bin/hadoop', 'MGMT_HOME': '/usr/share/cmf', 'CDH_IMPALA_HOME': '/usr/lib/impala', 'CDH_YARN_HOME': '/usr/lib/hadoop-yarn', 'CDH_HDFS_HOME': '/usr/lib/hadoop-hdfs', 'PATH': '/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games', 'CDH_HUE_PLUGINS_HOME': '/usr/lib/hadoop', 'CM_STATUS_CODES': u'STATUS_NONE HDFS_DFS_DIR_NOT_EMPTY HBASE_TABLE_DISABLED HBASE_TABLE_ENABLED JOBTRACKER_IN_STANDBY_MODE YARN_RM_IN_STANDBY_MODE', 'KEYTRUSTEE_KP_HOME': '/usr/share/keytrustee-keyprovider', 'CLOUDERA_ORACLE_CONNECTOR_JAR': '/usr/share/java/oracle-connector-java.jar', 'CDH_SQOOP2_HOME': '/usr/lib/sqoop2', 'CDH_MR2_HOME': '/usr/lib/hadoop-mapreduce', 'HIVE_DEFAULT_XML': '/etc/hive/conf.dist/hive-default.xml', 'CLOUDERA_POSTGRESQL_JDBC_JAR': '/usr/share/cmf/lib/postgresql-9.0-801.jdbc4.jar', 'CDH_KMS_HOME': '/usr/lib/hadoop-kms', 'CDH_HBASE_HOME': '/usr/lib/hbase', 'CDH_SQOOP_HOME': '/usr/lib/sqoop', 'WEBHCAT_DEFAULT_XML': '/etc/hive-webhcat/conf.dist/webhcat-default.xml', 'CDH_OOZIE_HOME': '/usr/lib/oozie', 'SUDO': 'sudo', 'CDH_ZOOKEEPER_HOME': '/usr/lib/zookeeper', 'CDH_HUE_HOME': '/usr/lib/hue', 'CLOUDERA_MYSQL_CONNECTOR_JAR': '/usr/share/java/mysql-connector-java.jar', 'CDH_HBASE_INDEXER_HOME': '/usr/lib/hbase-solr', 'CDH_MR1_HOME': '/usr/lib/hadoop-0.20-mapreduce', 'CDH_SOLR_HOME': '/usr/lib/solr', 'CDH_PIG_HOME': '/usr/lib/pig', 'CDH_CRUNCH_HOME': '/usr/lib/crunch', 'CDH_LLAMA_HOME': '/usr/lib/llama/', 'CDH_HTTPFS_HOME': '/usr/lib/hadoop-httpfs', 'CDH_HADOOP_HOME': '/usr/lib/hadoop', 'CDH_HIVE_HOME': '/usr/lib/hive', 'CDH_HCAT_HOME': '/usr/lib/hive-hcatalog', 'CDH_SENTRY_HOME': '/usr/lib/sentry', 'CDH_SPARK_HOME': '/usr/lib/spark', 'TOMCAT_HOME': '/usr/lib/bigtop-tomcat', 'CDH_FLUME_HOME': '/usr/lib/flume-ng'}
[11/Jan/2015 09:02:58 +0000] 7433 MainThread agent        INFO     To override these variables, use /etc/cloudera-scm-agent/config.ini. Environment variables for CDH locations are not used when CDH is installed from parcels.
[11/Jan/2015 09:02:58 +0000] 7433 MainThread agent        INFO     Re-using pre-existing directory: /run/cloudera-scm-agent/process
[11/Jan/2015 09:02:58 +0000] 7433 MainThread agent        INFO     Re-using pre-existing directory: /run/cloudera-scm-agent/supervisor
[11/Jan/2015 09:02:58 +0000] 7433 MainThread agent        INFO     Re-using pre-existing directory: /run/cloudera-scm-agent/supervisor/include
Error: could not read config file /run/cloudera-scm-agent/supervisor/supervisord.conf
For help, use /usr/lib/cmf/agent/src/cmf/agent.py -h
[11/Jan/2015 09:02:58 +0000] 7433 MainThread agent        ERROR    Failed to connect to previous supervisor.
Traceback (most recent call last):
  File "/usr/lib/cmf/agent/src/cmf/agent.py", line 1451, in find_or_start_supervisor
    self.configure_supervisor_clients()
  File "/usr/lib/cmf/agent/src/cmf/agent.py", line 1690, in configure_supervisor_clients
    supervisor_options.realize(args=["-c", os.path.join(self.supervisor_dir, "supervisord.conf")])
  File "/usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/supervisor-3.0-py2.7.egg/supervisor/options.py", line 1563, in realize
    Options.realize(self, *arg, **kw)
  File "/usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/supervisor-3.0-py2.7.egg/supervisor/options.py", line 310, in realize
    self.process_config()
  File "/usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/supervisor-3.0-py2.7.egg/supervisor/options.py", line 318, in process_config
    self.process_config_file(do_usage)
  File "/usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/supervisor-3.0-py2.7.egg/supervisor/options.py", line 353, in process_config_file
    self.usage(str(msg))
  File "/usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/supervisor-3.0-py2.7.egg/supervisor/options.py", line 141, in usage
    self.exit(2)
SystemExit: 2
[11/Jan/2015 09:02:58 +0000] 7433 MainThread tmpfs        INFO     Reusing mounted tmpfs at /run/cloudera-scm-agent/process
Traceback (most recent call last):
  File "/usr/lib/cmf/agent/src/cmf/agent.py", line 3088, in <module>
    main()
  File "/usr/lib/cmf/agent/src/cmf/agent.py", line 3072, in main
    agent.start()
  File "/usr/lib/cmf/agent/src/cmf/agent.py", line 487, in start
    self.find_or_start_supervisor()
  File "/usr/lib/cmf/agent/src/cmf/agent.py", line 1555, in find_or_start_supervisor
    for f in os.listdir(self.supervisor_include_path):
OSError: [Errno 13] Permission denied: '/run/cloudera-scm-agent/supervisor/include'
[11/Jan/2015 09:02:58 +0000] 7433 Dummy-1 agent        INFO     Stopping agent...

 

And the cloudera-scm-agent.log is

 

 

[11/Jan/2015 08:34:58 +0000] 1619 MainThread agent        INFO     Loading last saved hb response to complete initialization: /var/lib/cloudera-scm-agent/response.avro
[11/Jan/2015 08:34:58 +0000] 1619 MainThread agent        INFO     Using parcels directory from server provided value: /opt/cloudera/parcels
[11/Jan/2015 08:34:58 +0000] 1619 MainThread parcel       INFO     Agent does create users/groups and apply file permissions
[11/Jan/2015 08:34:58 +0000] 1619 MainThread downloader   INFO     Downloader path: /opt/cloudera/parcel-cache
[11/Jan/2015 08:34:58 +0000] 1619 MainThread parcel_cache INFO     Using /opt/cloudera/parcel-cache for parcel cache
[11/Jan/2015 08:34:59 +0000] 1619 MainThread agent        INFO     Active parcel list updated; recalculating component info.
[11/Jan/2015 08:35:03 +0000] 1619 Monitor-HostMonitor throttling_logger INFO     Using java location: '/usr/lib/jvm/java-7-oracle-cloudera/bin/java'.
[11/Jan/2015 08:36:01 +0000] 1619 MainThread agent        ERROR    Heartbeating to localhost:7182 failed.
Traceback (most recent call last):
  File "/usr/lib/cmf/agent/src/cmf/agent.py", line 904, in send_heartbeat
    self.master_port)
  File "/usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/avro-1.6.3-py2.7.egg/avro/ipc.py", line 464, in __init__
    self.conn.connect()
  File "/usr/lib/python2.7/httplib.py", line 772, in connect
    self.timeout, self.source_address)
  File "/usr/lib/python2.7/socket.py", line 571, in create_connection
    raise err
error: [Errno 111] Connection refused
[11/Jan/2015 08:37:01 +0000] 1619 MainThread agent        ERROR    Heartbeating to localhost:7182 failed.
Traceback (most recent call last):
  File "/usr/lib/cmf/agent/src/cmf/agent.py", line 904, in send_heartbeat
    self.master_port)
  File "/usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/avro-1.6.3-py2.7.egg/avro/ipc.py", line 464, in __init__
    self.conn.connect()
  File "/usr/lib/python2.7/httplib.py", line 772, in connect
    self.timeout, self.source_address)
  File "/usr/lib/python2.7/socket.py", line 571, in create_connection
    raise err
error: [Errno 111] Connection refused
[11/Jan/2015 08:38:01 +0000] 1619 MainThread agent        ERROR    Heartbeating to localhost:7182 failed.
Traceback (most recent call last):
  File "/usr/lib/cmf/agent/src/cmf/agent.py", line 904, in send_heartbeat
    self.master_port)
  File "/usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/avro-1.6.3-py2.7.egg/avro/ipc.py", line 464, in __init__
    self.conn.connect()
  File "/usr/lib/python2.7/httplib.py", line 772, in connect
    self.timeout, self.source_address)
  File "/usr/lib/python2.7/socket.py", line 571, in create_connection
    raise err
error: [Errno 111] Connection refused
[11/Jan/2015 08:39:01 +0000] 1619 MainThread agent        ERROR    Heartbeating to localhost:7182 failed.
Traceback (most recent call last):
  File "/usr/lib/cmf/agent/src/cmf/agent.py", line 904, in send_heartbeat
    self.master_port)
  File "/usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/avro-1.6.3-py2.7.egg/avro/ipc.py", line 464, in __init__
    self.conn.connect()
  File "/usr/lib/python2.7/httplib.py", line 772, in connect
    self.timeout, self.source_address)
  File "/usr/lib/python2.7/socket.py", line 571, in create_connection
    raise err
error: [Errno 111] Connection refused
[11/Jan/2015 08:44:01 +0000] 1619 MainThread agent        INFO     Stopping agent...
[11/Jan/2015 08:44:01 +0000] 1619 MainThread agent        INFO     No extant cgroups; unmounting any cgroup roots
[11/Jan/2015 08:44:01 +0000] 1619 MainThread agent        INFO     No processes are being managed; Supervisor will shutdown.
[11/Jan/2015 08:44:01 +0000] 1619 MainThread agent        INFO     Shutting down supervisord, pid 3080
[11/Jan/2015 08:44:02 +0000] 1619 MainThread agent        INFO     waiting for process to terminate...
[11/Jan/2015 08:44:02 +0000] 1619 MainThread agent        INFO     Successfully killed process with pid 3080
[11/Jan/2015 08:44:02 +0000] 1619 MainThread _cplogging   INFO     [11/Jan/2015:08:44:02] ENGINE Bus STOPPING
[11/Jan/2015 08:44:02 +0000] 1619 MainThread _cplogging   INFO     [11/Jan/2015:08:44:02] ENGINE HTTP Server cherrypy._cpwsgi_server.CPWSGIServer(('arvind-300E4C-300E5C-300E7C', 9000)) shut down
[11/Jan/2015 08:44:02 +0000] 1619 MainThread _cplogging   INFO     [11/Jan/2015:08:44:02] ENGINE Stopped thread '_TimeoutMonitor'.
[11/Jan/2015 08:44:02 +0000] 1619 MainThread _cplogging   INFO     [11/Jan/2015:08:44:02] ENGINE Bus STOPPED
[11/Jan/2015 08:44:02 +0000] 1619 MainThread _cplogging   INFO     [11/Jan/2015:08:44:02] ENGINE Bus STOPPING
[11/Jan/2015 08:44:02 +0000] 1619 MainThread _cplogging   INFO     [11/Jan/2015:08:44:02] ENGINE HTTP Server cherrypy._cpwsgi_server.CPWSGIServer(('arvind-300E4C-300E5C-300E7C', 9000)) already shut down
[11/Jan/2015 08:44:02 +0000] 1619 MainThread _cplogging   INFO     [11/Jan/2015:08:44:02] ENGINE No thread running for None.
[11/Jan/2015 08:44:02 +0000] 1619 MainThread _cplogging   INFO     [11/Jan/2015:08:44:02] ENGINE Bus STOPPED
[11/Jan/2015 08:44:02 +0000] 1619 MainThread _cplogging   INFO     [11/Jan/2015:08:44:02] ENGINE Bus EXITING
[11/Jan/2015 08:44:02 +0000] 1619 MainThread _cplogging   INFO     [11/Jan/2015:08:44:02] ENGINE Bus EXITED
[11/Jan/2015 08:44:02 +0000] 1619 MainThread agent        INFO     Agent exiting; caught signal 15

 

Thanks,

Arvind

 

Re: Issue in installing single user Cloudera Manager 5.3.0

New Contributor

Hi Arvind,

 

were you able to get this issue fixed? I am facing the same error. just curious how did you fix this issue.