Cloudera Community

Support Questions

Find answers, ask questions, and share your expertise
cancel
Turn on suggestions
Auto-suggest helps you quickly narrow down your search results by suggesting possible matches as you type.
Showing results for 
Show  only  | Search instead for 
Did you mean: 
Advanced Search

Cloudera Manager distribution error

Labels:
avatar
author-rank Abhiravilla
Explorer

Created ‎10-04-2017 08:00 PM

I am trying to install cloudera manager on single host in psuedo distribution. The OS is ubuntu 16.04. I am getting the error at distribution phase of installation. It's showing at first as connection reset by peer and then connection refused.

 

This is the log file

 

[04/Oct/2017 20:41:27 +0000] 5147 MainThread agent        INFO     Created /run/cloudera-scm-agent/process/1-cluster-host-inspector
[04/Oct/2017 20:41:27 +0000] 5147 MainThread agent        INFO     Chowning /run/cloudera-scm-agent/process/1-cluster-host-inspector to root (0) root (0)
[04/Oct/2017 20:41:27 +0000] 5147 MainThread agent        INFO     Chmod'ing /run/cloudera-scm-agent/process/1-cluster-host-inspector to 0751
[04/Oct/2017 20:41:27 +0000] 5147 MainThread agent        INFO     Created /run/cloudera-scm-agent/process/1-cluster-host-inspector/logs
[04/Oct/2017 20:41:27 +0000] 5147 MainThread agent        INFO     Chowning /run/cloudera-scm-agent/process/1-cluster-host-inspector/logs to root (0) root (0)
[04/Oct/2017 20:41:27 +0000] 5147 MainThread agent        INFO     Chmod'ing /run/cloudera-scm-agent/process/1-cluster-host-inspector/logs to 0751
[04/Oct/2017 20:41:27 +0000] 5147 MainThread process      INFO     [1-cluster-host-inspector] Refreshing process files: None
[04/Oct/2017 20:41:27 +0000] 5147 MainThread parcel       INFO     prepare_environment begin: {}, [], []
[04/Oct/2017 20:41:27 +0000] 5147 MainThread parcel       INFO     No parcels activated for use
[04/Oct/2017 20:41:27 +0000] 5147 MainThread __init__     INFO     Extracted 1 files and 0 dirs to /run/cloudera-scm-agent/process/1-cluster-host-inspector.
[04/Oct/2017 20:41:27 +0000] 5147 MainThread process      INFO     [1-cluster-host-inspector] Launching process. one-off True, command mgmt/mgmt.sh, args [u'inspector', u'input.json', u'output.json', u'DEFAULT']
[04/Oct/2017 20:41:27 +0000] 5147 MainThread agent        INFO     Triggering supervisord update.
[04/Oct/2017 20:41:27 +0000] 5147 MainThread process      INFO     Begin audit plugin refresh
[04/Oct/2017 20:41:27 +0000] 5147 MainThread navigator_plugin INFO     Scheduling a refresh for Audit Plugin for cluster-host-inspector with pipelines []
[04/Oct/2017 20:41:27 +0000] 5147 MainThread process      INFO     Begin metadata plugin refresh
[04/Oct/2017 20:41:27 +0000] 5147 MainThread navigator_plugin INFO     Scheduling a refresh for Metadata Plugin for cluster-host-inspector with pipelines []
[04/Oct/2017 20:41:27 +0000] 5147 MainThread process      INFO     Not creating a monitor for 1-cluster-host-inspector: should_monitor returns false
[04/Oct/2017 20:41:27 +0000] 5147 MainThread process      INFO     Daemon refresh complete for process 1-cluster-host-inspector.
[04/Oct/2017 20:41:30 +0000] 5147 CP Server Thread-8 _cplogging   INFO     127.0.0.1 - - [04/Oct/2017:20:41:30] "GET /process/1-cluster-host-inspector/files/inspector HTTP/1.1" 200 2252 "" "Java/1.7.0_67"
[04/Oct/2017 20:41:31 +0000] 5147 Audit-Plugin navigator_plugin INFO     Refreshing Audit Plugin for cluster-host-inspector with pipelines []
[04/Oct/2017 20:41:31 +0000] 5147 Audit-Plugin navigator_plugin_pipeline INFO     Stopping Navigator Plugin Pipeline '' for cluster-host-inspector (log dir: None)
[04/Oct/2017 20:41:31 +0000] 5147 Metadata-Plugin navigator_plugin INFO     Refreshing Metadata Plugin for cluster-host-inspector with pipelines []
[04/Oct/2017 20:41:31 +0000] 5147 Metadata-Plugin navigator_plugin_pipeline INFO     Stopping Navigator Plugin Pipeline '' for cluster-host-inspector (log dir: None)
[04/Oct/2017 20:41:45 +0000] 5147 MainThread process      INFO     [1-cluster-host-inspector] Updating process: False {u'running': (True, False), u'run_generation': (1, 2)}
[04/Oct/2017 20:41:45 +0000] 5147 MainThread process      INFO     Deactivating process 1-cluster-host-inspector
[04/Oct/2017 20:41:46 +0000] 5147 Audit-Plugin navigator_plugin INFO     stopping Audit Plugin for cluster-host-inspector with pipelines []
[04/Oct/2017 20:41:46 +0000] 5147 Audit-Plugin navigator_plugin_pipeline INFO     Stopping Navigator Plugin Pipeline '' for cluster-host-inspector (log dir: None)
[04/Oct/2017 20:41:46 +0000] 5147 Metadata-Plugin navigator_plugin INFO     stopping Metadata Plugin for cluster-host-inspector with pipelines []
[04/Oct/2017 20:41:46 +0000] 5147 Metadata-Plugin navigator_plugin_pipeline INFO     Stopping Navigator Plugin Pipeline '' for cluster-host-inspector (log dir: None)
[04/Oct/2017 20:44:50 +0000] 5147 CP Server Thread-9 _cplogging   INFO     127.0.0.1 - - [04/Oct/2017:20:44:50] "GET /heartbeat HTTP/1.1" 200 2 "" "NING/1.0"
[04/Oct/2017 20:44:50 +0000] 5147 MainThread util         INFO     Using generic audit plugin for process zookeeper-init
[04/Oct/2017 20:44:50 +0000] 5147 MainThread util         INFO     Creating metadata plugin for process zookeeper-init
[04/Oct/2017 20:44:50 +0000] 5147 MainThread util         INFO     Using specific metadata plugin for process zookeeper-init
[04/Oct/2017 20:44:50 +0000] 5147 MainThread util         INFO     Using generic metadata plugin for process zookeeper-init
[04/Oct/2017 20:44:50 +0000] 5147 MainThread agent        INFO     [2-zookeeper-init] Instantiating process
[04/Oct/2017 20:44:50 +0000] 5147 MainThread process      INFO     [2-zookeeper-init] Updating process: True {}
[04/Oct/2017 20:44:50 +0000] 5147 MainThread process      INFO     First time to activate the process [2-zookeeper-init].
[04/Oct/2017 20:44:50 +0000] 5147 MainThread agent        INFO     Created /run/cloudera-scm-agent/process/2-zookeeper-init
[04/Oct/2017 20:44:50 +0000] 5147 MainThread agent        INFO     Chowning /run/cloudera-scm-agent/process/2-zookeeper-init to zookeeper (996) zookeeper (995)
[04/Oct/2017 20:44:50 +0000] 5147 MainThread agent        INFO     Chmod'ing /run/cloudera-scm-agent/process/2-zookeeper-init to 0751
[04/Oct/2017 20:44:50 +0000] 5147 MainThread agent        INFO     Created /run/cloudera-scm-agent/process/2-zookeeper-init/logs
[04/Oct/2017 20:44:50 +0000] 5147 MainThread agent        INFO     Chowning /run/cloudera-scm-agent/process/2-zookeeper-init/logs to zookeeper (996) zookeeper (995)
[04/Oct/2017 20:44:50 +0000] 5147 MainThread agent        INFO     Chmod'ing /run/cloudera-scm-agent/process/2-zookeeper-init/logs to 0751
[04/Oct/2017 20:44:50 +0000] 5147 MainThread process      INFO     [2-zookeeper-init] Refreshing process files: None
[04/Oct/2017 20:44:50 +0000] 5147 MainThread parcel       INFO     prepare_environment begin: {u'CDH': u'5.12.1-1.cdh5.12.1.p0.3'}, [u'cdh'], [u'cdh-plugin', u'zookeeper-plugin']
[04/Oct/2017 20:44:50 +0000] 5147 MainThread parcel       INFO     The following requested parcels are not available: {}
[04/Oct/2017 20:44:50 +0000] 5147 MainThread parcel       INFO     Obtained tags ['cdh', 'impala', 'sentry', 'solr', 'spark'] for parcel CDH
[04/Oct/2017 20:44:50 +0000] 5147 MainThread parcel       INFO     prepare_environment end: {'CDH': '5.12.1-1.cdh5.12.1.p0.3'}
[04/Oct/2017 20:44:50 +0000] 5147 MainThread __init__     INFO     Extracted 10 files and 0 dirs to /run/cloudera-scm-agent/process/2-zookeeper-init.
[04/Oct/2017 20:44:50 +0000] 5147 MainThread process      INFO     [2-zookeeper-init] Evaluating resource: {u'io': None, u'named_cpu': None, u'tcp_listen': None, u'dynamic': True, u'rlimits': None, u'install': None, u'file': None, u'memory': None, u'directory': {u'path': u'/var/log/zookeeper/stacks', u'bytes_free_warning_threshhold_bytes': 0, u'group': u'zookeeper', u'user': u'zookeeper', u'mode': 493}, u'cpu': None, u'contents': None}
[04/Oct/2017 20:44:50 +0000] 5147 MainThread os_ops       INFO     Created directory /var/log/zookeeper
[04/Oct/2017 20:44:50 +0000] 5147 MainThread os_ops       INFO     Created directory /var/log/zookeeper/stacks
[04/Oct/2017 20:44:50 +0000] 5147 MainThread process      INFO     reading limits: {u'limit_memlock': None, u'limit_fds': None}
[04/Oct/2017 20:44:50 +0000] 5147 MainThread process      INFO     [2-zookeeper-init] Launching process. one-off True, command zookeeper/zk.sh, args [u'init', u'--myid=1', u'ignoreExists']
[04/Oct/2017 20:44:50 +0000] 5147 MainThread agent        INFO     Triggering supervisord update.
[04/Oct/2017 20:44:50 +0000] 5147 MainThread process      INFO     Begin audit plugin refresh
[04/Oct/2017 20:44:50 +0000] 5147 MainThread navigator_plugin INFO     Scheduling a refresh for Audit Plugin for zookeeper-init with pipelines []
[04/Oct/2017 20:44:50 +0000] 5147 MainThread process      INFO     Begin metadata plugin refresh
[04/Oct/2017 20:44:50 +0000] 5147 MainThread navigator_plugin INFO     Scheduling a refresh for Metadata Plugin for zookeeper-init with pipelines []
[04/Oct/2017 20:44:50 +0000] 5147 MainThread process      INFO     Not creating a monitor for 2-zookeeper-init: should_monitor returns false
[04/Oct/2017 20:44:50 +0000] 5147 MainThread process      INFO     Daemon refresh complete for process 2-zookeeper-init.
[04/Oct/2017 20:44:51 +0000] 5147 Audit-Plugin navigator_plugin INFO     Refreshing Audit Plugin for zookeeper-init with pipelines []
[04/Oct/2017 20:44:51 +0000] 5147 Audit-Plugin navigator_plugin_pipeline INFO     Stopping Navigator Plugin Pipeline '' for zookeeper-init (log dir: None)
[04/Oct/2017 20:44:51 +0000] 5147 Metadata-Plugin navigator_plugin INFO     Refreshing Metadata Plugin for zookeeper-init with pipelines []
[04/Oct/2017 20:44:51 +0000] 5147 Metadata-Plugin navigator_plugin_pipeline INFO     Stopping Navigator Plugin Pipeline '' for zookeeper-init (log dir: None)
[04/Oct/2017 20:45:07 +0000] 5147 MainThread process      INFO     [2-zookeeper-init] Updating process: False {u'running': (True, False), u'run_generation': (1, 2)}
[04/Oct/2017 20:45:07 +0000] 5147 MainThread process      INFO     Deactivating process 2-zookeeper-init
[04/Oct/2017 20:45:11 +0000] 5147 Audit-Plugin navigator_plugin INFO     stopping Audit Plugin for zookeeper-init with pipelines []
[04/Oct/2017 20:45:11 +0000] 5147 Audit-Plugin navigator_plugin_pipeline INFO     Stopping Navigator Plugin Pipeline '' for zookeeper-init (log dir: None)
[04/Oct/2017 20:45:11 +0000] 5147 Metadata-Plugin navigator_plugin INFO     stopping Metadata Plugin for zookeeper-init with pipelines []
[04/Oct/2017 20:45:11 +0000] 5147 Metadata-Plugin navigator_plugin_pipeline INFO     Stopping Navigator Plugin Pipeline '' for zookeeper-init (log dir: None)
[04/Oct/2017 20:45:22 +0000] 5147 MainThread firehoses    INFO     Reporting interval updated: 5.0 -> 60
[04/Oct/2017 20:46:20 +0000] 5147 MonitorDaemon-Reporter firehoses    INFO     Creating a connection to the SERVICEMONITOR.
[04/Oct/2017 20:46:20 +0000] 5147 MonitorDaemon-Reporter firehoses    INFO     Creating a connection to the HOSTMONITOR.
[04/Oct/2017 20:46:20 +0000] 5147 MonitorDaemon-Reporter throttling_logger ERROR    Error sending messages to firehose: mgmt-HOSTMONITOR-58d97c64d44220f47b91dc6ed632f373
Traceback (most recent call last):
  File "/usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/cmf-5.12.1-py2.7.egg/cmf/monitor/firehose.py", line 116, in _send
    self._port)
  File "/usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/avro-1.6.3-py2.7.egg/avro/ipc.py", line 469, in __init__
    self.conn.connect()
  File "/usr/lib/python2.7/httplib.py", line 836, in connect
    self.timeout, self.source_address)
  File "/usr/lib/python2.7/socket.py", line 575, in create_connection
    raise err
error: [Errno 111] Connection refused
[04/Oct/2017 20:50:07 +0000] 5147 MainThread heartbeat_tracker INFO     HB stats (seconds): num:46 LIFE_MIN:0.01 min:0.00 mean:0.03 max:0.16 LIFE_MAX:0.07
[04/Oct/2017 20:51:22 +0000] 5147 MainThread throttling_logger INFO     (15 skipped) Identified java component java6 with full version JAVA_HOME=/usr/lib/jvm/j2sdk1.6-oracle java version "1.6.0_31" Java(TM) SE Runtime Environment (build 1.6.0_31-b04) Java HotSpot(TM) 64-Bit Server VM (build 20.6-b01, mixed mode)  for requested version 6.
[04/Oct/2017 20:51:22 +0000] 5147 MainThread throttling_logger INFO     (15 skipped) Identified java component java7 with full version JAVA_HOME=/usr/lib/jvm/java-7-oracle-cloudera java version "1.7.0_67" Java(TM) SE Runtime Environment (build 1.7.0_67-b01) Java HotSpot(TM) 64-Bit Server VM (build 24.65-b04, mixed mode)  for requested version 7.
[04/Oct/2017 20:57:20 +0000] 5147 MonitorDaemon-Reporter throttling_logger ERROR    (10 skipped) Error sending messages to firehose: mgmt-HOSTMONITOR-58d97c64d44220f47b91dc6ed632f373
Traceback (most recent call last):
  File "/usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/cmf-5.12.1-py2.7.egg/cmf/monitor/firehose.py", line 116, in _send
    self._port)
  File "/usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/avro-1.6.3-py2.7.egg/avro/ipc.py", line 469, in __init__
    self.conn.connect()
  File "/usr/lib/python2.7/httplib.py", line 836, in connect
    self.timeout, self.source_address)
  File "/usr/lib/python2.7/socket.py", line 575, in create_connection
    raise err
error: [Errno 111] Connection refused
[04/Oct/2017 21:00:07 +0000] 5147 MainThread heartbeat_tracker INFO     HB stats (seconds): num:40 LIFE_MIN:0.01 min:0.01 mean:0.02 max:0.03 LIFE_MAX:0.07
[04/Oct/2017 21:07:20 +0000] 5147 MonitorDaemon-Reporter throttling_logger ERROR    (9 skipped) Error sending messages to firehose: mgmt-HOSTMONITOR-58d97c64d44220f47b91dc6ed632f373
[04/Oct/2017 21:10:08 +0000] 5147 MainThread heartbeat_tracker INFO     HB stats (seconds): num:40 LIFE_MIN:0.01 min:0.01 mean:0.02 max:0.03 LIFE_MAX:0.07
[04/Oct/2017 21:17:20 +0000] 5147 MonitorDaemon-Reporter throttling_logger ERROR    (9 skipped) Error sending messages to firehose: mgmt-HOSTMONITOR-58d97c64d44220f47b91dc6ed632f373
Traceback (most recent call last):
  File "/usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/cmf-5.12.1-py2.7.egg/cmf/monitor/firehose.py", line 116, in _send
    self._port)
  File "/usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/avro-1.6.3-py2.7.egg/avro/ipc.py", line 469, in __init__
    self.conn.connect()
  File "/usr/lib/python2.7/httplib.py", line 836, in connect
    self.timeout, self.source_address)
  File "/usr/lib/python2.7/socket.py", line 575, in create_connection
    raise err
error: [Errno 111] Connection refused
[04/Oct/2017 21:20:08 +0000] 5147 MainThread heartbeat_tracker INFO     HB stats (seconds): num:40 LIFE_MIN:0.01 min:0.01 mean:0.02 max:0.03 LIFE_MAX:0.07
[04/Oct/2017 21:21:23 +0000] 5147 MainThread throttling_logger INFO     (14 skipped) Identified java component java6 with full version JAVA_HOME=/usr/lib/jvm/j2sdk1.6-oracle java version "1.6.0_31" Java(TM) SE Runtime Environment (build 1.6.0_31-b04) Java HotSpot(TM) 64-Bit Server VM (build 20.6-b01, mixed mode)  for requested version 6.
[04/Oct/2017 21:21:23 +0000] 5147 MainThread throttling_logger INFO     (14 skipped) Identified java component java7 with full version JAVA_HOME=/usr/lib/jvm/java-7-oracle-cloudera java version "1.7.0_67" Java(TM) SE Runtime Environment (build 1.7.0_67-b01) Java HotSpot(TM) 64-Bit Server VM (build 24.65-b04, mixed mode)  for requested version 7.
[04/Oct/2017 21:27:20 +0000] 5147 MonitorDaemon-Reporter throttling_logger ERROR    (9 skipped) Error sending messages to firehose: mgmt-HOSTMONITOR-58d97c64d44220f47b91dc6ed632f373
Traceback (most recent call last):
  File "/usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/cmf-5.12.1-py2.7.egg/cmf/monitor/firehose.py", line 116, in _send
    self._port)
  File "/usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/avro-1.6.3-py2.7.egg/avro/ipc.py", line 469, in __init__
    self.conn.connect()
  File "/usr/lib/python2.7/httplib.py", line 836, in connect
    self.timeout, self.source_address)
  File "/usr/lib/python2.7/socket.py", line 575, in create_connection
    raise err
error: [Errno 111] Connection refused
[04/Oct/2017 21:30:09 +0000] 5147 MainThread heartbeat_tracker INFO     HB stats (seconds): num:40 LIFE_MIN:0.01 min:0.01 mean:0.02 max:0.04 LIFE_MAX:0.07
[04/Oct/2017 21:38:20 +0000] 5147 MonitorDaemon-Reporter throttling_logger ERROR    (10 skipped) Error sending messages to firehose: mgmt-HOSTMONITOR-58d97c64d44220f47b91dc6ed632f373
Traceback (most recent call last):
  File "/usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/cmf-5.12.1-py2.7.egg/cmf/monitor/firehose.py", line 116, in _send
    self._port)
  File "/usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/avro-1.6.3-py2.7.egg/avro/ipc.py", line 469, in __init__
    self.conn.connect()
  File "/usr/lib/python2.7/httplib.py", line 836, in connect
    self.timeout, self.source_address)
  File "/usr/lib/python2.7/socket.py", line 575, in create_connection
    raise err
error: [Errno 111] Connection refused
[04/Oct/2017 21:40:09 +0000] 5147 MainThread heartbeat_tracker INFO     HB stats (seconds): num:40 LIFE_MIN:0.01 min:0.00 mean:0.01 max:0.02 LIFE_MAX:0.07

The host address i am using is 127.0.1.1 with host name as my system name. I have tried it with 127.0.0.1 but it fails at intial phase heart beat not received.

7,720 Views
0 Kudos
10 REPLIES 10

avatar
csguna author-rank
Champion

Created ‎10-04-2017 09:14 PM

whats your firewall or iptable status ?

7,330 Views
0 Kudos

avatar
author-rank Abhiravilla
Explorer

Created ‎10-04-2017 11:06 PM

yes firewall is disabled and iptables are off all 6 of them
7,320 Views
0 Kudos

avatar
author-rank bgooley author-rank
Master Guru

Created ‎10-05-2017 09:57 AM

@Abhiravilla,

 

The log you show does not indicate any problems that would prevent parcel distribution.

 

The following exception only indicates that the agent could not connect to the Host Monitor (which is expected if it is not running):

[04/Oct/2017 20:57:20 +0000] 5147 MonitorDaemon-Reporter throttling_logger ERROR    (10 skipped) Error sending messages to firehose: mgmt-HOSTMONITOR-58d97c64d44220f47b91dc6ed632f373

Traceback (most recent call last):

  File "/usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/cmf-5.12.1-py2.7.egg/cmf/monitor/firehose.py", line 116, in _send

    self._port)

  File "/usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/avro-1.6.3-py2.7.egg/avro/ipc.py", line 469, in __init__

    self.conn.connect()

  File "/usr/lib/python2.7/httplib.py", line 836, in connect

    self.timeout, self.source_address)

  File "/usr/lib/python2.7/socket.py", line 575, in create_connection

    raise err

error: [Errno 111] Connection refused

 

How do you know there are heartbeat problems?

Also:

 

- what is your server_host value in /etc/cloudera-scm-agent/config.ini

- what is the output of "hostname -f"

 

 

7,308 Views
0 Kudos

avatar
author-rank Abhiravilla
Explorer

Created ‎10-12-2017 07:58 AM

Sorry for late reply. I don't know if there are any heart beat problems. At first I got the heart beat problem but after logging in as root I solved that.
7,276 Views
0 Kudos

avatar
author-rank Abhiravilla
Explorer

Created ‎10-13-2017 08:13 AM

output of hostname -f is hd

7,261 Views
0 Kudos

avatar
csguna author-rank
Champion

Created on ‎10-19-2017 07:03 PM - edited ‎10-19-2017 07:05 PM

1. check your cloudera-scm-agent status 

2 . check your server_host value  in /etc/cloudera-scm-agent/config.ini , it should point to your cloduera manager's host. 

7,221 Views
0 Kudos

avatar
author-rank pra_big
Explorer

Created ‎01-28-2019 03:25 AM

We see the same issue on out node05

28/Jan/2019 11:00:36 +0000] 62064 Metadata-Plugin navigator_plugin_pipeline INFO Stopping Navigator Plugin Pipeline '' for yarn-RESOURCEMANAGER (log dir: None) [28/Jan/2019 11:00:36 +0000] 62064 Metadata-Plugin navigator_plugin INFO Refreshing Metadata Plugin for hive-WEBHCAT with pipelines [] [28/Jan/2019 11:00:36 +0000] 62064 Metadata-Plugin navigator_plugin_pipeline INFO Stopping Navigator Plugin Pipeline '' for hive-WEBHCAT (log dir: None) [28/Jan/2019 11:00:36 +0000] 62064 Audit-Plugin throttling_logger INFO Unable to communicate with audit server (host: nlbv015c060605.em2.oraclecloud.com, port: 7186): [Errno 111] Connection refused [28/Jan/2019 11:00:36 +0000] 62064 Audit-Plugin throttling_logger INFO Unable to send data to nav server. Will try again. [28/Jan/2019 11:00:36 +0000] 62064 Metadata-Plugin throttling_logger ERROR Unable to send message to metadata server. Traceback (most recent call last): File "/usr/lib64/cmf/agent/build/env/lib/python2.6/site-packages/cmf-5.13.1-py2.6.egg/cmf/audit/navigator_sender.py", line 162, in _send_json_data elif isinstance(getattr(e, 'reason'), socket.timeout): AttributeError: 'HTTPError' object has no attribute 'reason' [28/Jan/2019 11:00:55 +0000] 62064 MonitorDaemon-Scheduler __init__ INFO Monitor ready to report: ('GenericMonitor HUE-KT_RENEWER for None',) [28/Jan/2019 11:00:55 +0000] 62064 MonitorDaemon-Scheduler __init__ INFO Monitor ready to report: ('GenericMonitor HIVE-HIVESERVER2 for None',) [28/Jan/2019 11:00:55 +0000] 62064 MonitorDaemon-Scheduler __init__ INFO Monitor ready to report: ('GenericMonitor HIVE-HIVEMETASTORE for None',) [28/Jan/2019 11:00:55 +0000] 62064 MonitorDaemon-Scheduler __init__ INFO Monitor ready to report: ('GenericMonitor HIVE-WEBHCAT for None',) [28/Jan/2019 11:00:57 +0000] 62064 MonitorDaemon-Scheduler __init__ INFO Monitor ready to report: ('GenericMonitor HUE-HUE_SERVER for None',)

-bash-4.1# dcli -C cat /etc/cloudera-scm-agent/config.ini | grep server_host 10.196.64.68: server_host=nlbv015c060605.em2.oraclecloud.com 10.196.64.44: server_host=nlbv015c060605.em2.oraclecloud.com 10.196.64.86: server_host=nlbv015c060605.em2.oraclecloud.com 10.196.64.104: server_host=nlbv015c060605.em2.oraclecloud.com 10.196.64.8: server_host=nlbv015c060605.em2.oraclecloud.com -bash-4.1# hostname -f nlbv012c060605.em2.oraclecloud.com -bash-4.1#

-bash-4.1# dcli -C cat /etc/cloudera-scm-agent/config.ini | grep server_port
10.196.64.68: server_port=7182
10.196.64.44: server_port=7182
10.196.64.86: server_port=7182
10.196.64.104: server_port=7182
10.196.64.8: server_port=7182
-bash-4.1#

5,899 Views
0 Kudos

avatar
author-rank krishnaM
New Contributor

Created ‎12-10-2017 01:58 PM

Hi

 

I had the same issue. after spending days i managed to solve it by using hostname instead of the ip address. i managed to add another node too with out an issue. 

 

Hope this helps 

 

 

 

7,076 Views
0 Kudos

avatar
author-rank sbommaraju
New Contributor

Created ‎04-03-2019 07:35 AM

sudo systemctl status cloudera-scm-server
● cloudera-scm-server.service - Cloudera CM Server Service
Loaded: loaded (/usr/lib/systemd/system/cloudera-scm-server.service; enabled; vendor preset: disabled)
Active: failed (Result: start-limit) since Wed 2019-04-03 19:45:34 IST; 42s ago
Process: 4287 ExecStart=/opt/cloudera/cm/bin/cm-server (code=exited, status=1/FAILURE)
Main PID: 4287 (code=exited, status=1/FAILURE)

Apr 03 19:45:33 hadoopnn.hadoop.com systemd[1]: Unit cloudera-scm-server.service entered failed state.
Apr 03 19:45:33 hadoopnn.hadoop.com systemd[1]: cloudera-scm-server.service failed.
Apr 03 19:45:34 hadoopnn.hadoop.com systemd[1]: cloudera-scm-server.service holdoff time over, scheduling restart.
Apr 03 19:45:34 hadoopnn.hadoop.com systemd[1]: Stopped Cloudera CM Server Service.
Apr 03 19:45:34 hadoopnn.hadoop.com systemd[1]: start request repeated too quickly for cloudera-scm-server.service
Apr 03 19:45:34 hadoopnn.hadoop.com systemd[1]: Failed to start Cloudera CM Server Service.
Apr 03 19:45:34 hadoopnn.hadoop.com systemd[1]: Unit cloudera-scm-server.service entered failed state.
Apr 03 19:45:34 hadoopnn.hadoop.com systemd[1]: cloudera-scm-server.service failed.

5,607 Views
0 Kudos
Announcements
What's New @ Cloudera
Cloudera Data Engineering 1.23: Access Spark from Your Favor...
What's New @ Cloudera
HBase REST server scaling support is Generally Available
What's New @ Cloudera
New CLI option in the update-database command
What's New @ Cloudera
New Action menu item in the Cloudera Operational Database UI
What's New @ Cloudera
Get the list of supported instance types in the Cloudera Ope...
View More Announcements