Cloudera Community

Support Questions

Find answers, ask questions, and share your expertise
cancel
Turn on suggestions
Auto-suggest helps you quickly narrow down your search results by suggesting possible matches as you type.
Showing results for 
Show  only  | Search instead for 
Did you mean: 
Advanced Search

Hue: The Cloudera Manager Agent is not able to communicate with this role's web server.

Labels:
avatar
author-rank jehalter
Contributor

Created on ‎02-07-2017 01:37 PM - edited ‎09-16-2022 04:02 AM

After upgrading from CDH 5.7.5 to 5.10.0, Hue's Webserver Status gives error message:

 

"Bad : The Cloudera Manager Agent is not able to communicate with this role's web server."

 

Hue is up-and-running, I just think that the CM agent is unable to see it.

 

I found this in /var/log/cloudera-scm-agent/cloudera-scm-agent.log on the Hue server:

 

[07/Feb/2017 15:42:09 +0000] 3747 Monitor-GenericMonitor throttling_logger ERROR (59 skipped) Error calling is alive at 'https://0.0.0.0:8888/desktop/debug/is_alive'
Traceback (most recent call last):
File "/usr/lib64/cmf/agent/build/env/lib/python2.7/site-packages/cmf-5.10.0-py2.7.egg/cmf/monitor/generic/hue_adapters.py", line 39, in collect_and_parse
self._call_is_alive(self._metrics_uri)
File "/usr/lib64/cmf/agent/build/env/lib/python2.7/site-packages/cmf-5.10.0-py2.7.egg/cmf/monitor/generic/hue_adapters.py", line 76, in _call_is_alive
head_request_with_timeout(is_alive_url, timeout=timeout)
File "/usr/lib64/cmf/agent/build/env/lib/python2.7/site-packages/cmf-5.10.0-py2.7.egg/cmf/url_util.py", line 94, in head_request_with_timeout
max_cert_depth)
File "/usr/lib64/cmf/agent/build/env/lib/python2.7/site-packages/cmf-5.10.0-py2.7.egg/cmf/url_util.py", line 67, in urlopen_with_timeout
return opener.open(url, data, timeout)
File "/usr/lib64/python2.7/urllib2.py", line 437, in open
response = meth(req, response)
File "/usr/lib64/python2.7/urllib2.py", line 550, in http_response
'http', request, response, code, msg, hdrs)
File "/usr/lib64/python2.7/urllib2.py", line 475, in error
return self._call_chain(*args)
File "/usr/lib64/python2.7/urllib2.py", line 409, in _call_chain
result = func(*args)
File "/usr/lib64/cmf/agent/build/env/lib/python2.7/site-packages/cmf-5.10.0-py2.7.egg/cmf/https.py", line 205, in http_error_default
raise e
HTTPError: HTTP Error 400: BAD REQUEST

 

Any help would be most appreciated.

 

Thanks,

-jon

18,575 Views
2
27 REPLIES 27

avatar
author-rank iyanmv
Explorer

Created ‎12-12-2017 06:43 AM

You can follow the solution in previous page, it works!

 

By the way, I have just upgraded to CM and CDH 5.13.1 and this issue is still present. Will it be fixed?

8,639 Views
0 Kudos

avatar
author-rank DataYogi
Explorer

Created ‎12-29-2017 05:52 AM

I did what you have described here. The issue still persists. Also now when i open the hue page. I get the following error. Earlier it was page cannot be displayed issue. 

 

Traceback (most recent call last):
  File "/usr/lib/hue/desktop/core/src/desktop/lib/wsgiserver.py", line 1215, in communicate
    req.respond()
  File "/usr/lib/hue/desktop/core/src/desktop/lib/wsgiserver.py", line 576, in respond
    self._respond()
  File "/usr/lib/hue/desktop/core/src/desktop/lib/wsgiserver.py", line 588, in _respond
    response = self.wsgi_app(self.environ, self.start_response)
  File "/usr/lib/hue/build/env/lib/python2.7/site-packages/Django-1.6.10-py2.7.egg/django/core/handlers/wsgi.py", line 187, in __call__
    self.load_middleware()
  File "/usr/lib/hue/build/env/lib/python2.7/site-packages/Django-1.6.10-py2.7.egg/django/core/handlers/base.py", line 47, in load_middleware
    mw_instance = mw_class()
  File "/usr/lib/hue/build/env/lib/python2.7/site-packages/Django-1.6.10-py2.7.egg/django/middleware/locale.py", line 24, in __init__
    for url_pattern in get_resolver(None).url_patterns:
  File "/usr/lib/hue/build/env/lib/python2.7/site-packages/Django-1.6.10-py2.7.egg/django/core/urlresolvers.py", line 365, in url_patterns
    patterns = getattr(self.urlconf_module, "urlpatterns", self.urlconf_module)
  File "/usr/lib/hue/build/env/lib/python2.7/site-packages/Django-1.6.10-py2.7.egg/django/core/urlresolvers.py", line 360, in urlconf_module
    self._urlconf_module = import_module(self.urlconf_name)
  File "/usr/lib/hue/build/env/lib/python2.7/site-packages/Django-1.6.10-py2.7.egg/django/utils/importlib.py", line 40, in import_module
    __import__(name)
  File "/usr/lib/hue/desktop/core/src/desktop/urls.py", line 200, in <module>
    if app.urls:
  File "/usr/lib/hue/desktop/core/src/desktop/appmanager.py", line 170, in urls
    return self._submodule("urls")
  File "/usr/lib/hue/desktop/core/src/desktop/appmanager.py", line 201, in _submodule
    return _import_module_or_none(self.module.__name__ + "." + name)
  File "/usr/lib/hue/desktop/core/src/desktop/appmanager.py", line 53, in _import_module_or_none
    __import__(module)
  File "/usr/lib/hue/desktop/libs/notebook/src/notebook/urls.py", line 29, in <module>
    import notebook.monkey_patches
  File "/usr/lib/hue/desktop/libs/notebook/src/notebook/monkey_patches.py", line 44, in <module>
    if ENABLE_DBPROXY_SERVER.get() and [interpreter for interpreter in get_ordered_interpreters() if interpreter['interface'] == 'jdbc']:
  File "/usr/lib/hue/desktop/libs/notebook/src/notebook/conf.py", line 58, in get_ordered_interpreters
    _default_interpreters(user)
  File "/usr/lib/hue/desktop/libs/notebook/src/notebook/conf.py", line 231, in _default_interpreters
    cluster = Cluster(user)
  File "/usr/lib/hue/desktop/core/src/desktop/models.py", line 1867, in __init__
    self.default_cluster = get_user_preferences(self.user, key=USER_PREFERENCE_CLUSTER)
  File "/usr/lib/hue/desktop/core/src/desktop/models.py", line 1923, in get_user_preferences
    x = UserPreferences.objects.get(user=user, key=key)
  File "/usr/lib/hue/build/env/lib/python2.7/site-packages/Django-1.6.10-py2.7.egg/django/db/models/manager.py", line 151, in get
    return self.get_queryset().get(*args, **kwargs)
  File "/usr/lib/hue/build/env/lib/python2.7/site-packages/Django-1.6.10-py2.7.egg/django/db/models/query.py", line 304, in get
    num = len(clone)
  File "/usr/lib/hue/build/env/lib/python2.7/site-packages/Django-1.6.10-py2.7.egg/django/db/models/query.py", line 77, in __len__
    self._fetch_all()
  File "/usr/lib/hue/build/env/lib/python2.7/site-packages/Django-1.6.10-py2.7.egg/django/db/models/query.py", line 857, in _fetch_all
    self._result_cache = list(self.iterator())
  File "/usr/lib/hue/build/env/lib/python2.7/site-packages/Django-1.6.10-py2.7.egg/django/db/models/query.py", line 220, in iterator
    for row in compiler.results_iter():
  File "/usr/lib/hue/build/env/lib/python2.7/site-packages/Django-1.6.10-py2.7.egg/django/db/models/sql/compiler.py", line 713, in results_iter
    for rows in self.execute_sql(MULTI):
  File "/usr/lib/hue/build/env/lib/python2.7/site-packages/Django-1.6.10-py2.7.egg/django/db/models/sql/compiler.py", line 785, in execute_sql
    cursor = self.connection.cursor()
  File "/usr/lib/hue/build/env/lib/python2.7/site-packages/Django-1.6.10-py2.7.egg/django/db/backends/__init__.py", line 162, in cursor
    cursor = util.CursorWrapper(self._cursor(), self)
  File "/usr/lib/hue/build/env/lib/python2.7/site-packages/Django-1.6.10-py2.7.egg/django/db/backends/__init__.py", line 132, in _cursor
    self.ensure_connection()
  File "/usr/lib/hue/build/env/lib/python2.7/site-packages/Django-1.6.10-py2.7.egg/django/db/backends/__init__.py", line 127, in ensure_connection
    self.connect()
  File "/usr/lib/hue/build/env/lib/python2.7/site-packages/Django-1.6.10-py2.7.egg/django/db/utils.py", line 99, in __exit__
    six.reraise(dj_exc_type, dj_exc_value, traceback)
  File "/usr/lib/hue/build/env/lib/python2.7/site-packages/Django-1.6.10-py2.7.egg/django/db/backends/__init__.py", line 127, in ensure_connection
    self.connect()
  File "/usr/lib/hue/build/env/lib/python2.7/site-packages/Django-1.6.10-py2.7.egg/django/db/backends/__init__.py", line 115, in connect
    self.connection = self.get_new_connection(conn_params)
  File "/usr/lib/hue/build/env/lib/python2.7/site-packages/Django-1.6.10-py2.7.egg/django/db/backends/postgresql_psycopg2/base.py", line 115, in get_new_connection
    return Database.connect(**conn_params)
  File "/usr/lib/python2.7/dist-packages/psycopg2/__init__.py", line 179, in connect
    connection_factory=connection_factory, async=async)
OperationalError: FATAL:  no pg_hba.conf entry for host "2402:1f00:8001:281::", user "hue", database "hue", SSL off

  

7,101 Views
0 Kudos

avatar
author-rank DataYogi
Explorer

Created ‎12-29-2017 05:52 AM

I did what you have described here. The issue still persists. Also now when i open the hue page. I get the following error. Earlier it was page cannot be displayed issue. 

 

Traceback (most recent call last):
  File "/usr/lib/hue/desktop/core/src/desktop/lib/wsgiserver.py", line 1215, in communicate
    req.respond()
  File "/usr/lib/hue/desktop/core/src/desktop/lib/wsgiserver.py", line 576, in respond
    self._respond()
  File "/usr/lib/hue/desktop/core/src/desktop/lib/wsgiserver.py", line 588, in _respond
    response = self.wsgi_app(self.environ, self.start_response)
  File "/usr/lib/hue/build/env/lib/python2.7/site-packages/Django-1.6.10-py2.7.egg/django/core/handlers/wsgi.py", line 187, in __call__
    self.load_middleware()
  File "/usr/lib/hue/build/env/lib/python2.7/site-packages/Django-1.6.10-py2.7.egg/django/core/handlers/base.py", line 47, in load_middleware
    mw_instance = mw_class()
  File "/usr/lib/hue/build/env/lib/python2.7/site-packages/Django-1.6.10-py2.7.egg/django/middleware/locale.py", line 24, in __init__
    for url_pattern in get_resolver(None).url_patterns:
  File "/usr/lib/hue/build/env/lib/python2.7/site-packages/Django-1.6.10-py2.7.egg/django/core/urlresolvers.py", line 365, in url_patterns
    patterns = getattr(self.urlconf_module, "urlpatterns", self.urlconf_module)
  File "/usr/lib/hue/build/env/lib/python2.7/site-packages/Django-1.6.10-py2.7.egg/django/core/urlresolvers.py", line 360, in urlconf_module
    self._urlconf_module = import_module(self.urlconf_name)
  File "/usr/lib/hue/build/env/lib/python2.7/site-packages/Django-1.6.10-py2.7.egg/django/utils/importlib.py", line 40, in import_module
    __import__(name)
  File "/usr/lib/hue/desktop/core/src/desktop/urls.py", line 200, in <module>
    if app.urls:
  File "/usr/lib/hue/desktop/core/src/desktop/appmanager.py", line 170, in urls
    return self._submodule("urls")
  File "/usr/lib/hue/desktop/core/src/desktop/appmanager.py", line 201, in _submodule
    return _import_module_or_none(self.module.__name__ + "." + name)
  File "/usr/lib/hue/desktop/core/src/desktop/appmanager.py", line 53, in _import_module_or_none
    __import__(module)
  File "/usr/lib/hue/desktop/libs/notebook/src/notebook/urls.py", line 29, in <module>
    import notebook.monkey_patches
  File "/usr/lib/hue/desktop/libs/notebook/src/notebook/monkey_patches.py", line 44, in <module>
    if ENABLE_DBPROXY_SERVER.get() and [interpreter for interpreter in get_ordered_interpreters() if interpreter['interface'] == 'jdbc']:
  File "/usr/lib/hue/desktop/libs/notebook/src/notebook/conf.py", line 58, in get_ordered_interpreters
    _default_interpreters(user)
  File "/usr/lib/hue/desktop/libs/notebook/src/notebook/conf.py", line 231, in _default_interpreters
    cluster = Cluster(user)
  File "/usr/lib/hue/desktop/core/src/desktop/models.py", line 1867, in __init__
    self.default_cluster = get_user_preferences(self.user, key=USER_PREFERENCE_CLUSTER)
  File "/usr/lib/hue/desktop/core/src/desktop/models.py", line 1923, in get_user_preferences
    x = UserPreferences.objects.get(user=user, key=key)
  File "/usr/lib/hue/build/env/lib/python2.7/site-packages/Django-1.6.10-py2.7.egg/django/db/models/manager.py", line 151, in get
    return self.get_queryset().get(*args, **kwargs)
  File "/usr/lib/hue/build/env/lib/python2.7/site-packages/Django-1.6.10-py2.7.egg/django/db/models/query.py", line 304, in get
    num = len(clone)
  File "/usr/lib/hue/build/env/lib/python2.7/site-packages/Django-1.6.10-py2.7.egg/django/db/models/query.py", line 77, in __len__
    self._fetch_all()
  File "/usr/lib/hue/build/env/lib/python2.7/site-packages/Django-1.6.10-py2.7.egg/django/db/models/query.py", line 857, in _fetch_all
    self._result_cache = list(self.iterator())
  File "/usr/lib/hue/build/env/lib/python2.7/site-packages/Django-1.6.10-py2.7.egg/django/db/models/query.py", line 220, in iterator
    for row in compiler.results_iter():
  File "/usr/lib/hue/build/env/lib/python2.7/site-packages/Django-1.6.10-py2.7.egg/django/db/models/sql/compiler.py", line 713, in results_iter
    for rows in self.execute_sql(MULTI):
  File "/usr/lib/hue/build/env/lib/python2.7/site-packages/Django-1.6.10-py2.7.egg/django/db/models/sql/compiler.py", line 785, in execute_sql
    cursor = self.connection.cursor()
  File "/usr/lib/hue/build/env/lib/python2.7/site-packages/Django-1.6.10-py2.7.egg/django/db/backends/__init__.py", line 162, in cursor
    cursor = util.CursorWrapper(self._cursor(), self)
  File "/usr/lib/hue/build/env/lib/python2.7/site-packages/Django-1.6.10-py2.7.egg/django/db/backends/__init__.py", line 132, in _cursor
    self.ensure_connection()
  File "/usr/lib/hue/build/env/lib/python2.7/site-packages/Django-1.6.10-py2.7.egg/django/db/backends/__init__.py", line 127, in ensure_connection
    self.connect()
  File "/usr/lib/hue/build/env/lib/python2.7/site-packages/Django-1.6.10-py2.7.egg/django/db/utils.py", line 99, in __exit__
    six.reraise(dj_exc_type, dj_exc_value, traceback)
  File "/usr/lib/hue/build/env/lib/python2.7/site-packages/Django-1.6.10-py2.7.egg/django/db/backends/__init__.py", line 127, in ensure_connection
    self.connect()
  File "/usr/lib/hue/build/env/lib/python2.7/site-packages/Django-1.6.10-py2.7.egg/django/db/backends/__init__.py", line 115, in connect
    self.connection = self.get_new_connection(conn_params)
  File "/usr/lib/hue/build/env/lib/python2.7/site-packages/Django-1.6.10-py2.7.egg/django/db/backends/postgresql_psycopg2/base.py", line 115, in get_new_connection
    return Database.connect(**conn_params)
  File "/usr/lib/python2.7/dist-packages/psycopg2/__init__.py", line 179, in connect
    connection_factory=connection_factory, async=async)
OperationalError: FATAL:  no pg_hba.conf entry for host "2402:1f00:8001:281::", user "hue", database "hue", SSL off

  

[29/Dec/2017 21:46:29 +0000] 8592 Metadata-Plugin navigator_plugin INFO     Refreshing Metadata Plugin for hive-HIVEMETASTORE with pipelines []

[29/Dec/2017 21:46:29 +0000] 8592 Audit-Plugin navigator_plugin INFO     Refreshing Audit Plugin for hdfs-HTTPFS with pipelines []

[29/Dec/2017 21:46:29 +0000] 8592 Metadata-Plugin navigator_plugin_pipeline INFO     Stopping Navigator Plugin Pipeline '' for hive-HIVEMETASTORE (log dir: Non

e)

[29/Dec/2017 21:46:29 +0000] 8592 Audit-Plugin navigator_plugin_pipeline INFO     Stopping Navigator Plugin Pipeline '' for hdfs-HTTPFS (log dir: None)

[29/Dec/2017 21:46:29 +0000] 8592 Metadata-Plugin navigator_plugin INFO     Refreshing Metadata Plugin for hdfs-DATANODE with pipelines []

[29/Dec/2017 21:46:29 +0000] 8592 Audit-Plugin navigator_plugin INFO     Refreshing Audit Plugin for cloudera-mgmt-HOSTMONITOR with pipelines []

[29/Dec/2017 21:46:29 +0000] 8592 Metadata-Plugin navigator_plugin_pipeline INFO     Stopping Navigator Plugin Pipeline '' for hdfs-DATANODE (log dir: None)

[29/Dec/2017 21:46:29 +0000] 8592 Audit-Plugin navigator_plugin_pipeline INFO     Stopping Navigator Plugin Pipeline '' for cloudera-mgmt-HOSTMONITOR (log dir:

 None)

[29/Dec/2017 21:46:29 +0000] 8592 Metadata-Plugin navigator_plugin INFO     Refreshing Metadata Plugin for zookeeper-server with pipelines []

[29/Dec/2017 21:46:29 +0000] 8592 Audit-Plugin navigator_plugin INFO     Refreshing Audit Plugin for hdfs-NFSGATEWAY with pipelines []

[29/Dec/2017 21:46:29 +0000] 8592 Metadata-Plugin navigator_plugin_pipeline INFO     Stopping Navigator Plugin Pipeline '' for zookeeper-server (log dir: None)

[29/Dec/2017 21:46:29 +0000] 8592 Audit-Plugin navigator_plugin_pipeline INFO     Stopping Navigator Plugin Pipeline '' for hdfs-NFSGATEWAY (log dir: None)

[29/Dec/2017 21:46:29 +0000] 8592 Metadata-Plugin navigator_plugin INFO     Refreshing Metadata Plugin for oozie-OOZIE_SERVER with pipelines []

[29/Dec/2017 21:46:29 +0000] 8592 Audit-Plugin navigator_plugin INFO     Refreshing Audit Plugin for cloudera-mgmt-EVENTSERVER with pipelines []

[29/Dec/2017 21:46:29 +0000] 8592 Metadata-Plugin navigator_plugin_pipeline INFO     Stopping Navigator Plugin Pipeline '' for oozie-OOZIE_SERVER (log dir: Non

e)

[29/Dec/2017 21:46:29 +0000] 8592 Audit-Plugin navigator_plugin_pipeline INFO     Stopping Navigator Plugin Pipeline '' for cloudera-mgmt-EVENTSERVER (log dir:

 None)

[29/Dec/2017 21:46:29 +0000] 8592 Metadata-Plugin navigator_plugin INFO     Refreshing Metadata Plugin for flume-AGENT with pipelines []

[29/Dec/2017 21:46:29 +0000] 8592 Audit-Plugin navigator_plugin INFO     Refreshing Audit Plugin for hue-HUE_LOAD_BALANCER with pipelines []

[29/Dec/2017 21:46:29 +0000] 8592 Metadata-Plugin navigator_plugin_pipeline INFO     Stopping Navigator Plugin Pipeline '' for flume-AGENT (log dir: None)

[29/Dec/2017 21:46:29 +0000] 8592 Audit-Plugin navigator_plugin_pipeline INFO     Stopping Navigator Plugin Pipeline '' for hue-HUE_LOAD_BALANCER (log dir: Non

e)

[29/Dec/2017 21:46:29 +0000] 8592 Metadata-Plugin navigator_plugin INFO     Refreshing Metadata Plugin for hdfs-NAMENODE with pipelines []

[29/Dec/2017 21:46:29 +0000] 8592 Audit-Plugin navigator_plugin INFO     Refreshing Audit Plugin for hive-HIVESERVER2 with pipelines [HiveExecHookContext,HiveM

etaStoreEventListener,HiveSentryOnFailureHook]

[29/Dec/2017 21:46:29 +0000] 8592 Metadata-Plugin navigator_plugin_pipeline INFO     Stopping Navigator Plugin Pipeline '' for hdfs-NAMENODE (log dir: None)

[29/Dec/2017 21:46:29 +0000] 8592 Audit-Plugin navigator_plugin_pipeline INFO     Stopping Navigator Plugin Pipeline 'HiveExecHookContext' for hive-HIVESERVER2

 (log dir: None)

[29/Dec/2017 21:46:29 +0000] 8592 Metadata-Plugin navigator_plugin INFO     Refreshing Metadata Plugin for hue-HUE_SERVER with pipelines []

[29/Dec/2017 21:46:29 +0000] 8592 Audit-Plugin navigator_plugin_pipeline INFO     Stopping Navigator Plugin Pipeline 'HiveMetaStoreEventListener' for hive-HIVE

SERVER2 (log dir: None)

[29/Dec/2017 21:46:29 +0000] 8592 Metadata-Plugin navigator_plugin_pipeline INFO     Stopping Navigator Plugin Pipeline '' for hue-HUE_SERVER (log dir: None)

[29/Dec/2017 21:46:29 +0000] 8592 Audit-Plugin navigator_plugin_pipeline INFO     Stopping Navigator Plugin Pipeline 'HiveSentryOnFailureHook' for hive-HIVESER

VER2 (log dir: None)

[29/Dec/2017 21:46:29 +0000] 8592 Metadata-Plugin navigator_plugin INFO     Refreshing Metadata Plugin for cloudera-mgmt-HOSTMONITOR with pipelines []

[29/Dec/2017 21:46:29 +0000] 8592 Audit-Plugin navigator_plugin INFO     Refreshing Audit Plugin for cloudera-mgmt-ACTIVITYMONITOR with pipelines []

[29/Dec/2017 21:46:29 +0000] 8592 Metadata-Plugin navigator_plugin_pipeline INFO     Stopping Navigator Plugin Pipeline '' for cloudera-mgmt-HOSTMONITOR (log d

ir: None)

[29/Dec/2017 21:46:29 +0000] 8592 Audit-Plugin navigator_plugin_pipeline INFO     Stopping Navigator Plugin Pipeline '' for cloudera-mgmt-ACTIVITYMONITOR (log 

dir: None)

[29/Dec/2017 21:46:29 +0000] 8592 Metadata-Plugin navigator_plugin INFO     Refreshing Metadata Plugin for cloudera-mgmt-EVENTSERVER with pipelines []

[29/Dec/2017 21:46:29 +0000] 8592 Audit-Plugin navigator_plugin INFO     Refreshing Audit Plugin for yarn-JOBHISTORY with pipelines []

[29/Dec/2017 21:46:29 +0000] 8592 Metadata-Plugin navigator_plugin_pipeline INFO     Stopping Navigator Plugin Pipeline '' for cloudera-mgmt-EVENTSERVER (log d

ir: None)

[29/Dec/2017 21:46:29 +0000] 8592 Audit-Plugin navigator_plugin_pipeline INFO     Stopping Navigator Plugin Pipeline '' for yarn-JOBHISTORY (log dir: None)

[29/Dec/2017 21:46:29 +0000] 8592 Metadata-Plugin navigator_plugin INFO     Refreshing Metadata Plugin for hdfs-HTTPFS with pipelines []

[29/Dec/2017 21:46:29 +0000] 8592 Audit-Plugin navigator_plugin INFO     Refreshing Audit Plugin for hdfs-NAMENODE with pipelines [NavigatorLog4jAppender,HdfsA

uditLogger]

[29/Dec/2017 21:46:29 +0000] 8592 Metadata-Plugin navigator_plugin_pipeline INFO     Stopping Navigator Plugin Pipeline '' for hdfs-HTTPFS (log dir: None)

[29/Dec/2017 21:46:29 +0000] 8592 Audit-Plugin navigator_plugin_pipeline INFO     Stopping Navigator Plugin Pipeline 'NavigatorLog4jAppender' for hdfs-NAMENODE

 (log dir: None)

[29/Dec/2017 21:46:29 +0000] 8592 Metadata-Plugin navigator_plugin INFO     Refreshing Metadata Plugin for cloudera-mgmt-SERVICEMONITOR with pipelines []

[29/Dec/2017 21:46:29 +0000] 8592 Audit-Plugin navigator_plugin_pipeline INFO     Stopping Navigator Plugin Pipeline 'HdfsAuditLogger' for hdfs-NAMENODE (log d

ir: None)

[29/Dec/2017 21:46:29 +0000] 8592 Metadata-Plugin navigator_plugin_pipeline INFO     Stopping Navigator Plugin Pipeline '' for cloudera-mgmt-SERVICEMONITOR (lo

g dir: None)

[29/Dec/2017 21:46:29 +0000] 8592 Audit-Plugin navigator_plugin INFO     Refreshing Audit Plugin for hive-WEBHCAT with pipelines []

[29/Dec/2017 21:46:29 +0000] 8592 Metadata-Plugin navigator_plugin INFO     Refreshing Metadata Plugin for hive-WEBHCAT with pipelines []

[29/Dec/2017 21:46:29 +0000] 8592 Audit-Plugin navigator_plugin_pipeline INFO     Stopping Navigator Plugin Pipeline '' for hive-WEBHCAT (log dir: None)

[29/Dec/2017 21:46:29 +0000] 8592 Metadata-Plugin navigator_plugin_pipeline INFO     Stopping Navigator Plugin Pipeline '' for hive-WEBHCAT (log dir: None)

[29/Dec/2017 21:46:29 +0000] 8592 Audit-Plugin navigator_plugin INFO     Refreshing Audit Plugin for yarn-NODEMANAGER with pipelines []

[29/Dec/2017 21:46:29 +0000] 8592 Metadata-Plugin navigator_plugin INFO     Refreshing Metadata Plugin for hue-HUE_LOAD_BALANCER with pipelines []

[29/Dec/2017 21:46:29 +0000] 8592 Audit-Plugin navigator_plugin_pipeline INFO     Stopping Navigator Plugin Pipeline '' for yarn-NODEMANAGER (log dir: None)

[29/Dec/2017 21:46:29 +0000] 8592 Metadata-Plugin navigator_plugin_pipeline INFO     Stopping Navigator Plugin Pipeline '' for hue-HUE_LOAD_BALANCER (log dir: 

None)

[29/Dec/2017 21:46:29 +0000] 8592 Audit-Plugin navigator_plugin INFO     Refreshing Audit Plugin for yarn-RESOURCEMANAGER with pipelines []

[29/Dec/2017 21:46:29 +0000] 8592 Metadata-Plugin navigator_plugin INFO     Refreshing Metadata Plugin for yarn-RESOURCEMANAGER with pipelines []

[29/Dec/2017 21:46:29 +0000] 8592 Audit-Plugin navigator_plugin_pipeline INFO     Stopping Navigator Plugin Pipeline '' for yarn-RESOURCEMANAGER (log dir: None

)

[29/Dec/2017 21:46:29 +0000] 8592 Metadata-Plugin navigator_plugin_pipeline INFO     Stopping Navigator Plugin Pipeline '' for yarn-RESOURCEMANAGER (log dir: N

one)

[29/Dec/2017 21:46:29 +0000] 8592 Audit-Plugin navigator_plugin INFO     Refreshing Audit Plugin for spark_on_yarn-SPARK_YARN_HISTORY_SERVER with pipelines []

[29/Dec/2017 21:46:29 +0000] 8592 Metadata-Plugin navigator_plugin INFO     Refreshing Metadata Plugin for spark_on_yarn-SPARK_YARN_HISTORY_SERVER with pipelin

es []

[29/Dec/2017 21:46:29 +0000] 8592 Audit-Plugin navigator_plugin_pipeline INFO     Stopping Navigator Plugin Pipeline '' for spark_on_yarn-SPARK_YARN_HISTORY_SE

RVER (log dir: None)

[29/Dec/2017 21:46:29 +0000] 8592 Metadata-Plugin navigator_plugin_pipeline INFO     Stopping Navigator Plugin Pipeline '' for spark_on_yarn-SPARK_YARN_HISTORY

_SERVER (log dir: None)

[29/Dec/2017 21:46:29 +0000] 8592 Audit-Plugin navigator_plugin INFO     Refreshing Audit Plugin for hue-HUE_SERVER with pipelines []

[29/Dec/2017 21:46:29 +0000] 8592 Metadata-Plugin navigator_plugin INFO     Refreshing Metadata Plugin for cloudera-mgmt-ACTIVITYMONITOR with pipelines []

[29/Dec/2017 21:46:29 +0000] 8592 Audit-Plugin navigator_plugin_pipeline INFO     Stopping Navigator Plugin Pipeline '' for hue-HUE_SERVER (log dir: None)

[29/Dec/2017 21:46:29 +0000] 8592 Metadata-Plugin navigator_plugin_pipeline INFO     Stopping Navigator Plugin Pipeline '' for cloudera-mgmt-ACTIVITYMONITOR (l

og dir: None)

[29/Dec/2017 21:46:29 +0000] 8592 Audit-Plugin navigator_plugin INFO     Refreshing Audit Plugin for flume-AGENT with pipelines []

[29/Dec/2017 21:46:29 +0000] 8592 Audit-Plugin navigator_plugin_pipeline INFO     Stopping Navigator Plugin Pipeline '' for flume-AGENT (log dir: None)

[29/Dec/2017 21:46:29 +0000] 8592 Audit-Plugin navigator_plugin INFO     Refreshing Audit Plugin for hive-HIVEMETASTORE with pipelines []

[29/Dec/2017 21:46:29 +0000] 8592 Audit-Plugin navigator_plugin_pipeline INFO     Stopping Navigator Plugin Pipeline '' for hive-HIVEMETASTORE (log dir: None)

[29/Dec/2017 21:46:50 +0000] 8592 MonitorDaemon-Scheduler __init__     INFO     Monitor ready to report: ('GenericMonitor HUE-HUE_LOAD_BALANCER for None',)

[29/Dec/2017 21:47:25 +0000] 8592 Monitor-GenericMonitor throttling_logger WARNING  Error collecting metrics from sample file. Result: 2

[29/Dec/2017 21:47:25 +0000] 8592 Monitor-GenericMonitor throttling_logger ERROR    Error calling is alive at 'http://0.0.0.0:8888/desktop/debug/is_alive'

Traceback (most recent call last):

  File "/usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/cmf-5.13.1-py2.7.egg/cmf/monitor/generic/hue_adapters.py", line 39, in collect_and_parse

    self._call_is_alive(self._metrics_uri)

  File "/usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/cmf-5.13.1-py2.7.egg/cmf/monitor/generic/hue_adapters.py", line 76, in _call_is_alive

    head_request_with_timeout(is_alive_url, timeout=timeout)

  File "/usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/cmf-5.13.1-py2.7.egg/cmf/url_util.py", line 106, in head_request_with_timeout

    max_cert_depth)

  File "/usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/cmf-5.13.1-py2.7.egg/cmf/url_util.py", line 74, in urlopen_with_timeout

    return opener.open(url, data, timeout)

  File "/usr/lib/python2.7/urllib2.py", line 410, in open

    response = meth(req, response)

  File "/usr/lib/python2.7/urllib2.py", line 523, in http_response

    'http', request, response, code, msg, hdrs)

  File "/usr/lib/python2.7/urllib2.py", line 448, in error

    return self._call_chain(*args)

  File "/usr/lib/python2.7/urllib2.py", line 382, in _call_chain

    result = func(*args)

  File "/usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/cmf-5.13.1-py2.7.egg/cmf/https.py", line 221, in http_error_default

    raise e

HTTPError: HTTP Error 500: Internal Server Error

[29/Dec/2017 21:47:29 +0000] 8592 MonitorDaemon-Scheduler __init__     INFO     Monitor expired: ('GenericMonitor HUE-HUE_SERVER for hue-HUE_SERVER-97a6005891c

5ca7a61310d126b30a758',)

root@ns553739:~# tail -f /var/log/cloudera-scm-agent/cloudera-scm-agent.log

  File "/usr/lib/python2.7/urllib2.py", line 523, in http_response

    'http', request, response, code, msg, hdrs)

  File "/usr/lib/python2.7/urllib2.py", line 448, in error

    return self._call_chain(*args)

  File "/usr/lib/python2.7/urllib2.py", line 382, in _call_chain

    result = func(*args)

  File "/usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/cmf-5.13.1-py2.7.egg/cmf/https.py", line 221, in http_error_default

    raise e

HTTPError: HTTP Error 500: Internal Server Error

[29/Dec/2017 21:47:29 +0000] 8592 MonitorDaemon-Scheduler __init__     INFO     Monitor expired: ('GenericMonitor HUE-HUE_SERVER for hue-HUE_SERVER-97a6005891c5ca7a61310d126b30a758',)

[29/Dec/2017 21:49:04 +0000] 8592 MainThread process      INFO     [75-hue-HUE_LOAD_BALANCER] Updating process: False {u'running': (True, False), u'run_generation': (1, 2)}

[29/Dec/2017 21:49:04 +0000] 8592 MainThread process      INFO     Deactivating process 75-hue-HUE_LOAD_BALANCER

[29/Dec/2017 21:49:04 +0000] 8592 Metadata-Plugin navigator_plugin INFO     stopping Metadata Plugin for hue-HUE_LOAD_BALANCER with pipelines []

[29/Dec/2017 21:49:04 +0000] 8592 Metadata-Plugin navigator_plugin_pipeline INFO     Stopping Navigator Plugin Pipeline '' for hue-HUE_LOAD_BALANCER (log dir: None)

[29/Dec/2017 21:49:04 +0000] 8592 Audit-Plugin navigator_plugin INFO     stopping Audit Plugin for hue-HUE_LOAD_BALANCER with pipelines []

[29/Dec/2017 21:49:04 +0000] 8592 Audit-Plugin navigator_plugin_pipeline INFO     Stopping Navigator Plugin Pipeline '' for hue-HUE_LOAD_BALANCER (log dir: None)

[29/Dec/2017 21:49:05 +0000] 8592 MainThread agent        INFO     Triggering supervisord update.

[29/Dec/2017 21:49:05 +0000] 8592 MainThread process      INFO     [76-hue-HUE_SERVER] Updating process: False {u'running': (True, False), u'run_generation': (1, 2)}

[29/Dec/2017 21:49:05 +0000] 8592 MainThread process      INFO     Deactivating process 76-hue-HUE_SERVER

[29/Dec/2017 21:49:06 +0000] 8592 MainThread agent        INFO     Triggering supervisord update.

[29/Dec/2017 21:49:09 +0000] 8592 Metadata-Plugin navigator_plugin INFO     stopping Metadata Plugin for hue-HUE_SERVER with pipelines []

[29/Dec/2017 21:49:09 +0000] 8592 Metadata-Plugin navigator_plugin_pipeline INFO     Stopping Navigator Plugin Pipeline '' for hue-HUE_SERVER (log dir: None)

[29/Dec/2017 21:49:09 +0000] 8592 Audit-Plugin navigator_plugin INFO     stopping Audit Plugin for hue-HUE_SERVER with pipelines []

[29/Dec/2017 21:49:09 +0000] 8592 Audit-Plugin navigator_plugin_pipeline INFO     Stopping Navigator Plugin Pipeline '' for hue-HUE_SERVER (log dir: None)

[29/Dec/2017 21:49:21 +0000] 8592 MainThread process      INFO     [75-hue-HUE_LOAD_BALANCER] Updating process.

[29/Dec/2017 21:49:21 +0000] 8592 MainThread process      INFO     Deleting process 75-hue-HUE_LOAD_BALANCER

[29/Dec/2017 21:49:21 +0000] 8592 MainThread agent        INFO     Triggering supervisord update.

[29/Dec/2017 21:49:21 +0000] 8592 MainThread process      INFO     [76-hue-HUE_SERVER] Updating process.

[29/Dec/2017 21:49:21 +0000] 8592 MainThread process      INFO     Deleting process 76-hue-HUE_SERVER

[29/Dec/2017 21:49:21 +0000] 8592 MainThread agent        INFO     Triggering supervisord update.

[29/Dec/2017 21:49:21 +0000] 8592 MainThread agent        INFO     [75-hue-HUE_LOAD_BALANCER] Orphaning process

[29/Dec/2017 21:49:21 +0000] 8592 MainThread agent        INFO     [76-hue-HUE_SERVER] Orphaning process

[29/Dec/2017 21:49:21 +0000] 8592 MainThread util         INFO     Using generic audit plugin for process hue-HUE_LOAD_BALANCER

[29/Dec/2017 21:49:21 +0000] 8592 MainThread util         INFO     Creating metadata plugin for process hue-HUE_LOAD_BALANCER

[29/Dec/2017 21:49:21 +0000] 8592 MainThread util         INFO     Using specific metadata plugin for process hue-HUE_LOAD_BALANCER

[29/Dec/2017 21:49:21 +0000] 8592 MainThread util         INFO     Using generic metadata plugin for process hue-HUE_LOAD_BALANCER

[29/Dec/2017 21:49:21 +0000] 8592 MainThread agent        INFO     [77-hue-HUE_LOAD_BALANCER] Instantiating process

[29/Dec/2017 21:49:21 +0000] 8592 MainThread process      INFO     [77-hue-HUE_LOAD_BALANCER] Updating process: True {}

[29/Dec/2017 21:49:21 +0000] 8592 MainThread process      INFO     First time to activate the process [77-hue-HUE_LOAD_BALANCER].

[29/Dec/2017 21:49:21 +0000] 8592 MainThread agent        INFO     Created /run/cloudera-scm-agent/process/77-hue-HUE_LOAD_BALANCER

[29/Dec/2017 21:49:21 +0000] 8592 MainThread agent        INFO     Chowning /run/cloudera-scm-agent/process/77-hue-HUE_LOAD_BALANCER to hue (123) hue (132)

[29/Dec/2017 21:49:21 +0000] 8592 MainThread agent        INFO     Chmod'ing /run/cloudera-scm-agent/process/77-hue-HUE_LOAD_BALANCER to 0751

[29/Dec/2017 21:49:21 +0000] 8592 MainThread agent        INFO     Created /run/cloudera-scm-agent/process/77-hue-HUE_LOAD_BALANCER/logs

[29/Dec/2017 21:49:21 +0000] 8592 MainThread agent        INFO     Chowning /run/cloudera-scm-agent/process/77-hue-HUE_LOAD_BALANCER/logs to hue (123) hue (132)

[29/Dec/2017 21:49:21 +0000] 8592 MainThread agent        INFO     Chmod'ing /run/cloudera-scm-agent/process/77-hue-HUE_LOAD_BALANCER/logs to 0751

[29/Dec/2017 21:49:21 +0000] 8592 MainThread process      INFO     [77-hue-HUE_LOAD_BALANCER] Refreshing process files: None

[29/Dec/2017 21:49:21 +0000] 8592 MainThread parcel       INFO     prepare_environment begin: {}, [u'cdh'], [u'cdh-plugin', u'hue-plugin']

[29/Dec/2017 21:49:21 +0000] 8592 MainThread parcel       INFO     No parcels activated for use

[29/Dec/2017 21:49:21 +0000] 8592 MainThread __init__     INFO     Extracted 6 files and 0 dirs to /run/cloudera-scm-agent/process/77-hue-HUE_LOAD_BALANCER.

[29/Dec/2017 21:49:21 +0000] 8592 MainThread process      INFO     [77-hue-HUE_LOAD_BALANCER] Evaluating resource: {u'io': None, u'named_cpu': None, u'tcp_listen': None, u'dynamic': False, u'rlimits': None, u'install': None, u'file': None, u'memory': None, u'directory': {u'path': u'/var/log/hue-httpd', u'bytes_free_warning_threshhold_bytes': 0, u'group': u'hue', u'user': u'hue', u'mode': 493}, u'cpu': None, u'contents': None}

[29/Dec/2017 21:49:21 +0000] 8592 MainThread process      INFO     reading limits: {u'limit_memlock': None, u'limit_fds': None}

[29/Dec/2017 21:49:21 +0000] 8592 MainThread process      INFO     [77-hue-HUE_LOAD_BALANCER] Launching process. one-off False, command hue/httpd.sh, args []

[29/Dec/2017 21:49:21 +0000] 8592 MainThread agent        INFO     Triggering supervisord update.

[29/Dec/2017 21:49:21 +0000] 8592 MainThread process      INFO     Begin audit plugin refresh

[29/Dec/2017 21:49:21 +0000] 8592 MainThread navigator_plugin INFO     Scheduling a refresh for Audit Plugin for hue-HUE_LOAD_BALANCER with pipelines []

[29/Dec/2017 21:49:21 +0000] 8592 MainThread process      INFO     Begin metadata plugin refresh

[29/Dec/2017 21:49:21 +0000] 8592 MainThread navigator_plugin INFO     Scheduling a refresh for Metadata Plugin for hue-HUE_LOAD_BALANCER with pipelines []

[29/Dec/2017 21:49:21 +0000] 8592 MainThread __init__     INFO     Instantiating generic monitor for service HUE and role HUE_LOAD_BALANCER

[29/Dec/2017 21:49:21 +0000] 8592 MainThread process      INFO     Begin monitor refresh.

[29/Dec/2017 21:49:21 +0000] 8592 MainThread abstract_monitor INFO     Refreshing GenericMonitor HUE-HUE_LOAD_BALANCER for None

[29/Dec/2017 21:49:21 +0000] 8592 MainThread __init__     INFO     New monitor: (<cmf.monitor.generic.GenericMonitor object at 0x7f78ec3baf10>,)

[29/Dec/2017 21:49:21 +0000] 8592 MainThread process      INFO     Daemon refresh complete for process 77-hue-HUE_LOAD_BALANCER.

[29/Dec/2017 21:49:21 +0000] 8592 MainThread util         INFO     Using generic audit plugin for process hue-HUE_SERVER

[29/Dec/2017 21:49:21 +0000] 8592 MainThread util         INFO     Creating metadata plugin for process hue-HUE_SERVER

[29/Dec/2017 21:49:21 +0000] 8592 MainThread util         INFO     Using specific metadata plugin for process hue-HUE_SERVER

[29/Dec/2017 21:49:21 +0000] 8592 MainThread util         INFO     Using generic metadata plugin for process hue-HUE_SERVER

[29/Dec/2017 21:49:21 +0000] 8592 MainThread agent        INFO     [78-hue-HUE_SERVER] Instantiating process

[29/Dec/2017 21:49:21 +0000] 8592 MainThread process      INFO     [78-hue-HUE_SERVER] Updating process: True {}

[29/Dec/2017 21:49:21 +0000] 8592 MainThread process      INFO     First time to activate the process [78-hue-HUE_SERVER].

[29/Dec/2017 21:49:21 +0000] 8592 MainThread agent        INFO     Created /run/cloudera-scm-agent/process/78-hue-HUE_SERVER

[29/Dec/2017 21:49:21 +0000] 8592 MainThread agent        INFO     Chowning /run/cloudera-scm-agent/process/78-hue-HUE_SERVER to hue (123) hue (132)

[29/Dec/2017 21:49:21 +0000] 8592 MainThread agent        INFO     Chmod'ing /run/cloudera-scm-agent/process/78-hue-HUE_SERVER to 0751

[29/Dec/2017 21:49:21 +0000] 8592 MainThread agent        INFO     Created /run/cloudera-scm-agent/process/78-hue-HUE_SERVER/logs

[29/Dec/2017 21:49:21 +0000] 8592 MainThread agent        INFO     Chowning /run/cloudera-scm-agent/process/78-hue-HUE_SERVER/logs to hue (123) hue (132)

[29/Dec/2017 21:49:21 +0000] 8592 MainThread agent        INFO     Chmod'ing /run/cloudera-scm-agent/process/78-hue-HUE_SERVER/logs to 0751

[29/Dec/2017 21:49:21 +0000] 8592 MainThread process      INFO     [78-hue-HUE_SERVER] Refreshing process files: None

[29/Dec/2017 21:49:21 +0000] 8592 MainThread parcel       INFO     prepare_environment begin: {}, [u'cdh'], [u'cdh-plugin', u'hue-plugin']

[29/Dec/2017 21:49:21 +0000] 8592 MainThread parcel       INFO     No parcels activated for use

[29/Dec/2017 21:49:21 +0000] 8592 MainThread __init__     INFO     Extracted 36 files and 0 dirs to /run/cloudera-scm-agent/process/78-hue-HUE_SERVER.

[29/Dec/2017 21:49:21 +0000] 8592 MainThread process      INFO     [78-hue-HUE_SERVER] Evaluating resource: {u'io': None, u'named_cpu': None, u'tcp_listen': None, u'dynamic': False, u'rlimits': None, u'install': None, u'file': None, u'memory': None, u'directory': {u'path': u'/var/log/hue', u'bytes_free_warning_threshhold_bytes': 0, u'group': u'hue', u'user': u'hue', u'mode': 493}, u'cpu': None, u'contents': None}

[29/Dec/2017 21:49:21 +0000] 8592 MainThread process      INFO     reading limits: {u'limit_memlock': None, u'limit_fds': None}

[29/Dec/2017 21:49:21 +0000] 8592 MainThread process      INFO     [78-hue-HUE_SERVER] Launching process. one-off False, command hue/hue.sh, args [u'runcpserver']

[29/Dec/2017 21:49:21 +0000] 8592 MainThread agent        INFO     Triggering supervisord update.

[29/Dec/2017 21:49:22 +0000] 8592 MainThread process      INFO     Begin audit plugin refresh

[29/Dec/2017 21:49:22 +0000] 8592 MainThread navigator_plugin INFO     Scheduling a refresh for Audit Plugin for hue-HUE_SERVER with pipelines []

[29/Dec/2017 21:49:22 +0000] 8592 MainThread process      INFO     Begin metadata plugin refresh

[29/Dec/2017 21:49:22 +0000] 8592 MainThread navigator_plugin INFO     Scheduling a refresh for Metadata Plugin for hue-HUE_SERVER with pipelines []

[29/Dec/2017 21:49:22 +0000] 8592 MainThread __init__     INFO     Instantiating generic monitor for service HUE and role HUE_SERVER

[29/Dec/2017 21:49:22 +0000] 8592 MainThread process      INFO     Begin monitor refresh.

[29/Dec/2017 21:49:22 +0000] 8592 MainThread abstract_monitor INFO     Refreshing GenericMonitor HUE-HUE_SERVER for None

[29/Dec/2017 21:49:22 +0000] 8592 MainThread __init__     INFO     New monitor: (<cmf.monitor.generic.GenericMonitor object at 0x7f78ea06fe90>,)

[29/Dec/2017 21:49:22 +0000] 8592 MainThread process      INFO     Daemon refresh complete for process 78-hue-HUE_SERVER.

[29/Dec/2017 21:49:24 +0000] 8592 Metadata-Plugin navigator_plugin INFO     Refreshing Metadata Plugin for hue-HUE_SERVER with pipelines []

[29/Dec/2017 21:49:24 +0000] 8592 Metadata-Plugin navigator_plugin_pipeline INFO     Stopping Navigator Plugin Pipeline '' for hue-HUE_SERVER (log dir: None)

[29/Dec/2017 21:49:24 +0000] 8592 Metadata-Plugin navigator_plugin INFO     Refreshing Metadata Plugin for hue-HUE_LOAD_BALANCER with pipelines []

[29/Dec/2017 21:49:24 +0000] 8592 Metadata-Plugin navigator_plugin_pipeline INFO     Stopping Navigator Plugin Pipeline '' for hue-HUE_LOAD_BALANCER (log dir: None)

[29/Dec/2017 21:49:24 +0000] 8592 Audit-Plugin navigator_plugin INFO     Refreshing Audit Plugin for hue-HUE_SERVER with pipelines []

[29/Dec/2017 21:49:24 +0000] 8592 Audit-Plugin navigator_plugin_pipeline INFO     Stopping Navigator Plugin Pipeline '' for hue-HUE_SERVER (log dir: None)

[29/Dec/2017 21:49:24 +0000] 8592 Audit-Plugin navigator_plugin INFO     Refreshing Audit Plugin for hue-HUE_LOAD_BALANCER with pipelines []

[29/Dec/2017 21:49:24 +0000] 8592 Audit-Plugin navigator_plugin_pipeline INFO     Stopping Navigator Plugin Pipeline '' for hue-HUE_LOAD_BALANCER (log dir: None)

[29/Dec/2017 21:49:44 +0000] 8592 MonitorDaemon-Scheduler __init__     INFO     Monitor ready to report: ('GenericMonitor HUE-HUE_LOAD_BALANCER for hue-HUE_LOAD_BALANCER-97a6005891c5ca7a61310d126b30a758',)

[29/Dec/2017 21:50:22 +0000] 8592 MonitorDaemon-Scheduler __init__     INFO     Monitor expired: ('GenericMonitor HUE-HUE_SERVER for hue-HUE_SERVER-97a6005891c5ca7a61310d126b30a758',)

 

7,101 Views
0 Kudos

avatar
author-rank bgooley author-rank
Master Guru

Created ‎12-29-2017 09:47 AM

@DataYogi,  The error discussed on this thread is:

 HTTPError: HTTP Error 400: BAD REQUEST

 

The error your agent is showing is different:

 HTTPError: HTTP Error 500: Internal Server Error

 

This is a different problem... we should probably move to another thread.

In short, your Hue Server is not functional since it cannot communicate with its Postgres backend database:

OperationalError: FATAL:  no pg_hba.conf entry for host "2402:1f00:8001:281::", user "hue", database "hue", SSL off

 

This is a response from your Postgres server saying that it is denying your host / user combination access to the server.

You may need to either configure IPv4 addresses if you did not intend on using IPv6 or configure your server's pg_hba.conf file to allow the IPv6 address.  Information regarding this database configuration should be on Postgres sites or other places on the web.  We do have some documentation from Cloudera, too:

https://www.cloudera.com/documentation/enterprise/latest/topics/cm_ig_extrnl_pstgrs.html

 

If you are using the "embedded" postgres database, instead, you can either enable IPv4 in the cluster hosts or add IPv6 lines in the config file located in "/var/lib/cloudera-scm-server-db/data/pg_hba.conf".

7,085 Views
0 Kudos

avatar
author-rank DataYogi
Explorer

Created on ‎12-29-2017 04:30 PM - edited ‎12-30-2017 01:40 AM

@bgooleyThank you for the reply. But i need some more help. Would be really grateful. Below is the ipconfig of my server. 

 

eth0      Link encap:Ethernet  HWaddr 0c:c4:7a:84:1c:5a  

          inet addr:139.99.122.129  Bcast:139.99.122.255  Mask:255.255.255.0

          inet6 addr: fe80::ec4:7aff:fe84:1c5a/64 Scope:Link

          inet6 addr: 2402:1f00:8001:281::/64 Scope:Global

          UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1

          RX packets:239355 errors:0 dropped:0 overruns:0 frame:0

          TX packets:38706 errors:0 dropped:0 overruns:0 carrier:0

          collisions:0 txqueuelen:1000 

          RX bytes:333258201 (333.2 MB)  TX bytes:7247319 (7.2 MB)

          Memory:df180000-df1fffff 

 

 

Below is the snapshot from the config file as suggested by you. The line in the bold is what i added.

 

# TYPE  DATABASE        USER            ADDRESS                 METHOD

 

# "local" is for Unix domain socket connections only

local   all             all                                     md5

# IPv4 local connections:

host    all             all             127.0.0.1/32            md5

# IPv6 local connections:

host    all             all             ::1/128                 md5

host    hue             hue             2402:1f00:8001:281::     md5

# Allow replication connections from localhost, by a user with the

# replication privilege.

#local   replication     cloudera-scm                                md5

#host    replication     cloudera-scm        127.0.0.1/32            md5

#host    replication     cloudera-scm        ::1/128                 md5

# Accept connections from all hosts

host    amon   amon   0.0.0.0/0   md5

host    rman   rman   0.0.0.0/0   md5

host    nav   nav   0.0.0.0/0   md5

host    navms   navms   0.0.0.0/0   md5

# block remote access for admin user and scm

host all cloudera-scm,scm 0.0.0.0/0 reject

# enable remote access for other users

host sameuser all 0.0.0.0/0 md5

                                                               

In the hue config, i have enabled the Bind Hue Server to Wildcard Address. 

 

In the cloudera manager, i get the following error for my Hue service 

 

Bad : The Cloudera Manager Agent is not able to communicate with this role's web server.
 

I am still getting the following error when i go to my ip http://139.99.122.129:8888

 

OperationalError: FATAL:  no pg_hba.conf entry for host "2402:1f00:8001:281::", user "hue", database "hue", SSL off

 

7,078 Views
0 Kudos

avatar
author-rank DataYogi
Explorer

Created on ‎12-29-2017 04:39 PM - edited ‎12-30-2017 01:39 AM

@bgooleyHow do we do this ? you can either enable IPv4 in the cluster hosts ??

7,076 Views
0 Kudos

avatar
author-rank bgooley author-rank
Master Guru

Created ‎01-03-2018 10:53 AM

@DataYogi,

 

IPv4 is a function of your OS networking, so that is a matter for your host and network configuration.  My point is that if you are unfamiliar with how database servers and other servers interact over IPv6, perhaps it would be best to only use IPv4 for now.

 

See the following postgres information regarding addresses (including IPv6)

https://www.postgresql.org/docs/9.3/static/auth-pg-hba-conf.html

 

It appears you were missing the /64 subnet portion of the IP as your interface shows:

inet6 addr: 2402:1f00:8001:281::/64 Scope:Global

 

I believe either of the following in the pg_hba.conf file would allow access from that one host:

host    hue             hue             2402:1f00:8001:281::/64     md5

or

host    hue             hue             2402:1f00:8001:281::/128     md5

 

Unless you need to restrict access, you can add lines to allow access from any host that is IPv6 with the following:

host   hue              hue            ::0/0           md5

 

 

NOTE:  Make sure you ensure there are no servers connecting to the embedded postgres database and restart from the command line with "service cloudera-scm-server-db restart" after making any changes to ensure they took effect.

 

 

7,047 Views
0 Kudos

avatar
author-rank SRG
New Contributor

Created ‎02-08-2017 10:50 AM

 

Hello,

 

I am getting the error message below -  please let me know your ideas on how to solve.  Using Quickstart 5.8 on Virtual Box.  Thanks!  SRG

 

 

hadoop.hdfs_clusters.default.webhdfs_url

Current value:

 

http://quickstart.cloudera:50070/webhdfs/v1


Failed to create temporary file

 

"/tmp/hue_config_validation.1233575168814310044"

 

 

8,473 Views
0 Kudos
Announcements
What's New @ Cloudera
Cloudera Data Engineering 1.23: Access Spark from Your Favor...
What's New @ Cloudera
HBase REST server scaling support is Generally Available
What's New @ Cloudera
New CLI option in the update-database command
What's New @ Cloudera
New Action menu item in the Cloudera Operational Database UI
What's New @ Cloudera
Get the list of supported instance types in the Cloudera Ope...
View More Announcements