Reply
Highlighted
Explorer
Posts: 9
Registered: ‎03-27-2015

Cloudera SCM Web UI not responding

I am trying to add a Custom service through Cloudera Manager. My Cluster is Kerberised.  

when I put the CSD jar in /opt/cloudera/csd/ directory and restarted the cloudera scm server and agent, it started succefully but when i tried to hit the  Web UI on 7180 port It didnt reponded even after a long time. Please help me to find out the reason and the solution. Thanks in advance.

 

Following are the logs

 

cloudera-scm-agent.log

[05/Jun/2015 13:20:48 +0000] 30151 MainThread agent        INFO     Refreshing files for process 254-hdfs-NAMENODE: [u'cloudera-stack-monitor.properties', u'dfs_hosts_allow.txt', u'dfs_hosts_exclude.txt', u'topology.map', u'n
avigator.client.properties']
[05/Jun/2015 13:20:48 +0000] 30151 MainThread parcel       INFO     prepare_environment begin: {u'btef': u'2.1', u'bt': u'2.1', u'CDH': u'5.3.3-1.cdh5.3.3.p0.5'}, [u'cdh'], [u'cdh-plugin', u'hdfs-plugin']
[05/Jun/2015 13:20:48 +0000] 30151 MainThread parcel       INFO     The following requested parcels are not available: {}
[05/Jun/2015 13:20:48 +0000] 30151 MainThread parcel       INFO     Obtained tags ['btef'] for parcel btef
[05/Jun/2015 13:20:48 +0000] 30151 MainThread parcel       INFO     Obtained tags ['bt'] for parcel bt
[05/Jun/2015 13:20:48 +0000] 30151 MainThread parcel       INFO     Obtained tags ['cdh', 'impala', 'sentry', 'solr', 'spark'] for parcel CDH
[05/Jun/2015 13:20:48 +0000] 30151 MainThread parcel       INFO     prepare_environment end: {'CDH': '5.3.3-1.cdh5.3.3.p0.5'}
[05/Jun/2015 13:20:48 +0000] 30151 MainThread util         INFO     Extracted 5 files and 0 dirs to /var/run/cloudera-scm-agent/process/254-hdfs-NAMENODE.
[05/Jun/2015 13:20:48 +0000] 30151 MainThread throttling_logger INFO     Added principal HTTP/ip-10-46-22-29.us-west-2.compute.internal with keytab /var/run/cloudera-scm-agent/process/254-hdfs-NAMENODE/hdfs.keytab as a candid
ate to kinit
[05/Jun/2015 13:20:48 +0000] 30151 MainThread abstract_monitor INFO     Refreshing NameNodeMonitor for None
[05/Jun/2015 13:20:48 +0000] 30151 MainThread __init__     INFO     New monitor: (<cmf.monitor.namenode.NameNodeMonitor object at 0x3143a10>,)
[05/Jun/2015 13:20:48 +0000] 30151 MonitorDaemon-Scheduler __init__     INFO     Monitor ready to report: ('ZooKeeperServerMonitor for None',)
[05/Jun/2015 13:20:48 +0000] 30151 MainThread agent        INFO     Process with same id has changed: 255-hdfs-SECONDARYNAMENODE.
[05/Jun/2015 13:20:48 +0000] 30151 MainThread agent        INFO     Refreshing files for process 255-hdfs-SECONDARYNAMENODE: [u'cloudera-stack-monitor.properties']
[05/Jun/2015 13:20:48 +0000] 30151 MainThread parcel       INFO     prepare_environment begin: {u'btef': u'2.1', u'bt': u'2.1', u'CDH': u'5.3.3-1.cdh5.3.3.p0.5'}, [u'cdh'], [u'cdh-plugin', u'hdfs-plugin']
[05/Jun/2015 13:20:48 +0000] 30151 MainThread parcel       INFO     The following requested parcels are not available: {}
[05/Jun/2015 13:20:48 +0000] 30151 MainThread parcel       INFO     Obtained tags ['btef'] for parcel btef
[05/Jun/2015 13:20:48 +0000] 30151 MainThread parcel       INFO     Obtained tags ['bt'] for parcel bt
[05/Jun/2015 13:20:48 +0000] 30151 MainThread parcel       INFO     Obtained tags ['cdh', 'impala', 'sentry', 'solr', 'spark'] for parcel CDH
[05/Jun/2015 13:20:48 +0000] 30151 MainThread parcel       INFO     prepare_environment end: {'CDH': '5.3.3-1.cdh5.3.3.p0.5'}
[05/Jun/2015 13:20:48 +0000] 30151 MainThread util         INFO     Extracted 1 files and 0 dirs to /var/run/cloudera-scm-agent/process/255-hdfs-SECONDARYNAMENODE.
[05/Jun/2015 13:20:48 +0000] 30151 MainThread throttling_logger INFO     Added principal HTTP/ip-10-46-22-29.us-west-2.compute.internal with keytab /var/run/cloudera-scm-agent/process/255-hdfs-SECONDARYNAMENODE/hdfs.keytab as
 a candidate to kinit
[05/Jun/2015 13:20:48 +0000] 30151 MainThread abstract_monitor INFO     Refreshing SecondaryNameNodeMonitor for None
[05/Jun/2015 13:20:48 +0000] 30151 MainThread __init__     INFO     New monitor: (<cmf.monitor.secondarynamenode.SecondaryNameNodeMonitor object at 0x3740fd0>,)
[05/Jun/2015 13:20:49 +0000] 30151 MonitorDaemon-Scheduler __init__     INFO     Monitor ready to report: ('NameNodeMonitor for None',)
[05/Jun/2015 13:20:49 +0000] 30151 MainThread parcel       INFO     Loading parcel manifest for: bt-2.1
[05/Jun/2015 13:20:49 +0000] 30151 MainThread parcel       INFO     Loading parcel manifest for: btef-2.1
[05/Jun/2015 13:20:49 +0000] 30151 MainThread parcel       INFO     Loading parcel manifest for: CDH-5.3.3-1.cdh5.3.3.p0.5
[05/Jun/2015 13:20:49 +0000] 30151 MainThread parcel       INFO     Loading parcel manifest for: bt-2.1
[05/Jun/2015 13:20:49 +0000] 30151 MainThread parcel       INFO     Loading parcel manifest for: btef-2.1
[05/Jun/2015 13:20:49 +0000] 30151 MainThread parcel       INFO     Loading parcel manifest for: CDH-5.3.3-1.cdh5.3.3.p0.5
[05/Jun/2015 13:20:49 +0000] 30151 MainThread parcel       INFO     Loading parcel manifest for: bt-2.1
[05/Jun/2015 13:20:49 +0000] 30151 MainThread parcel       INFO     Loading parcel manifest for: btef-2.1
[05/Jun/2015 13:20:49 +0000] 30151 MainThread parcel       INFO     Loading parcel manifest for: CDH-5.3.3-1.cdh5.3.3.p0.5
[05/Jun/2015 13:20:49 +0000] 30151 MonitorDaemon-Scheduler __init__     INFO     Monitor ready to report: ('SecondaryNameNodeMonitor for None',)
[05/Jun/2015 13:20:52 +0000] 30151 Audit-Plugin audit_plugin INFO     Refreshing Audit Plugin with pipelines
[05/Jun/2015 13:20:52 +0000] 30151 Audit-Plugin audit_plugin_pipeline INFO     stopping  (None)
[05/Jun/2015 13:20:52 +0000] 30151 Audit-Plugin audit_plugin INFO     Refreshing Audit Plugin with pipelines NavigatorLog4jAppender,HdfsAuditLogger
[05/Jun/2015 13:20:52 +0000] 30151 Audit-Plugin audit_plugin_pipeline INFO     stopping NavigatorLog4jAppender (None)
[05/Jun/2015 13:20:52 +0000] 30151 Audit-Plugin audit_plugin_pipeline INFO     stopping HdfsAuditLogger (None)
[05/Jun/2015 13:20:52 +0000] 30151 Audit-Plugin audit_plugin INFO     Refreshing Audit Plugin with pipelines
[05/Jun/2015 13:20:52 +0000] 30151 Audit-Plugin audit_plugin_pipeline INFO     stopping  (None)
[05/Jun/2015 13:21:18 +0000] 30151 Monitor-HostMonitor throttling_logger INFO     Using java location: '/usr/java/jdk1.7.0_67-cloudera/bin/java'.
[05/Jun/2015 13:21:21 +0000] 30151 MonitorDaemon-Scheduler __init__     INFO     Monitor ready to report: ('ServiceMonitorMonitor for mgmt-SERVICEMONITOR-3d68879c8c0e4b24116ddc7465a61684',)

 and   cloudera-scm-agent.out

 

++ export CDH_MR1_HOME=/opt/cloudera/parcels/CDH-5.3.3-1.cdh5.3.3.p0.5/lib/hadoop-0.20-mapreduce
++ CDH_MR1_HOME=/opt/cloudera/parcels/CDH-5.3.3-1.cdh5.3.3.p0.5/lib/hadoop-0.20-mapreduce
++ export CDH_HDFS_HOME=/opt/cloudera/parcels/CDH-5.3.3-1.cdh5.3.3.p0.5/lib/hadoop-hdfs
++ CDH_HDFS_HOME=/opt/cloudera/parcels/CDH-5.3.3-1.cdh5.3.3.p0.5/lib/hadoop-hdfs
++ export CDH_HTTPFS_HOME=/opt/cloudera/parcels/CDH-5.3.3-1.cdh5.3.3.p0.5/lib/hadoop-httpfs
++ CDH_HTTPFS_HOME=/opt/cloudera/parcels/CDH-5.3.3-1.cdh5.3.3.p0.5/lib/hadoop-httpfs
++ export CDH_MR2_HOME=/opt/cloudera/parcels/CDH-5.3.3-1.cdh5.3.3.p0.5/lib/hadoop-mapreduce
++ CDH_MR2_HOME=/opt/cloudera/parcels/CDH-5.3.3-1.cdh5.3.3.p0.5/lib/hadoop-mapreduce
++ export CDH_YARN_HOME=/opt/cloudera/parcels/CDH-5.3.3-1.cdh5.3.3.p0.5/lib/hadoop-yarn
++ CDH_YARN_HOME=/opt/cloudera/parcels/CDH-5.3.3-1.cdh5.3.3.p0.5/lib/hadoop-yarn
++ export CDH_HBASE_HOME=/opt/cloudera/parcels/CDH-5.3.3-1.cdh5.3.3.p0.5/lib/hbase
++ CDH_HBASE_HOME=/opt/cloudera/parcels/CDH-5.3.3-1.cdh5.3.3.p0.5/lib/hbase
++ export CDH_ZOOKEEPER_HOME=/opt/cloudera/parcels/CDH-5.3.3-1.cdh5.3.3.p0.5/lib/zookeeper
++ CDH_ZOOKEEPER_HOME=/opt/cloudera/parcels/CDH-5.3.3-1.cdh5.3.3.p0.5/lib/zookeeper
++ export CDH_HIVE_HOME=/opt/cloudera/parcels/CDH-5.3.3-1.cdh5.3.3.p0.5/lib/hive
++ CDH_HIVE_HOME=/opt/cloudera/parcels/CDH-5.3.3-1.cdh5.3.3.p0.5/lib/hive
++ export CDH_HUE_HOME=/opt/cloudera/parcels/CDH-5.3.3-1.cdh5.3.3.p0.5/lib/hue
++ CDH_HUE_HOME=/opt/cloudera/parcels/CDH-5.3.3-1.cdh5.3.3.p0.5/lib/hue
++ export CDH_OOZIE_HOME=/opt/cloudera/parcels/CDH-5.3.3-1.cdh5.3.3.p0.5/lib/oozie
++ CDH_OOZIE_HOME=/opt/cloudera/parcels/CDH-5.3.3-1.cdh5.3.3.p0.5/lib/oozie
++ export CDH_HUE_PLUGINS_HOME=/opt/cloudera/parcels/CDH-5.3.3-1.cdh5.3.3.p0.5/lib/hadoop
++ CDH_HUE_PLUGINS_HOME=/opt/cloudera/parcels/CDH-5.3.3-1.cdh5.3.3.p0.5/lib/hadoop
++ export CDH_FLUME_HOME=/opt/cloudera/parcels/CDH-5.3.3-1.cdh5.3.3.p0.5/lib/flume-ng
++ CDH_FLUME_HOME=/opt/cloudera/parcels/CDH-5.3.3-1.cdh5.3.3.p0.5/lib/flume-ng
++ export CDH_PIG_HOME=/opt/cloudera/parcels/CDH-5.3.3-1.cdh5.3.3.p0.5/lib/pig
++ CDH_PIG_HOME=/opt/cloudera/parcels/CDH-5.3.3-1.cdh5.3.3.p0.5/lib/pig
++ export CDH_HCAT_HOME=/opt/cloudera/parcels/CDH-5.3.3-1.cdh5.3.3.p0.5/lib/hive-hcatalog
++ CDH_HCAT_HOME=/opt/cloudera/parcels/CDH-5.3.3-1.cdh5.3.3.p0.5/lib/hive-hcatalog
++ export CDH_SQOOP2_HOME=/opt/cloudera/parcels/CDH-5.3.3-1.cdh5.3.3.p0.5/lib/sqoop2
++ CDH_SQOOP2_HOME=/opt/cloudera/parcels/CDH-5.3.3-1.cdh5.3.3.p0.5/lib/sqoop2
++ export CDH_LLAMA_HOME=/opt/cloudera/parcels/CDH-5.3.3-1.cdh5.3.3.p0.5/lib/llama
++ CDH_LLAMA_HOME=/opt/cloudera/parcels/CDH-5.3.3-1.cdh5.3.3.p0.5/lib/llama
++ export CDH_SENTRY_HOME=/opt/cloudera/parcels/CDH-5.3.3-1.cdh5.3.3.p0.5/lib/sentry
++ CDH_SENTRY_HOME=/opt/cloudera/parcels/CDH-5.3.3-1.cdh5.3.3.p0.5/lib/sentry
++ export TOMCAT_HOME=/opt/cloudera/parcels/CDH-5.3.3-1.cdh5.3.3.p0.5/lib/bigtop-tomcat
++ TOMCAT_HOME=/opt/cloudera/parcels/CDH-5.3.3-1.cdh5.3.3.p0.5/lib/bigtop-tomcat
++ export JSVC_HOME=/opt/cloudera/parcels/CDH-5.3.3-1.cdh5.3.3.p0.5/lib/bigtop-utils
++ JSVC_HOME=/opt/cloudera/parcels/CDH-5.3.3-1.cdh5.3.3.p0.5/lib/bigtop-utils
++ export CDH_HADOOP_BIN=/opt/cloudera/parcels/CDH-5.3.3-1.cdh5.3.3.p0.5/lib/hadoop/bin/hadoop
++ CDH_HADOOP_BIN=/opt/cloudera/parcels/CDH-5.3.3-1.cdh5.3.3.p0.5/lib/hadoop/bin/hadoop
++ export CDH_IMPALA_HOME=/opt/cloudera/parcels/CDH-5.3.3-1.cdh5.3.3.p0.5/lib/impala
++ CDH_IMPALA_HOME=/opt/cloudera/parcels/CDH-5.3.3-1.cdh5.3.3.p0.5/lib/impala
++ export CDH_SOLR_HOME=/opt/cloudera/parcels/CDH-5.3.3-1.cdh5.3.3.p0.5/lib/solr
++ CDH_SOLR_HOME=/opt/cloudera/parcels/CDH-5.3.3-1.cdh5.3.3.p0.5/lib/solr
++ export CDH_HBASE_INDEXER_HOME=/opt/cloudera/parcels/CDH-5.3.3-1.cdh5.3.3.p0.5/lib/hbase-solr
++ CDH_HBASE_INDEXER_HOME=/opt/cloudera/parcels/CDH-5.3.3-1.cdh5.3.3.p0.5/lib/hbase-solr
++ export SEARCH_HOME=/opt/cloudera/parcels/CDH-5.3.3-1.cdh5.3.3.p0.5/lib/search
++ SEARCH_HOME=/opt/cloudera/parcels/CDH-5.3.3-1.cdh5.3.3.p0.5/lib/search
++ export CDH_SPARK_HOME=/opt/cloudera/parcels/CDH-5.3.3-1.cdh5.3.3.p0.5/lib/spark
++ CDH_SPARK_HOME=/opt/cloudera/parcels/CDH-5.3.3-1.cdh5.3.3.p0.5/lib/spark
++ export WEBHCAT_DEFAULT_XML=/opt/cloudera/parcels/CDH-5.3.3-1.cdh5.3.3.p0.5/etc/hive-webhcat/conf.dist/webhcat-default.xml
++ WEBHCAT_DEFAULT_XML=/opt/cloudera/parcels/CDH-5.3.3-1.cdh5.3.3.p0.5/etc/hive-webhcat/conf.dist/webhcat-default.xml
++ export CDH_KMS_HOME=/opt/cloudera/parcels/CDH-5.3.3-1.cdh5.3.3.p0.5/lib/hadoop-kms
++ CDH_KMS_HOME=/opt/cloudera/parcels/CDH-5.3.3-1.cdh5.3.3.p0.5/lib/hadoop-kms

cloudera-scm-server.log

 

2015-06-03 21:45:04,992 INFO ParcelUpdateService:com.cloudera.parcel.components.LocalParcelManagerImpl: Found files CDH-5.3.3-1.cdh5.3.3.p0.5-el6.parcel under /opt/cloudera/parcel-repo
2015-06-03 21:45:30,280 INFO StaleEntityEviction:com.cloudera.server.cmf.StaleEntityEvictionThread: Reaped total of 0 deleted commands
2015-06-03 21:45:30,282 INFO StaleEntityEviction:com.cloudera.server.cmf.StaleEntityEvictionThread: Found no commands older than 2013-06-04T01:45:30.281Z to reap.
2015-06-03 21:45:30,284 INFO StaleEntityEviction:com.cloudera.server.cmf.node.NodeScannerService: Reaped 0 requests.
2015-06-03 21:45:30,284 INFO StaleEntityEviction:com.cloudera.server.cmf.node.NodeConfiguratorService: Reaped 0 requests.
2015-06-03 21:55:30,291 INFO StaleEntityEviction:com.cloudera.server.cmf.StaleEntityEvictionThread: Reaped total of 0 deleted commands
2015-06-03 21:55:30,292 INFO StaleEntityEviction:com.cloudera.server.cmf.StaleEntityEvictionThread: Found no commands older than 2013-06-04T01:55:30.292Z to reap.
2015-06-03 21:55:30,294 INFO StaleEntityEviction:com.cloudera.server.cmf.node.NodeScannerService: Reaped 0 requests.
2015-06-03 21:55:30,294 INFO StaleEntityEviction:com.cloudera.server.cmf.node.NodeConfiguratorService: Reaped 0 requests.
2015-06-03 22:00:00,004 INFO com.cloudera.cmf.scheduler-1_Worker-1:com.cloudera.cmf.service.ServiceHandlerRegistry: Executing command GlobalPoolsRefresh BasicCmdArgs{scheduleId=1, scheduledTime=2015-06-04T02:00:00.000Z}.
2015-06-03 22:00:00,334 INFO com.cloudera.cmf.scheduler-1_Worker-1:com.cloudera.cmf.scheduler.CommandDispatcherJob: Skipping scheduled command 'GlobalPoolsRefresh' since it is a noop.
2015-06-03 22:05:30,301 INFO StaleEntityEviction:com.cloudera.server.cmf.StaleEntityEvictionThread: Reaped total of 0 deleted commands
2015-06-03 22:05:30,302 INFO StaleEntityEviction:com.cloudera.server.cmf.StaleEntityEvictionThread: Found no commands older than 2013-06-04T02:05:30.301Z to reap.
2015-06-03 22:05:30,304 INFO StaleEntityEviction:com.cloudera.server.cmf.node.NodeScannerService: Reaped 0 requests.
2015-06-03 22:05:30,304 INFO StaleEntityEviction:com.cloudera.server.cmf.node.NodeConfiguratorService: Reaped 0 requests.
2015-06-03 22:15:30,311 INFO StaleEntityEviction:com.cloudera.server.cmf.StaleEntityEvictionThread: Reaped total of 0 deleted commands
2015-06-03 22:15:30,312 INFO StaleEntityEviction:com.cloudera.server.cmf.StaleEntityEvictionThread: Found no commands older than 2013-06-04T02:15:30.311Z to reap.
2015-06-03 22:15:30,314 INFO StaleEntityEviction:com.cloudera.server.cmf.node.NodeScannerService: Reaped 0 requests.
2015-06-03 22:15:30,314 INFO StaleEntityEviction:com.cloudera.server.cmf.node.NodeConfiguratorService: Reaped 0 requests.
2015-06-03 22:25:30,321 INFO StaleEntityEviction:com.cloudera.server.cmf.StaleEntityEvictionThread: Reaped total of 0 deleted commands
2015-06-03 22:25:30,322 INFO StaleEntityEviction:com.cloudera.server.cmf.StaleEntityEvictionThread: Found no commands older than 2013-06-04T02:25:30.321Z to reap.
2015-06-03 22:25:30,324 INFO StaleEntityEviction:com.cloudera.server.cmf.node.NodeScannerService: Reaped 0 requests.
2015-06-03 22:25:30,324 INFO StaleEntityEviction:com.cloudera.server.cmf.node.NodeConfiguratorService: Reaped 0 requests.
2015-06-03 22:35:30,331 INFO StaleEntityEviction:com.cloudera.server.cmf.StaleEntityEvictionThread: Reaped total of 0 deleted commands
2015-06-03 22:35:30,332 INFO StaleEntityEviction:com.cloudera.server.cmf.StaleEntityEvictionThread: Found no commands older than 2013-06-04T02:35:30.331Z to reap.
2015-06-03 22:35:30,333 INFO StaleEntityEviction:com.cloudera.server.cmf.node.NodeScannerService: Reaped 0 requests.
2015-06-03 22:35:30,333 INFO StaleEntityEviction:com.cloudera.server.cmf.node.NodeConfiguratorService: Reaped 0 requests.
Announcements