31 May 2017 14:17:15,893 INFO [qtp-ambari-client-35978] AbstractResourceProvider:921 - Received a updateHostComponent request, clusterName=rrahdpqa, serviceName=HDFS, componentName=DATANODE, hostname=nvmd1cbb150d00.ril.com, request={ clusterName=rrahdpqa, serviceName=HDFS, componentName=DATANODE, hostname=nvmd1cbb150d00.ril.com, desiredState=STARTED, state=null, desiredStackId=null, staleConfig=null, adminState=null} 31 May 2017 14:17:15,900 INFO [qtp-ambari-client-35978] AmbariManagementControllerImpl:1935 - Adding service type info in createHostAction:: null 31 May 2017 14:17:15,901 INFO [qtp-ambari-client-35978] AmbariManagementControllerImpl:1952 - Iterating service type Instance in createHostAction:: SQOOP 31 May 2017 14:17:15,901 INFO [qtp-ambari-client-35978] AmbariManagementControllerImpl:1952 - Iterating service type Instance in createHostAction:: HDFS 31 May 2017 14:17:15,902 INFO [qtp-ambari-client-35978] AmbariManagementControllerImpl:1952 - Iterating service type Instance in createHostAction:: MAPREDUCE2 31 May 2017 14:17:15,902 INFO [qtp-ambari-client-35978] AmbariManagementControllerImpl:1952 - Iterating service type Instance in createHostAction:: OOZIE 31 May 2017 14:17:15,903 INFO [qtp-ambari-client-35978] AmbariManagementControllerImpl:1952 - Iterating service type Instance in createHostAction:: TEZ 31 May 2017 14:17:15,903 INFO [qtp-ambari-client-35978] AmbariManagementControllerImpl:1952 - Iterating service type Instance in createHostAction:: SPARK 31 May 2017 14:17:15,904 INFO [qtp-ambari-client-35978] AmbariManagementControllerImpl:1952 - Iterating service type Instance in createHostAction:: HBASE 31 May 2017 14:17:15,904 INFO [qtp-ambari-client-35978] AmbariManagementControllerImpl:1952 - Iterating service type Instance in createHostAction:: ZOOKEEPER 31 May 2017 14:17:15,905 INFO [qtp-ambari-client-35978] AmbariManagementControllerImpl:1952 - Iterating service type Instance in createHostAction:: YARN 31 May 2017 14:17:15,905 INFO [qtp-ambari-client-35978] AmbariManagementControllerImpl:1952 - Iterating service type Instance in createHostAction:: PIG 31 May 2017 14:17:15,906 INFO [qtp-ambari-client-35978] AmbariManagementControllerImpl:1952 - Iterating service type Instance in createHostAction:: HIVE 31 May 2017 14:17:15,906 INFO [qtp-ambari-client-35978] AmbariManagementControllerImpl:1952 - Iterating service type Instance in createHostAction:: AMBARI_METRICS 31 May 2017 14:17:15,910 INFO [qtp-ambari-client-35978] AmbariManagementControllerImpl:2107 - AmbariManagementControllerImpl.createHostAction: created ExecutionCommand for host nvmd1cbb150d00.ril.com, role DATANODE, roleCommand START, and command ID 336--1, with cluster-env tags version1 31 May 2017 14:17:15,931 INFO [ambari-action-scheduler] ServiceComponentHostImpl:1047 - Host role transitioned to a new state, serviceComponentName=DATANODE, hostName=nvmd1cbb150d00.ril.com, oldState=INSTALLED, currentState=STARTING 31 May 2017 14:17:19,236 INFO [qtp-ambari-client-35982] AbstractProviderModule:878 - Current Metrics collector Host : null 31 May 2017 14:17:19,237 INFO [qtp-ambari-client-35982] AbstractProviderModule:883 - New Metrics collector Host : nvmd1cbb190d00.ril.com 31 May 2017 14:17:22,165 INFO [qtp-ambari-agent-35984] HeartBeatHandler:309 - HeartBeatHandler.sendCommands: sending ExecutionCommand for host nvmd1cbb150d00.ril.com, role DATANODE, roleCommand START, and command ID 336-0, task ID 3500 31 May 2017 14:17:30,754 WARN [ambari-heartbeat-processor-0] HeartbeatProcessor:545 - Operation failed - may be retried. Service component host: DATANODE, host: nvmd1cbb150d00.ril.com Action id 336-0 and Task id 3500 31 May 2017 14:17:30,756 INFO [ambari-heartbeat-processor-0] ServiceComponentHostImpl:1047 - Host role transitioned to a new state, serviceComponentName=DATANODE, hostName=nvmd1cbb150d00.ril.com, oldState=STARTING, currentState=INSTALLED 31 May 2017 17:03:17,914 ERROR [pool-9-thread-16400] BaseProvider:240 - Caught exception getting JMX metrics : Connection refused, skipping same exceptions for next 5 minutes java.net.ConnectException: Connection refused at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:589) at sun.net.NetworkClient.doConnect(NetworkClient.java:175) at sun.net.www.http.HttpClient.openServer(HttpClient.java:432) at sun.net.www.http.HttpClient.openServer(HttpClient.java:527) at sun.net.www.http.HttpClient.(HttpClient.java:211) at sun.net.www.http.HttpClient.New(HttpClient.java:308) at sun.net.www.http.HttpClient.New(HttpClient.java:326) at sun.net.www.protocol.http.HttpURLConnection.getNewHttpClient(HttpURLConnection.java:1169) at sun.net.www.protocol.http.HttpURLConnection.plainConnect0(HttpURLConnection.java:1105) at sun.net.www.protocol.http.HttpURLConnection.plainConnect(HttpURLConnection.java:999) at sun.net.www.protocol.http.HttpURLConnection.connect(HttpURLConnection.java:933) at sun.net.www.protocol.http.HttpURLConnection.getInputStream0(HttpURLConnection.java:1513) at sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1441) at java.net.HttpURLConnection.getResponseCode(HttpURLConnection.java:480) at org.apache.ambari.server.controller.internal.URLStreamProvider.processURL(URLStreamProvider.java:209) at org.apache.ambari.server.controller.internal.URLStreamProvider.processURL(URLStreamProvider.java:133) at org.apache.ambari.server.controller.internal.URLStreamProvider.readFrom(URLStreamProvider.java:107) at org.apache.ambari.server.controller.internal.URLStreamProvider.readFrom(URLStreamProvider.java:112) at org.apache.ambari.server.controller.jmx.JMXPropertyProvider.populateResource(JMXPropertyProvider.java:212) at org.apache.ambari.server.controller.metrics.ThreadPoolEnabledPropertyProvider$1.call(ThreadPoolEnabledPropertyProvider.java:180) at org.apache.ambari.server.controller.metrics.ThreadPoolEnabledPropertyProvider$1.call(ThreadPoolEnabledPropertyProvider.java:178) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 31 May 2017 17:03:54,304 INFO [qtp-ambari-client-36472] AbstractProviderModule:878 - Current Metrics collector Host : null 31 May 2017 17:03:54,306 INFO [qtp-ambari-client-36472] AbstractProviderModule:883 - New Metrics collector Host : nvmd1cbb190d00.ril.com 31 May 2017 17:16:41,199 ERROR [pool-9-thread-16398] BaseProvider:240 - Caught exception getting JMX metrics : Connection refused, skipping same exceptions for next 5 minutes java.net.ConnectException: Connection refused at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:589) at sun.net.NetworkClient.doConnect(NetworkClient.java:175) at sun.net.www.http.HttpClient.openServer(HttpClient.java:432) at sun.net.www.http.HttpClient.openServer(HttpClient.java:527) at sun.net.www.http.HttpClient.(HttpClient.java:211) at sun.net.www.http.HttpClient.New(HttpClient.java:308) at sun.net.www.http.HttpClient.New(HttpClient.java:326) at sun.net.www.protocol.http.HttpURLConnection.getNewHttpClient(HttpURLConnection.java:1169) at sun.net.www.protocol.http.HttpURLConnection.plainConnect0(HttpURLConnection.java:1105) at sun.net.www.protocol.http.HttpURLConnection.plainConnect(HttpURLConnection.java:999) at sun.net.www.protocol.http.HttpURLConnection.connect(HttpURLConnection.java:933) at sun.net.www.protocol.http.HttpURLConnection.getInputStream0(HttpURLConnection.java:1513) at sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1441) at java.net.HttpURLConnection.getResponseCode(HttpURLConnection.java:480) at org.apache.ambari.server.controller.internal.URLStreamProvider.processURL(URLStreamProvider.java:209) at org.apache.ambari.server.controller.internal.URLStreamProvider.processURL(URLStreamProvider.java:133) at org.apache.ambari.server.controller.internal.URLStreamProvider.readFrom(URLStreamProvider.java:107) at org.apache.ambari.server.controller.internal.URLStreamProvider.readFrom(URLStreamProvider.java:112) at org.apache.ambari.server.controller.jmx.JMXPropertyProvider.populateResource(JMXPropertyProvider.java:212) at org.apache.ambari.server.controller.metrics.ThreadPoolEnabledPropertyProvider$1.call(ThreadPoolEnabledPropertyProvider.java:180) at org.apache.ambari.server.controller.metrics.ThreadPoolEnabledPropertyProvider$1.call(ThreadPoolEnabledPropertyProvider.java:178) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 31 May 2017 17:16:56,884 INFO [qtp-ambari-client-36548] AbstractProviderModule:878 - Current Metrics collector Host : null 31 May 2017 17:16:56,885 INFO [qtp-ambari-client-36548] AbstractProviderModule:883 - New Metrics collector Host : nvmd1cbb190d00.ril.com 31 May 2017 17:19:03,777 INFO [qtp-ambari-client-36511] AmbariManagementControllerImpl:3385 - Received action execution request, clusterName=rrahdpqa, request=isCommand :true, action :null, command :RESTART, inputs :{}, resourceFilters: [RequestResourceFilter{serviceName='HDFS', componentName='DATANODE', hostNames=[nvmd1cbb210d00.ril.com]}, RequestResourceFilter{serviceName='HBASE', componentName='HBASE_CLIENT', hostNames=[nvmd1cbb210d00.ril.com]}, RequestResourceFilter{serviceName='HIVE', componentName='HCAT', hostNames=[nvmd1cbb210d00.ril.com]}, RequestResourceFilter{serviceName='HDFS', componentName='HDFS_CLIENT', hostNames=[nvmd1cbb210d00.ril.com]}, RequestResourceFilter{serviceName='HIVE', componentName='HIVE_CLIENT', hostNames=[nvmd1cbb210d00.ril.com]}, RequestResourceFilter{serviceName='MAPREDUCE2', componentName='MAPREDUCE2_CLIENT', hostNames=[nvmd1cbb210d00.ril.com]}, RequestResourceFilter{serviceName='AMBARI_METRICS', componentName='METRICS_MONITOR', hostNames=[nvmd1cbb210d00.ril.com]}, RequestResourceFilter{serviceName='HDFS', componentName='NAMENODE', hostNames=[nvmd1cbb210d00.ril.com]}, RequestResourceFilter{serviceName='OOZIE', componentName='OOZIE_CLIENT', hostNames=[nvmd1cbb210d00.ril.com]}, RequestResourceFilter{serviceName='PIG', componentName='PIG', hostNames=[nvmd1cbb210d00.ril.com]}, RequestResourceFilter{serviceName='SPARK', componentName='SPARK_CLIENT', hostNames=[nvmd1cbb210d00.ril.com]}, RequestResourceFilter{serviceName='SQOOP', componentName='SQOOP', hostNames=[nvmd1cbb210d00.ril.com]}, RequestResourceFilter{serviceName='TEZ', componentName='TEZ_CLIENT', hostNames=[nvmd1cbb210d00.ril.com]}, RequestResourceFilter{serviceName='YARN', componentName='YARN_CLIENT', hostNames=[nvmd1cbb210d00.ril.com]}, RequestResourceFilter{serviceName='ZOOKEEPER', componentName='ZOOKEEPER_CLIENT', hostNames=[nvmd1cbb210d00.ril.com]}], exclusive: false, clusterName :rrahdpqa 31 May 2017 17:19:03,783 INFO [qtp-ambari-client-36511] AmbariCustomCommandExecutionHelper:1135 - Iterating service type Instance in getCommandJson:: SQOOP 31 May 2017 17:19:03,784 INFO [qtp-ambari-client-36511] AmbariCustomCommandExecutionHelper:1135 - Iterating service type Instance in getCommandJson:: HDFS 31 May 2017 17:19:03,784 INFO [qtp-ambari-client-36511] AmbariCustomCommandExecutionHelper:1135 - Iterating service type Instance in getCommandJson:: MAPREDUCE2 31 May 2017 17:19:03,784 INFO [qtp-ambari-client-36511] AmbariCustomCommandExecutionHelper:1135 - Iterating service type Instance in getCommandJson:: OOZIE 31 May 2017 17:19:03,785 INFO [qtp-ambari-client-36511] AmbariCustomCommandExecutionHelper:1135 - Iterating service type Instance in getCommandJson:: TEZ 31 May 2017 17:19:03,785 INFO [qtp-ambari-client-36511] AmbariCustomCommandExecutionHelper:1135 - Iterating service type Instance in getCommandJson:: SPARK 31 May 2017 17:19:03,786 INFO [qtp-ambari-client-36511] AmbariCustomCommandExecutionHelper:1135 - Iterating service type Instance in getCommandJson:: HBASE 31 May 2017 17:19:03,786 INFO [qtp-ambari-client-36511] AmbariCustomCommandExecutionHelper:1135 - Iterating service type Instance in getCommandJson:: ZOOKEEPER 31 May 2017 17:19:03,787 INFO [qtp-ambari-client-36511] AmbariCustomCommandExecutionHelper:1135 - Iterating service type Instance in getCommandJson:: YARN 31 May 2017 17:19:03,787 INFO [qtp-ambari-client-36511] AmbariCustomCommandExecutionHelper:1135 - Iterating service type Instance in getCommandJson:: PIG 31 May 2017 17:19:03,787 INFO [qtp-ambari-client-36511] AmbariCustomCommandExecutionHelper:1135 - Iterating service type Instance in getCommandJson:: HIVE 31 May 2017 17:19:03,788 INFO [qtp-ambari-client-36511] AmbariCustomCommandExecutionHelper:1135 - Iterating service type Instance in getCommandJson:: AMBARI_METRICS 31 May 2017 17:19:12,544 INFO [qtp-ambari-agent-36550] HeartBeatHandler:309 - HeartBeatHandler.sendCommands: sending ExecutionCommand for host nvmd1cbb210d00.ril.com, role DATANODE, roleCommand CUSTOM_COMMAND, and command ID 337-0, task ID 3501 31 May 2017 17:19:12,546 INFO [qtp-ambari-agent-36550] HeartBeatHandler:309 - HeartBeatHandler.sendCommands: sending ExecutionCommand for host nvmd1cbb210d00.ril.com, role HBASE_CLIENT, roleCommand CUSTOM_COMMAND, and command ID 337-0, task ID 3502 31 May 2017 17:19:12,547 INFO [qtp-ambari-agent-36550] HeartBeatHandler:309 - HeartBeatHandler.sendCommands: sending ExecutionCommand for host nvmd1cbb210d00.ril.com, role HCAT, roleCommand CUSTOM_COMMAND, and command ID 337-0, task ID 3503 31 May 2017 17:19:12,547 INFO [qtp-ambari-agent-36550] HeartBeatHandler:309 - HeartBeatHandler.sendCommands: sending ExecutionCommand for host nvmd1cbb210d00.ril.com, role HDFS_CLIENT, roleCommand CUSTOM_COMMAND, and command ID 337-0, task ID 3504 31 May 2017 17:19:12,547 INFO [qtp-ambari-agent-36550] HeartBeatHandler:309 - HeartBeatHandler.sendCommands: sending ExecutionCommand for host nvmd1cbb210d00.ril.com, role HIVE_CLIENT, roleCommand CUSTOM_COMMAND, and command ID 337-0, task ID 3505 31 May 2017 17:19:12,547 INFO [qtp-ambari-agent-36550] HeartBeatHandler:309 - HeartBeatHandler.sendCommands: sending ExecutionCommand for host nvmd1cbb210d00.ril.com, role MAPREDUCE2_CLIENT, roleCommand CUSTOM_COMMAND, and command ID 337-0, task ID 3506 31 May 2017 17:19:12,548 INFO [qtp-ambari-agent-36550] HeartBeatHandler:309 - HeartBeatHandler.sendCommands: sending ExecutionCommand for host nvmd1cbb210d00.ril.com, role METRICS_MONITOR, roleCommand CUSTOM_COMMAND, and command ID 337-0, task ID 3507 31 May 2017 17:19:12,548 INFO [qtp-ambari-agent-36550] HeartBeatHandler:309 - HeartBeatHandler.sendCommands: sending ExecutionCommand for host nvmd1cbb210d00.ril.com, role NAMENODE, roleCommand CUSTOM_COMMAND, and command ID 337-0, task ID 3508 31 May 2017 17:19:12,548 INFO [qtp-ambari-agent-36550] HeartBeatHandler:309 - HeartBeatHandler.sendCommands: sending ExecutionCommand for host nvmd1cbb210d00.ril.com, role OOZIE_CLIENT, roleCommand CUSTOM_COMMAND, and command ID 337-0, task ID 3509 31 May 2017 17:19:12,548 INFO [qtp-ambari-agent-36550] HeartBeatHandler:309 - HeartBeatHandler.sendCommands: sending ExecutionCommand for host nvmd1cbb210d00.ril.com, role PIG, roleCommand CUSTOM_COMMAND, and command ID 337-0, task ID 3510 31 May 2017 17:19:12,549 INFO [qtp-ambari-agent-36550] HeartBeatHandler:309 - HeartBeatHandler.sendCommands: sending ExecutionCommand for host nvmd1cbb210d00.ril.com, role SPARK_CLIENT, roleCommand CUSTOM_COMMAND, and command ID 337-0, task ID 3511 31 May 2017 17:19:12,549 INFO [qtp-ambari-agent-36550] HeartBeatHandler:309 - HeartBeatHandler.sendCommands: sending ExecutionCommand for host nvmd1cbb210d00.ril.com, role SQOOP, roleCommand CUSTOM_COMMAND, and command ID 337-0, task ID 3512 31 May 2017 17:19:12,549 INFO [qtp-ambari-agent-36550] HeartBeatHandler:309 - HeartBeatHandler.sendCommands: sending ExecutionCommand for host nvmd1cbb210d00.ril.com, role TEZ_CLIENT, roleCommand CUSTOM_COMMAND, and command ID 337-0, task ID 3513 31 May 2017 17:19:12,549 INFO [qtp-ambari-agent-36550] HeartBeatHandler:309 - HeartBeatHandler.sendCommands: sending ExecutionCommand for host nvmd1cbb210d00.ril.com, role YARN_CLIENT, roleCommand CUSTOM_COMMAND, and command ID 337-0, task ID 3514 31 May 2017 17:19:12,550 INFO [qtp-ambari-agent-36550] HeartBeatHandler:309 - HeartBeatHandler.sendCommands: sending ExecutionCommand for host nvmd1cbb210d00.ril.com, role ZOOKEEPER_CLIENT, roleCommand CUSTOM_COMMAND, and command ID 337-0, task ID 3515 31 May 2017 17:19:25,997 INFO [ambari-heartbeat-processor-0] HeartbeatProcessor:496 - Updating applied config on service HDFS, component DATANODE, host nvmd1cbb210d00.ril.com 31 May 2017 17:19:28,999 INFO [ambari-heartbeat-processor-0] HeartbeatProcessor:496 - Updating applied config on service HBASE, component HBASE_CLIENT, host nvmd1cbb210d00.ril.com 31 May 2017 17:19:31,000 INFO [ambari-heartbeat-processor-0] HeartbeatProcessor:496 - Updating applied config on service HIVE, component HCAT, host nvmd1cbb210d00.ril.com 31 May 2017 17:19:33,999 INFO [ambari-heartbeat-processor-0] HeartbeatProcessor:496 - Updating applied config on service HDFS, component HDFS_CLIENT, host nvmd1cbb210d00.ril.com 31 May 2017 17:19:36,001 INFO [ambari-heartbeat-processor-0] HeartbeatProcessor:496 - Updating applied config on service HIVE, component HIVE_CLIENT, host nvmd1cbb210d00.ril.com 31 May 2017 17:19:38,999 INFO [ambari-heartbeat-processor-0] HeartbeatProcessor:496 - Updating applied config on service MAPREDUCE2, component MAPREDUCE2_CLIENT, host nvmd1cbb210d00.ril.com 31 May 2017 17:19:47,993 INFO [ambari-heartbeat-processor-0] HeartbeatProcessor:496 - Updating applied config on service AMBARI_METRICS, component METRICS_MONITOR, host nvmd1cbb210d00.ril.com 31 May 2017 17:21:08,000 INFO [ambari-heartbeat-processor-0] HeartbeatProcessor:496 - Updating applied config on service HDFS, component NAMENODE, host nvmd1cbb210d00.ril.com 31 May 2017 17:21:10,999 INFO [ambari-heartbeat-processor-0] HeartbeatProcessor:496 - Updating applied config on service OOZIE, component OOZIE_CLIENT, host nvmd1cbb210d00.ril.com 31 May 2017 17:21:12,999 INFO [ambari-heartbeat-processor-0] HeartbeatProcessor:496 - Updating applied config on service PIG, component PIG, host nvmd1cbb210d00.ril.com 31 May 2017 17:21:14,999 INFO [ambari-heartbeat-processor-0] HeartbeatProcessor:496 - Updating applied config on service SPARK, component SPARK_CLIENT, host nvmd1cbb210d00.ril.com 31 May 2017 17:21:17,041 INFO [ambari-heartbeat-processor-0] HeartbeatProcessor:496 - Updating applied config on service SQOOP, component SQOOP, host nvmd1cbb210d00.ril.com 31 May 2017 17:21:19,000 INFO [ambari-heartbeat-processor-0] HeartbeatProcessor:496 - Updating applied config on service TEZ, component TEZ_CLIENT, host nvmd1cbb210d00.ril.com 31 May 2017 17:21:21,999 INFO [ambari-heartbeat-processor-0] HeartbeatProcessor:496 - Updating applied config on service YARN, component YARN_CLIENT, host nvmd1cbb210d00.ril.com 31 May 2017 17:21:24,007 INFO [ambari-heartbeat-processor-0] HeartbeatProcessor:496 - Updating applied config on service ZOOKEEPER, component ZOOKEEPER_CLIENT, host nvmd1cbb210d00.ril.com 31 May 2017 17:25:55,962 INFO [qtp-ambari-client-36546] AbstractProviderModule:878 - Current Metrics collector Host : null 31 May 2017 17:25:55,963 INFO [qtp-ambari-client-36546] AbstractProviderModule:883 - New Metrics collector Host : nvmd1cbb190d00.ril.com 31 May 2017 17:27:13,739 INFO [qtp-ambari-client-36578] AbstractProviderModule:878 - Current Metrics collector Host : null 31 May 2017 17:27:13,740 INFO [qtp-ambari-client-36578] AbstractProviderModule:883 - New Metrics collector Host : nvmd1cbb190d00.ril.com 31 May 2017 17:27:21,891 INFO [qtp-ambari-client-36546] AmbariManagementControllerImpl:3385 - Received action execution request, clusterName=rrahdpqa, request=isCommand :true, action :null, command :RESTART, inputs :{}, resourceFilters: [RequestResourceFilter{serviceName='YARN', componentName='APP_TIMELINE_SERVER', hostNames=[nvmd1cbb150d00.ril.com]}, RequestResourceFilter{serviceName='HDFS', componentName='DATANODE', hostNames=[nvmd1cbb150d00.ril.com]}, RequestResourceFilter{serviceName='HDFS', componentName='HDFS_CLIENT', hostNames=[nvmd1cbb150d00.ril.com]}, RequestResourceFilter{serviceName='MAPREDUCE2', componentName='HISTORYSERVER', hostNames=[nvmd1cbb150d00.ril.com]}, RequestResourceFilter{serviceName='HIVE', componentName='HIVE_CLIENT', hostNames=[nvmd1cbb150d00.ril.com]}, RequestResourceFilter{serviceName='HIVE', componentName='HIVE_METASTORE', hostNames=[nvmd1cbb150d00.ril.com]}, RequestResourceFilter{serviceName='HIVE', componentName='HIVE_SERVER', hostNames=[nvmd1cbb150d00.ril.com]}, RequestResourceFilter{serviceName='MAPREDUCE2', componentName='MAPREDUCE2_CLIENT', hostNames=[nvmd1cbb150d00.ril.com]}, RequestResourceFilter{serviceName='AMBARI_METRICS', componentName='METRICS_MONITOR', hostNames=[nvmd1cbb150d00.ril.com]}, RequestResourceFilter{serviceName='HIVE', componentName='MYSQL_SERVER', hostNames=[nvmd1cbb150d00.ril.com]}, RequestResourceFilter{serviceName='YARN', componentName='NODEMANAGER', hostNames=[nvmd1cbb150d00.ril.com]}, RequestResourceFilter{serviceName='OOZIE', componentName='OOZIE_SERVER', hostNames=[nvmd1cbb150d00.ril.com]}, RequestResourceFilter{serviceName='HBASE', componentName='PHOENIX_QUERY_SERVER', hostNames=[nvmd1cbb150d00.ril.com]}, RequestResourceFilter{serviceName='PIG', componentName='PIG', hostNames=[nvmd1cbb150d00.ril.com]}, RequestResourceFilter{serviceName='YARN', componentName='RESOURCEMANAGER', hostNames=[nvmd1cbb150d00.ril.com]}, RequestResourceFilter{serviceName='HDFS', componentName='SECONDARY_NAMENODE', hostNames=[nvmd1cbb150d00.ril.com]}, RequestResourceFilter{serviceName='SPARK', componentName='SPARK_THRIFTSERVER', hostNames=[nvmd1cbb150d00.ril.com]}, RequestResourceFilter{serviceName='TEZ', componentName='TEZ_CLIENT', hostNames=[nvmd1cbb150d00.ril.com]}, RequestResourceFilter{serviceName='HIVE', componentName='WEBHCAT_SERVER', hostNames=[nvmd1cbb150d00.ril.com]}, RequestResourceFilter{serviceName='YARN', componentName='YARN_CLIENT', hostNames=[nvmd1cbb150d00.ril.com]}, RequestResourceFilter{serviceName='ZOOKEEPER', componentName='ZOOKEEPER_CLIENT', hostNames=[nvmd1cbb150d00.ril.com]}, RequestResourceFilter{serviceName='ZOOKEEPER', componentName='ZOOKEEPER_SERVER', hostNames=[nvmd1cbb150d00.ril.com]}], exclusive: false, clusterName :rrahdpqa 31 May 2017 17:27:21,897 INFO [qtp-ambari-client-36546] AmbariCustomCommandExecutionHelper:1135 - Iterating service type Instance in getCommandJson:: SQOOP 31 May 2017 17:27:21,898 INFO [qtp-ambari-client-36546] AmbariCustomCommandExecutionHelper:1135 - Iterating service type Instance in getCommandJson:: HDFS 31 May 2017 17:27:21,898 INFO [qtp-ambari-client-36546] AmbariCustomCommandExecutionHelper:1135 - Iterating service type Instance in getCommandJson:: MAPREDUCE2 31 May 2017 17:27:21,899 INFO [qtp-ambari-client-36546] AmbariCustomCommandExecutionHelper:1135 - Iterating service type Instance in getCommandJson:: OOZIE 31 May 2017 17:27:21,899 INFO [qtp-ambari-client-36546] AmbariCustomCommandExecutionHelper:1135 - Iterating service type Instance in getCommandJson:: TEZ 31 May 2017 17:27:21,900 INFO [qtp-ambari-client-36546] AmbariCustomCommandExecutionHelper:1135 - Iterating service type Instance in getCommandJson:: SPARK 31 May 2017 17:27:21,900 INFO [qtp-ambari-client-36546] AmbariCustomCommandExecutionHelper:1135 - Iterating service type Instance in getCommandJson:: HBASE 31 May 2017 17:27:21,900 INFO [qtp-ambari-client-36546] AmbariCustomCommandExecutionHelper:1135 - Iterating service type Instance in getCommandJson:: ZOOKEEPER 31 May 2017 17:27:21,901 INFO [qtp-ambari-client-36546] AmbariCustomCommandExecutionHelper:1135 - Iterating service type Instance in getCommandJson:: YARN 31 May 2017 17:27:21,901 INFO [qtp-ambari-client-36546] AmbariCustomCommandExecutionHelper:1135 - Iterating service type Instance in getCommandJson:: PIG 31 May 2017 17:27:21,902 INFO [qtp-ambari-client-36546] AmbariCustomCommandExecutionHelper:1135 - Iterating service type Instance in getCommandJson:: HIVE 31 May 2017 17:27:21,902 INFO [qtp-ambari-client-36546] AmbariCustomCommandExecutionHelper:1135 - Iterating service type Instance in getCommandJson:: AMBARI_METRICS 31 May 2017 17:27:32,341 INFO [qtp-ambari-agent-36572] HeartBeatHandler:309 - HeartBeatHandler.sendCommands: sending ExecutionCommand for host nvmd1cbb150d00.ril.com, role APP_TIMELINE_SERVER, roleCommand CUSTOM_COMMAND, and command ID 338-0, task ID 3516 31 May 2017 17:27:32,342 INFO [qtp-ambari-agent-36572] HeartBeatHandler:309 - HeartBeatHandler.sendCommands: sending ExecutionCommand for host nvmd1cbb150d00.ril.com, role DATANODE, roleCommand CUSTOM_COMMAND, and command ID 338-0, task ID 3517 31 May 2017 17:27:32,342 INFO [qtp-ambari-agent-36572] HeartBeatHandler:309 - HeartBeatHandler.sendCommands: sending ExecutionCommand for host nvmd1cbb150d00.ril.com, role HDFS_CLIENT, roleCommand CUSTOM_COMMAND, and command ID 338-0, task ID 3518 31 May 2017 17:27:32,343 INFO [qtp-ambari-agent-36572] HeartBeatHandler:309 - HeartBeatHandler.sendCommands: sending ExecutionCommand for host nvmd1cbb150d00.ril.com, role HISTORYSERVER, roleCommand CUSTOM_COMMAND, and command ID 338-0, task ID 3519 31 May 2017 17:27:32,343 INFO [qtp-ambari-agent-36572] HeartBeatHandler:309 - HeartBeatHandler.sendCommands: sending ExecutionCommand for host nvmd1cbb150d00.ril.com, role HIVE_CLIENT, roleCommand CUSTOM_COMMAND, and command ID 338-0, task ID 3520 31 May 2017 17:27:32,343 INFO [qtp-ambari-agent-36572] HeartBeatHandler:309 - HeartBeatHandler.sendCommands: sending ExecutionCommand for host nvmd1cbb150d00.ril.com, role MAPREDUCE2_CLIENT, roleCommand CUSTOM_COMMAND, and command ID 338-0, task ID 3521 31 May 2017 17:27:32,343 INFO [qtp-ambari-agent-36572] HeartBeatHandler:309 - HeartBeatHandler.sendCommands: sending ExecutionCommand for host nvmd1cbb150d00.ril.com, role METRICS_MONITOR, roleCommand CUSTOM_COMMAND, and command ID 338-0, task ID 3522 31 May 2017 17:27:32,344 INFO [qtp-ambari-agent-36572] HeartBeatHandler:309 - HeartBeatHandler.sendCommands: sending ExecutionCommand for host nvmd1cbb150d00.ril.com, role MYSQL_SERVER, roleCommand CUSTOM_COMMAND, and command ID 338-0, task ID 3523 31 May 2017 17:27:32,344 INFO [qtp-ambari-agent-36572] HeartBeatHandler:309 - HeartBeatHandler.sendCommands: sending ExecutionCommand for host nvmd1cbb150d00.ril.com, role NODEMANAGER, roleCommand CUSTOM_COMMAND, and command ID 338-0, task ID 3524 31 May 2017 17:27:32,344 INFO [qtp-ambari-agent-36572] HeartBeatHandler:309 - HeartBeatHandler.sendCommands: sending ExecutionCommand for host nvmd1cbb150d00.ril.com, role OOZIE_SERVER, roleCommand CUSTOM_COMMAND, and command ID 338-0, task ID 3525 31 May 2017 17:27:32,344 INFO [qtp-ambari-agent-36572] HeartBeatHandler:309 - HeartBeatHandler.sendCommands: sending ExecutionCommand for host nvmd1cbb150d00.ril.com, role PHOENIX_QUERY_SERVER, roleCommand CUSTOM_COMMAND, and command ID 338-0, task ID 3526 31 May 2017 17:27:32,345 INFO [qtp-ambari-agent-36572] HeartBeatHandler:309 - HeartBeatHandler.sendCommands: sending ExecutionCommand for host nvmd1cbb150d00.ril.com, role PIG, roleCommand CUSTOM_COMMAND, and command ID 338-0, task ID 3527 31 May 2017 17:27:32,345 INFO [qtp-ambari-agent-36572] HeartBeatHandler:309 - HeartBeatHandler.sendCommands: sending ExecutionCommand for host nvmd1cbb150d00.ril.com, role RESOURCEMANAGER, roleCommand CUSTOM_COMMAND, and command ID 338-0, task ID 3528 31 May 2017 17:27:32,345 INFO [qtp-ambari-agent-36572] HeartBeatHandler:309 - HeartBeatHandler.sendCommands: sending ExecutionCommand for host nvmd1cbb150d00.ril.com, role SECONDARY_NAMENODE, roleCommand CUSTOM_COMMAND, and command ID 338-0, task ID 3529 31 May 2017 17:27:32,346 INFO [qtp-ambari-agent-36572] HeartBeatHandler:309 - HeartBeatHandler.sendCommands: sending ExecutionCommand for host nvmd1cbb150d00.ril.com, role SPARK_THRIFTSERVER, roleCommand CUSTOM_COMMAND, and command ID 338-0, task ID 3530 31 May 2017 17:27:32,346 INFO [qtp-ambari-agent-36572] HeartBeatHandler:309 - HeartBeatHandler.sendCommands: sending ExecutionCommand for host nvmd1cbb150d00.ril.com, role TEZ_CLIENT, roleCommand CUSTOM_COMMAND, and command ID 338-0, task ID 3531 31 May 2017 17:27:32,346 INFO [qtp-ambari-agent-36572] HeartBeatHandler:309 - HeartBeatHandler.sendCommands: sending ExecutionCommand for host nvmd1cbb150d00.ril.com, role YARN_CLIENT, roleCommand CUSTOM_COMMAND, and command ID 338-0, task ID 3532 31 May 2017 17:27:32,346 INFO [qtp-ambari-agent-36572] HeartBeatHandler:309 - HeartBeatHandler.sendCommands: sending ExecutionCommand for host nvmd1cbb150d00.ril.com, role ZOOKEEPER_CLIENT, roleCommand CUSTOM_COMMAND, and command ID 338-0, task ID 3533 31 May 2017 17:27:32,347 INFO [qtp-ambari-agent-36572] HeartBeatHandler:309 - HeartBeatHandler.sendCommands: sending ExecutionCommand for host nvmd1cbb150d00.ril.com, role ZOOKEEPER_SERVER, roleCommand CUSTOM_COMMAND, and command ID 338-0, task ID 3534 31 May 2017 17:27:36,993 WARN [ambari-heartbeat-processor-0] HeartbeatProcessor:545 - Operation failed - may be retried. Service component host: APP_TIMELINE_SERVER, host: nvmd1cbb150d00.ril.com Action id 338-0 and Task id 3516 31 May 2017 17:27:36,994 ERROR [ambari-heartbeat-processor-0] ServiceComponentHostImpl:1030 - Can't handle ServiceComponentHostEvent event at current state, serviceComponentName=APP_TIMELINE_SERVER, hostName=nvmd1cbb150d00.ril.com, currentState=INSTALLED, eventType=HOST_SVCCOMP_OP_FAILED, event=EventType: HOST_SVCCOMP_OP_FAILED 31 May 2017 17:27:36,994 WARN [ambari-heartbeat-processor-0] HeartbeatProcessor:563 - State machine exception. Invalid event: HOST_SVCCOMP_OP_FAILED at INSTALLED 31 May 2017 17:27:37,510 WARN [ambari-action-scheduler] ActionScheduler:305 - APP_TIMELINE_SERVER failed, request 338 will be aborted 31 May 2017 17:27:37,510 WARN [ambari-action-scheduler] ActionScheduler:318 - Operation completely failed, aborting request id: 338 31 May 2017 17:27:37,511 ERROR [ambari-action-scheduler] ServiceComponentHostImpl:1030 - Can't handle ServiceComponentHostEvent event at current state, serviceComponentName=APP_TIMELINE_SERVER, hostName=nvmd1cbb150d00.ril.com, currentState=INSTALLED, eventType=HOST_SVCCOMP_OP_FAILED, event=EventType: HOST_SVCCOMP_OP_FAILED 31 May 2017 17:27:37,511 ERROR [ambari-action-scheduler] ServiceComponentHostImpl:1030 - Can't handle ServiceComponentHostEvent event at current state, serviceComponentName=DATANODE, hostName=nvmd1cbb150d00.ril.com, currentState=INSTALLED, eventType=HOST_SVCCOMP_OP_FAILED, event=EventType: HOST_SVCCOMP_OP_FAILED 31 May 2017 17:27:37,511 ERROR [ambari-action-scheduler] ServiceComponentHostImpl:1030 - Can't handle ServiceComponentHostEvent event at current state, serviceComponentName=HDFS_CLIENT, hostName=nvmd1cbb150d00.ril.com, currentState=INSTALLED, eventType=HOST_SVCCOMP_OP_FAILED, event=EventType: HOST_SVCCOMP_OP_FAILED 31 May 2017 17:27:37,511 ERROR [ambari-action-scheduler] ServiceComponentHostImpl:1030 - Can't handle ServiceComponentHostEvent event at current state, serviceComponentName=HISTORYSERVER, hostName=nvmd1cbb150d00.ril.com, currentState=STARTED, eventType=HOST_SVCCOMP_OP_FAILED, event=EventType: HOST_SVCCOMP_OP_FAILED 31 May 2017 17:27:37,512 ERROR [ambari-action-scheduler] ServiceComponentHostImpl:1030 - Can't handle ServiceComponentHostEvent event at current state, serviceComponentName=HIVE_CLIENT, hostName=nvmd1cbb150d00.ril.com, currentState=INSTALLED, eventType=HOST_SVCCOMP_OP_FAILED, event=EventType: HOST_SVCCOMP_OP_FAILED 31 May 2017 17:27:37,512 ERROR [ambari-action-scheduler] ServiceComponentHostImpl:1030 - Can't handle ServiceComponentHostEvent event at current state, serviceComponentName=MAPREDUCE2_CLIENT, hostName=nvmd1cbb150d00.ril.com, currentState=INSTALLED, eventType=HOST_SVCCOMP_OP_FAILED, event=EventType: HOST_SVCCOMP_OP_FAILED 31 May 2017 17:27:37,512 ERROR [ambari-action-scheduler] ServiceComponentHostImpl:1030 - Can't handle ServiceComponentHostEvent event at current state, serviceComponentName=METRICS_MONITOR, hostName=nvmd1cbb150d00.ril.com, currentState=STARTED, eventType=HOST_SVCCOMP_OP_FAILED, event=EventType: HOST_SVCCOMP_OP_FAILED 31 May 2017 17:27:37,512 ERROR [ambari-action-scheduler] ServiceComponentHostImpl:1030 - Can't handle ServiceComponentHostEvent event at current state, serviceComponentName=MYSQL_SERVER, hostName=nvmd1cbb150d00.ril.com, currentState=STARTED, eventType=HOST_SVCCOMP_OP_FAILED, event=EventType: HOST_SVCCOMP_OP_FAILED 31 May 2017 17:27:37,512 ERROR [ambari-action-scheduler] ServiceComponentHostImpl:1030 - Can't handle ServiceComponentHostEvent event at current state, serviceComponentName=NODEMANAGER, hostName=nvmd1cbb150d00.ril.com, currentState=STARTED, eventType=HOST_SVCCOMP_OP_FAILED, event=EventType: HOST_SVCCOMP_OP_FAILED 31 May 2017 17:27:37,513 ERROR [ambari-action-scheduler] ServiceComponentHostImpl:1030 - Can't handle ServiceComponentHostEvent event at current state, serviceComponentName=OOZIE_SERVER, hostName=nvmd1cbb150d00.ril.com, currentState=STARTED, eventType=HOST_SVCCOMP_OP_FAILED, event=EventType: HOST_SVCCOMP_OP_FAILED 31 May 2017 17:27:37,513 ERROR [ambari-action-scheduler] ServiceComponentHostImpl:1030 - Can't handle ServiceComponentHostEvent event at current state, serviceComponentName=PHOENIX_QUERY_SERVER, hostName=nvmd1cbb150d00.ril.com, currentState=STARTED, eventType=HOST_SVCCOMP_OP_FAILED, event=EventType: HOST_SVCCOMP_OP_FAILED 31 May 2017 17:27:37,513 ERROR [ambari-action-scheduler] ServiceComponentHostImpl:1030 - Can't handle ServiceComponentHostEvent event at current state, serviceComponentName=PIG, hostName=nvmd1cbb150d00.ril.com, currentState=INSTALLED, eventType=HOST_SVCCOMP_OP_FAILED, event=EventType: HOST_SVCCOMP_OP_FAILED 31 May 2017 17:27:37,513 ERROR [ambari-action-scheduler] ServiceComponentHostImpl:1030 - Can't handle ServiceComponentHostEvent event at current state, serviceComponentName=RESOURCEMANAGER, hostName=nvmd1cbb150d00.ril.com, currentState=STARTED, eventType=HOST_SVCCOMP_OP_FAILED, event=EventType: HOST_SVCCOMP_OP_FAILED 31 May 2017 17:27:37,513 ERROR [ambari-action-scheduler] ServiceComponentHostImpl:1030 - Can't handle ServiceComponentHostEvent event at current state, serviceComponentName=SECONDARY_NAMENODE, hostName=nvmd1cbb150d00.ril.com, currentState=STARTED, eventType=HOST_SVCCOMP_OP_FAILED, event=EventType: HOST_SVCCOMP_OP_FAILED 31 May 2017 17:27:37,514 ERROR [ambari-action-scheduler] ServiceComponentHostImpl:1030 - Can't handle ServiceComponentHostEvent event at current state, serviceComponentName=SPARK_THRIFTSERVER, hostName=nvmd1cbb150d00.ril.com, currentState=STARTED, eventType=HOST_SVCCOMP_OP_FAILED, event=EventType: HOST_SVCCOMP_OP_FAILED 31 May 2017 17:27:37,514 ERROR [ambari-action-scheduler] ServiceComponentHostImpl:1030 - Can't handle ServiceComponentHostEvent event at current state, serviceComponentName=TEZ_CLIENT, hostName=nvmd1cbb150d00.ril.com, currentState=INSTALLED, eventType=HOST_SVCCOMP_OP_FAILED, event=EventType: HOST_SVCCOMP_OP_FAILED 31 May 2017 17:27:37,514 ERROR [ambari-action-scheduler] ServiceComponentHostImpl:1030 - Can't handle ServiceComponentHostEvent event at current state, serviceComponentName=YARN_CLIENT, hostName=nvmd1cbb150d00.ril.com, currentState=INSTALLED, eventType=HOST_SVCCOMP_OP_FAILED, event=EventType: HOST_SVCCOMP_OP_FAILED 31 May 2017 17:27:37,514 ERROR [ambari-action-scheduler] ServiceComponentHostImpl:1030 - Can't handle ServiceComponentHostEvent event at current state, serviceComponentName=ZOOKEEPER_CLIENT, hostName=nvmd1cbb150d00.ril.com, currentState=INSTALLED, eventType=HOST_SVCCOMP_OP_FAILED, event=EventType: HOST_SVCCOMP_OP_FAILED 31 May 2017 17:27:37,514 ERROR [ambari-action-scheduler] ServiceComponentHostImpl:1030 - Can't handle ServiceComponentHostEvent event at current state, serviceComponentName=ZOOKEEPER_SERVER, hostName=nvmd1cbb150d00.ril.com, currentState=STARTED, eventType=HOST_SVCCOMP_OP_FAILED, event=EventType: HOST_SVCCOMP_OP_FAILED 31 May 2017 17:27:37,517 INFO [ambari-action-scheduler] ActionDBAccessorImpl:196 - Aborting command. Hostname nvmd1cbb150d00.ril.com role DATANODE requestId null taskId 3517 stageId null 31 May 2017 17:27:37,517 INFO [ambari-action-scheduler] ActionDBAccessorImpl:196 - Aborting command. Hostname nvmd1cbb150d00.ril.com role HDFS_CLIENT requestId null taskId 3518 stageId null 31 May 2017 17:27:37,517 INFO [ambari-action-scheduler] ActionDBAccessorImpl:196 - Aborting command. Hostname nvmd1cbb150d00.ril.com role HISTORYSERVER requestId null taskId 3519 stageId null 31 May 2017 17:27:37,517 INFO [ambari-action-scheduler] ActionDBAccessorImpl:196 - Aborting command. Hostname nvmd1cbb150d00.ril.com role HIVE_CLIENT requestId null taskId 3520 stageId null 31 May 2017 17:27:37,517 INFO [ambari-action-scheduler] ActionDBAccessorImpl:196 - Aborting command. Hostname nvmd1cbb150d00.ril.com role MAPREDUCE2_CLIENT requestId null taskId 3521 stageId null 31 May 2017 17:27:37,517 INFO [ambari-action-scheduler] ActionDBAccessorImpl:196 - Aborting command. Hostname nvmd1cbb150d00.ril.com role METRICS_MONITOR requestId null taskId 3522 stageId null 31 May 2017 17:27:37,518 INFO [ambari-action-scheduler] ActionDBAccessorImpl:196 - Aborting command. Hostname nvmd1cbb150d00.ril.com role MYSQL_SERVER requestId null taskId 3523 stageId null 31 May 2017 17:27:37,518 INFO [ambari-action-scheduler] ActionDBAccessorImpl:196 - Aborting command. Hostname nvmd1cbb150d00.ril.com role NODEMANAGER requestId null taskId 3524 stageId null 31 May 2017 17:27:37,518 INFO [ambari-action-scheduler] ActionDBAccessorImpl:196 - Aborting command. Hostname nvmd1cbb150d00.ril.com role OOZIE_SERVER requestId null taskId 3525 stageId null 31 May 2017 17:27:37,518 INFO [ambari-action-scheduler] ActionDBAccessorImpl:196 - Aborting command. Hostname nvmd1cbb150d00.ril.com role PHOENIX_QUERY_SERVER requestId null taskId 3526 stageId null 31 May 2017 17:27:37,518 INFO [ambari-action-scheduler] ActionDBAccessorImpl:196 - Aborting command. Hostname nvmd1cbb150d00.ril.com role PIG requestId null taskId 3527 stageId null 31 May 2017 17:27:37,518 INFO [ambari-action-scheduler] ActionDBAccessorImpl:196 - Aborting command. Hostname nvmd1cbb150d00.ril.com role RESOURCEMANAGER requestId null taskId 3528 stageId null 31 May 2017 17:27:37,518 INFO [ambari-action-scheduler] ActionDBAccessorImpl:196 - Aborting command. Hostname nvmd1cbb150d00.ril.com role SECONDARY_NAMENODE requestId null taskId 3529 stageId null 31 May 2017 17:27:37,518 INFO [ambari-action-scheduler] ActionDBAccessorImpl:196 - Aborting command. Hostname nvmd1cbb150d00.ril.com role SPARK_THRIFTSERVER requestId null taskId 3530 stageId null 31 May 2017 17:27:37,518 INFO [ambari-action-scheduler] ActionDBAccessorImpl:196 - Aborting command. Hostname nvmd1cbb150d00.ril.com role TEZ_CLIENT requestId null taskId 3531 stageId null 31 May 2017 17:27:37,518 INFO [ambari-action-scheduler] ActionDBAccessorImpl:196 - Aborting command. Hostname nvmd1cbb150d00.ril.com role YARN_CLIENT requestId null taskId 3532 stageId null 31 May 2017 17:27:37,519 INFO [ambari-action-scheduler] ActionDBAccessorImpl:196 - Aborting command. Hostname nvmd1cbb150d00.ril.com role ZOOKEEPER_CLIENT requestId null taskId 3533 stageId null 31 May 2017 17:27:37,519 INFO [ambari-action-scheduler] ActionDBAccessorImpl:196 - Aborting command. Hostname nvmd1cbb150d00.ril.com role ZOOKEEPER_SERVER requestId null taskId 3534 stageId null 31 May 2017 17:27:37,519 INFO [ambari-action-scheduler] ActionDBAccessorImpl:196 - Aborting command. Hostname nvmd1cbb150d00.ril.com role HIVE_METASTORE requestId null taskId 3535 stageId null 31 May 2017 17:27:37,519 INFO [ambari-action-scheduler] ActionDBAccessorImpl:196 - Aborting command. Hostname nvmd1cbb150d00.ril.com role HIVE_SERVER requestId null taskId 3536 stageId null 31 May 2017 17:27:37,519 INFO [ambari-action-scheduler] ActionDBAccessorImpl:196 - Aborting command. Hostname nvmd1cbb150d00.ril.com role WEBHCAT_SERVER requestId null taskId 3537 stageId null 31 May 2017 17:32:33,240 INFO [qtp-ambari-client-36596] AmbariManagementControllerImpl:3385 - Received action execution request, clusterName=rrahdpqa, request=isCommand :true, action :null, command :RESTART, inputs :{}, resourceFilters: [RequestResourceFilter{serviceName='YARN', componentName='APP_TIMELINE_SERVER', hostNames=[nvmd1cbb150d00.ril.com]}, RequestResourceFilter{serviceName='HDFS', componentName='DATANODE', hostNames=[nvmd1cbb150d00.ril.com]}, RequestResourceFilter{serviceName='HDFS', componentName='HDFS_CLIENT', hostNames=[nvmd1cbb150d00.ril.com]}, RequestResourceFilter{serviceName='MAPREDUCE2', componentName='HISTORYSERVER', hostNames=[nvmd1cbb150d00.ril.com]}, RequestResourceFilter{serviceName='HIVE', componentName='HIVE_CLIENT', hostNames=[nvmd1cbb150d00.ril.com]}, RequestResourceFilter{serviceName='HIVE', componentName='HIVE_METASTORE', hostNames=[nvmd1cbb150d00.ril.com]}, RequestResourceFilter{serviceName='HIVE', componentName='HIVE_SERVER', hostNames=[nvmd1cbb150d00.ril.com]}, RequestResourceFilter{serviceName='MAPREDUCE2', componentName='MAPREDUCE2_CLIENT', hostNames=[nvmd1cbb150d00.ril.com]}, RequestResourceFilter{serviceName='AMBARI_METRICS', componentName='METRICS_MONITOR', hostNames=[nvmd1cbb150d00.ril.com]}, RequestResourceFilter{serviceName='HIVE', componentName='MYSQL_SERVER', hostNames=[nvmd1cbb150d00.ril.com]}, RequestResourceFilter{serviceName='YARN', componentName='NODEMANAGER', hostNames=[nvmd1cbb150d00.ril.com]}, RequestResourceFilter{serviceName='OOZIE', componentName='OOZIE_SERVER', hostNames=[nvmd1cbb150d00.ril.com]}, RequestResourceFilter{serviceName='HBASE', componentName='PHOENIX_QUERY_SERVER', hostNames=[nvmd1cbb150d00.ril.com]}, RequestResourceFilter{serviceName='PIG', componentName='PIG', hostNames=[nvmd1cbb150d00.ril.com]}, RequestResourceFilter{serviceName='YARN', componentName='RESOURCEMANAGER', hostNames=[nvmd1cbb150d00.ril.com]}, RequestResourceFilter{serviceName='HDFS', componentName='SECONDARY_NAMENODE', hostNames=[nvmd1cbb150d00.ril.com]}, RequestResourceFilter{serviceName='SPARK', componentName='SPARK_THRIFTSERVER', hostNames=[nvmd1cbb150d00.ril.com]}, RequestResourceFilter{serviceName='TEZ', componentName='TEZ_CLIENT', hostNames=[nvmd1cbb150d00.ril.com]}, RequestResourceFilter{serviceName='HIVE', componentName='WEBHCAT_SERVER', hostNames=[nvmd1cbb150d00.ril.com]}, RequestResourceFilter{serviceName='YARN', componentName='YARN_CLIENT', hostNames=[nvmd1cbb150d00.ril.com]}, RequestResourceFilter{serviceName='ZOOKEEPER', componentName='ZOOKEEPER_CLIENT', hostNames=[nvmd1cbb150d00.ril.com]}, RequestResourceFilter{serviceName='ZOOKEEPER', componentName='ZOOKEEPER_SERVER', hostNames=[nvmd1cbb150d00.ril.com]}], exclusive: false, clusterName :rrahdpqa 31 May 2017 17:32:33,246 INFO [qtp-ambari-client-36596] AmbariCustomCommandExecutionHelper:1135 - Iterating service type Instance in getCommandJson:: SQOOP 31 May 2017 17:32:33,247 INFO [qtp-ambari-client-36596] AmbariCustomCommandExecutionHelper:1135 - Iterating service type Instance in getCommandJson:: HDFS 31 May 2017 17:32:33,247 INFO [qtp-ambari-client-36596] AmbariCustomCommandExecutionHelper:1135 - Iterating service type Instance in getCommandJson:: MAPREDUCE2 31 May 2017 17:32:33,248 INFO [qtp-ambari-client-36596] AmbariCustomCommandExecutionHelper:1135 - Iterating service type Instance in getCommandJson:: OOZIE 31 May 2017 17:32:33,248 INFO [qtp-ambari-client-36596] AmbariCustomCommandExecutionHelper:1135 - Iterating service type Instance in getCommandJson:: TEZ 31 May 2017 17:32:33,248 INFO [qtp-ambari-client-36596] AmbariCustomCommandExecutionHelper:1135 - Iterating service type Instance in getCommandJson:: SPARK 31 May 2017 17:32:33,249 INFO [qtp-ambari-client-36596] AmbariCustomCommandExecutionHelper:1135 - Iterating service type Instance in getCommandJson:: HBASE 31 May 2017 17:32:33,249 INFO [qtp-ambari-client-36596] AmbariCustomCommandExecutionHelper:1135 - Iterating service type Instance in getCommandJson:: ZOOKEEPER 31 May 2017 17:32:33,250 INFO [qtp-ambari-client-36596] AmbariCustomCommandExecutionHelper:1135 - Iterating service type Instance in getCommandJson:: YARN 31 May 2017 17:32:33,250 INFO [qtp-ambari-client-36596] AmbariCustomCommandExecutionHelper:1135 - Iterating service type Instance in getCommandJson:: PIG 31 May 2017 17:32:33,251 INFO [qtp-ambari-client-36596] AmbariCustomCommandExecutionHelper:1135 - Iterating service type Instance in getCommandJson:: HIVE 31 May 2017 17:32:33,251 INFO [qtp-ambari-client-36596] AmbariCustomCommandExecutionHelper:1135 - Iterating service type Instance in getCommandJson:: AMBARI_METRICS 31 May 2017 17:32:34,160 INFO [qtp-ambari-agent-36590] HeartBeatHandler:309 - HeartBeatHandler.sendCommands: sending ExecutionCommand for host nvmd1cbb150d00.ril.com, role APP_TIMELINE_SERVER, roleCommand CUSTOM_COMMAND, and command ID 339-0, task ID 3538 31 May 2017 17:32:34,161 INFO [qtp-ambari-agent-36590] HeartBeatHandler:309 - HeartBeatHandler.sendCommands: sending ExecutionCommand for host nvmd1cbb150d00.ril.com, role DATANODE, roleCommand CUSTOM_COMMAND, and command ID 339-0, task ID 3539 31 May 2017 17:32:34,162 INFO [qtp-ambari-agent-36590] HeartBeatHandler:309 - HeartBeatHandler.sendCommands: sending ExecutionCommand for host nvmd1cbb150d00.ril.com, role HDFS_CLIENT, roleCommand CUSTOM_COMMAND, and command ID 339-0, task ID 3540 31 May 2017 17:32:34,162 INFO [qtp-ambari-agent-36590] HeartBeatHandler:309 - HeartBeatHandler.sendCommands: sending ExecutionCommand for host nvmd1cbb150d00.ril.com, role HISTORYSERVER, roleCommand CUSTOM_COMMAND, and command ID 339-0, task ID 3541 31 May 2017 17:32:34,162 INFO [qtp-ambari-agent-36590] HeartBeatHandler:309 - HeartBeatHandler.sendCommands: sending ExecutionCommand for host nvmd1cbb150d00.ril.com, role HIVE_CLIENT, roleCommand CUSTOM_COMMAND, and command ID 339-0, task ID 3542 31 May 2017 17:32:34,163 INFO [qtp-ambari-agent-36590] HeartBeatHandler:309 - HeartBeatHandler.sendCommands: sending ExecutionCommand for host nvmd1cbb150d00.ril.com, role MAPREDUCE2_CLIENT, roleCommand CUSTOM_COMMAND, and command ID 339-0, task ID 3543 31 May 2017 17:32:34,163 INFO [qtp-ambari-agent-36590] HeartBeatHandler:309 - HeartBeatHandler.sendCommands: sending ExecutionCommand for host nvmd1cbb150d00.ril.com, role METRICS_MONITOR, roleCommand CUSTOM_COMMAND, and command ID 339-0, task ID 3544 31 May 2017 17:32:34,163 INFO [qtp-ambari-agent-36590] HeartBeatHandler:309 - HeartBeatHandler.sendCommands: sending ExecutionCommand for host nvmd1cbb150d00.ril.com, role MYSQL_SERVER, roleCommand CUSTOM_COMMAND, and command ID 339-0, task ID 3545 31 May 2017 17:32:34,163 INFO [qtp-ambari-agent-36590] HeartBeatHandler:309 - HeartBeatHandler.sendCommands: sending ExecutionCommand for host nvmd1cbb150d00.ril.com, role NODEMANAGER, roleCommand CUSTOM_COMMAND, and command ID 339-0, task ID 3546 31 May 2017 17:32:34,164 INFO [qtp-ambari-agent-36590] HeartBeatHandler:309 - HeartBeatHandler.sendCommands: sending ExecutionCommand for host nvmd1cbb150d00.ril.com, role OOZIE_SERVER, roleCommand CUSTOM_COMMAND, and command ID 339-0, task ID 3547 31 May 2017 17:32:34,164 INFO [qtp-ambari-agent-36590] HeartBeatHandler:309 - HeartBeatHandler.sendCommands: sending ExecutionCommand for host nvmd1cbb150d00.ril.com, role PHOENIX_QUERY_SERVER, roleCommand CUSTOM_COMMAND, and command ID 339-0, task ID 3548 31 May 2017 17:32:34,164 INFO [qtp-ambari-agent-36590] HeartBeatHandler:309 - HeartBeatHandler.sendCommands: sending ExecutionCommand for host nvmd1cbb150d00.ril.com, role PIG, roleCommand CUSTOM_COMMAND, and command ID 339-0, task ID 3549 31 May 2017 17:32:34,164 INFO [qtp-ambari-agent-36590] HeartBeatHandler:309 - HeartBeatHandler.sendCommands: sending ExecutionCommand for host nvmd1cbb150d00.ril.com, role RESOURCEMANAGER, roleCommand CUSTOM_COMMAND, and command ID 339-0, task ID 3550 31 May 2017 17:32:34,165 INFO [qtp-ambari-agent-36590] HeartBeatHandler:309 - HeartBeatHandler.sendCommands: sending ExecutionCommand for host nvmd1cbb150d00.ril.com, role SECONDARY_NAMENODE, roleCommand CUSTOM_COMMAND, and command ID 339-0, task ID 3551 31 May 2017 17:32:34,165 INFO [qtp-ambari-agent-36590] HeartBeatHandler:309 - HeartBeatHandler.sendCommands: sending ExecutionCommand for host nvmd1cbb150d00.ril.com, role SPARK_THRIFTSERVER, roleCommand CUSTOM_COMMAND, and command ID 339-0, task ID 3552 31 May 2017 17:32:34,165 INFO [qtp-ambari-agent-36590] HeartBeatHandler:309 - HeartBeatHandler.sendCommands: sending ExecutionCommand for host nvmd1cbb150d00.ril.com, role TEZ_CLIENT, roleCommand CUSTOM_COMMAND, and command ID 339-0, task ID 3553 31 May 2017 17:32:34,165 INFO [qtp-ambari-agent-36590] HeartBeatHandler:309 - HeartBeatHandler.sendCommands: sending ExecutionCommand for host nvmd1cbb150d00.ril.com, role YARN_CLIENT, roleCommand CUSTOM_COMMAND, and command ID 339-0, task ID 3554 31 May 2017 17:32:34,166 INFO [qtp-ambari-agent-36590] HeartBeatHandler:309 - HeartBeatHandler.sendCommands: sending ExecutionCommand for host nvmd1cbb150d00.ril.com, role ZOOKEEPER_CLIENT, roleCommand CUSTOM_COMMAND, and command ID 339-0, task ID 3555 31 May 2017 17:32:34,166 INFO [qtp-ambari-agent-36590] HeartBeatHandler:309 - HeartBeatHandler.sendCommands: sending ExecutionCommand for host nvmd1cbb150d00.ril.com, role ZOOKEEPER_SERVER, roleCommand CUSTOM_COMMAND, and command ID 339-0, task ID 3556 31 May 2017 17:32:41,014 INFO [ambari-heartbeat-processor-0] HeartbeatProcessor:496 - Updating applied config on service YARN, component APP_TIMELINE_SERVER, host nvmd1cbb150d00.ril.com 31 May 2017 17:32:47,001 INFO [ambari-heartbeat-processor-0] HeartbeatProcessor:496 - Updating applied config on service HDFS, component DATANODE, host nvmd1cbb150d00.ril.com 31 May 2017 17:32:48,999 INFO [ambari-heartbeat-processor-0] HeartbeatProcessor:496 - Updating applied config on service HDFS, component HDFS_CLIENT, host nvmd1cbb150d00.ril.com 31 May 2017 17:32:59,002 INFO [ambari-heartbeat-processor-0] HeartbeatProcessor:496 - Updating applied config on service MAPREDUCE2, component HISTORYSERVER, host nvmd1cbb150d00.ril.com 31 May 2017 17:33:01,999 INFO [ambari-heartbeat-processor-0] HeartbeatProcessor:496 - Updating applied config on service HIVE, component HIVE_CLIENT, host nvmd1cbb150d00.ril.com 31 May 2017 17:33:05,000 INFO [ambari-heartbeat-processor-0] HeartbeatProcessor:496 - Updating applied config on service MAPREDUCE2, component MAPREDUCE2_CLIENT, host nvmd1cbb150d00.ril.com 31 May 2017 17:33:13,994 INFO [ambari-heartbeat-processor-0] HeartbeatProcessor:496 - Updating applied config on service AMBARI_METRICS, component METRICS_MONITOR, host nvmd1cbb150d00.ril.com 31 May 2017 17:33:22,993 INFO [ambari-heartbeat-processor-0] HeartbeatProcessor:496 - Updating applied config on service HIVE, component MYSQL_SERVER, host nvmd1cbb150d00.ril.com 31 May 2017 17:33:32,999 INFO [ambari-heartbeat-processor-0] HeartbeatProcessor:496 - Updating applied config on service YARN, component NODEMANAGER, host nvmd1cbb150d00.ril.com 31 May 2017 17:33:34,001 INFO [ambari-heartbeat-processor-0] HeartbeatProcessor:603 - State of service component APP_TIMELINE_SERVER of service YARN of cluster rrahdpqa has changed from INSTALLED to STARTED at host nvmd1cbb150d00.ril.com according to STATUS_COMMAND report 31 May 2017 17:33:34,004 INFO [ambari-heartbeat-processor-0] HeartbeatProcessor:603 - State of service component DATANODE of service HDFS of cluster rrahdpqa has changed from INSTALLED to STARTED at host nvmd1cbb150d00.ril.com according to STATUS_COMMAND report 31 May 2017 17:33:48,108 INFO [AlertNoticeDispatchService RUNNING] AlertNoticeDispatchService:279 - There are 2 pending alert notices about to be dispatched... 31 May 2017 17:33:48,114 INFO [alert-dispatch-13] EmailDispatcher:94 - Sending email: Notification{ type=ALERT, subject=Alert Summary: OK[2], Warning[0], Critical[0], Unknown[0]} 31 May 2017 17:33:51,999 INFO [ambari-heartbeat-processor-0] HeartbeatProcessor:496 - Updating applied config on service OOZIE, component OOZIE_SERVER, host nvmd1cbb150d00.ril.com 31 May 2017 17:33:54,000 INFO [ambari-heartbeat-processor-0] HeartbeatProcessor:496 - Updating applied config on service HBASE, component PHOENIX_QUERY_SERVER, host nvmd1cbb150d00.ril.com 31 May 2017 17:33:55,998 INFO [ambari-heartbeat-processor-0] HeartbeatProcessor:496 - Updating applied config on service PIG, component PIG, host nvmd1cbb150d00.ril.com 31 May 2017 17:34:04,999 INFO [ambari-heartbeat-processor-0] HeartbeatProcessor:496 - Updating applied config on service YARN, component RESOURCEMANAGER, host nvmd1cbb150d00.ril.com 31 May 2017 17:34:16,999 INFO [ambari-heartbeat-processor-0] HeartbeatProcessor:496 - Updating applied config on service HDFS, component SECONDARY_NAMENODE, host nvmd1cbb150d00.ril.com 31 May 2017 17:34:22,007 INFO [ambari-heartbeat-processor-0] HeartbeatProcessor:496 - Updating applied config on service SPARK, component SPARK_THRIFTSERVER, host nvmd1cbb150d00.ril.com 31 May 2017 17:34:24,000 INFO [ambari-heartbeat-processor-0] HeartbeatProcessor:496 - Updating applied config on service TEZ, component TEZ_CLIENT, host nvmd1cbb150d00.ril.com 31 May 2017 17:34:27,000 INFO [ambari-heartbeat-processor-0] HeartbeatProcessor:496 - Updating applied config on service YARN, component YARN_CLIENT, host nvmd1cbb150d00.ril.com 31 May 2017 17:34:28,999 INFO [ambari-heartbeat-processor-0] HeartbeatProcessor:496 - Updating applied config on service ZOOKEEPER, component ZOOKEEPER_CLIENT, host nvmd1cbb150d00.ril.com 31 May 2017 17:34:31,998 INFO [ambari-heartbeat-processor-0] HeartbeatProcessor:496 - Updating applied config on service ZOOKEEPER, component ZOOKEEPER_SERVER, host nvmd1cbb150d00.ril.com 31 May 2017 17:34:42,096 INFO [qtp-ambari-agent-36622] HeartBeatHandler:309 - HeartBeatHandler.sendCommands: sending ExecutionCommand for host nvmd1cbb150d00.ril.com, role HIVE_METASTORE, roleCommand CUSTOM_COMMAND, and command ID 339-1, task ID 3557 31 May 2017 17:34:42,096 INFO [qtp-ambari-agent-36622] HeartBeatHandler:309 - HeartBeatHandler.sendCommands: sending ExecutionCommand for host nvmd1cbb150d00.ril.com, role HIVE_SERVER, roleCommand CUSTOM_COMMAND, and command ID 339-1, task ID 3558 31 May 2017 17:34:57,000 INFO [ambari-heartbeat-processor-0] HeartbeatProcessor:496 - Updating applied config on service HIVE, component HIVE_METASTORE, host nvmd1cbb150d00.ril.com 31 May 2017 17:35:13,999 INFO [ambari-heartbeat-processor-0] HeartbeatProcessor:496 - Updating applied config on service HIVE, component HIVE_SERVER, host nvmd1cbb150d00.ril.com 31 May 2017 17:35:23,455 INFO [qtp-ambari-agent-36622] HeartBeatHandler:309 - HeartBeatHandler.sendCommands: sending ExecutionCommand for host nvmd1cbb150d00.ril.com, role WEBHCAT_SERVER, roleCommand CUSTOM_COMMAND, and command ID 339-2, task ID 3559 31 May 2017 17:35:48,114 INFO [AlertNoticeDispatchService RUNNING] AlertNoticeDispatchService:279 - There are 1 pending alert notices about to be dispatched... 31 May 2017 17:35:48,119 INFO [alert-dispatch-13] EmailDispatcher:94 - Sending email: Notification{ type=ALERT, subject=Alert Summary: OK[1], Warning[0], Critical[0], Unknown[0]} 31 May 2017 17:35:48,999 INFO [ambari-heartbeat-processor-0] HeartbeatProcessor:496 - Updating applied config on service HIVE, component WEBHCAT_SERVER, host nvmd1cbb150d00.ril.com 01 Jun 2017 12:05:36,743 ERROR [pool-9-thread-26927] BaseProvider:240 - Caught exception getting JMX metrics : Connection refused, skipping same exceptions for next 5 minutes java.net.ConnectException: Connection refused at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:589) at sun.net.NetworkClient.doConnect(NetworkClient.java:175) at sun.net.www.http.HttpClient.openServer(HttpClient.java:432) at sun.net.www.http.HttpClient.openServer(HttpClient.java:527) at sun.net.www.http.HttpClient.(HttpClient.java:211) at sun.net.www.http.HttpClient.New(HttpClient.java:308) at sun.net.www.http.HttpClient.New(HttpClient.java:326) at sun.net.www.protocol.http.HttpURLConnection.getNewHttpClient(HttpURLConnection.java:1169) at sun.net.www.protocol.http.HttpURLConnection.plainConnect0(HttpURLConnection.java:1105) at sun.net.www.protocol.http.HttpURLConnection.plainConnect(HttpURLConnection.java:999) at sun.net.www.protocol.http.HttpURLConnection.connect(HttpURLConnection.java:933) at sun.net.www.protocol.http.HttpURLConnection.getInputStream0(HttpURLConnection.java:1513) at sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1441) at java.net.HttpURLConnection.getResponseCode(HttpURLConnection.java:480) at org.apache.ambari.server.controller.internal.URLStreamProvider.processURL(URLStreamProvider.java:209) at org.apache.ambari.server.controller.internal.URLStreamProvider.processURL(URLStreamProvider.java:133) at org.apache.ambari.server.controller.internal.URLStreamProvider.readFrom(URLStreamProvider.java:107) at org.apache.ambari.server.controller.internal.URLStreamProvider.readFrom(URLStreamProvider.java:112) at org.apache.ambari.server.controller.jmx.JMXPropertyProvider.populateResource(JMXPropertyProvider.java:212) at org.apache.ambari.server.controller.metrics.ThreadPoolEnabledPropertyProvider$1.call(ThreadPoolEnabledPropertyProvider.java:180) at org.apache.ambari.server.controller.metrics.ThreadPoolEnabledPropertyProvider$1.call(ThreadPoolEnabledPropertyProvider.java:178) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 02 Jun 2017 13:41:29,585 ERROR [pool-9-thread-27056] BaseProvider:240 - Caught exception getting JMX metrics : Connection refused, skipping same exceptions for next 5 minutes java.net.ConnectException: Connection refused at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:589) at sun.net.NetworkClient.doConnect(NetworkClient.java:175) at sun.net.www.http.HttpClient.openServer(HttpClient.java:432) at sun.net.www.http.HttpClient.openServer(HttpClient.java:527) at sun.net.www.http.HttpClient.(HttpClient.java:211) at sun.net.www.http.HttpClient.New(HttpClient.java:308) at sun.net.www.http.HttpClient.New(HttpClient.java:326) at sun.net.www.protocol.http.HttpURLConnection.getNewHttpClient(HttpURLConnection.java:1169) at sun.net.www.protocol.http.HttpURLConnection.plainConnect0(HttpURLConnection.java:1105) at sun.net.www.protocol.http.HttpURLConnection.plainConnect(HttpURLConnection.java:999) at sun.net.www.protocol.http.HttpURLConnection.connect(HttpURLConnection.java:933) at sun.net.www.protocol.http.HttpURLConnection.getInputStream0(HttpURLConnection.java:1513) at sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1441) at java.net.HttpURLConnection.getResponseCode(HttpURLConnection.java:480) at org.apache.ambari.server.controller.internal.URLStreamProvider.processURL(URLStreamProvider.java:209) at org.apache.ambari.server.controller.internal.URLStreamProvider.processURL(URLStreamProvider.java:133) at org.apache.ambari.server.controller.internal.URLStreamProvider.readFrom(URLStreamProvider.java:107) at org.apache.ambari.server.controller.internal.URLStreamProvider.readFrom(URLStreamProvider.java:112) at org.apache.ambari.server.controller.jmx.JMXPropertyProvider.populateResource(JMXPropertyProvider.java:212) at org.apache.ambari.server.controller.metrics.ThreadPoolEnabledPropertyProvider$1.call(ThreadPoolEnabledPropertyProvider.java:180) at org.apache.ambari.server.controller.metrics.ThreadPoolEnabledPropertyProvider$1.call(ThreadPoolEnabledPropertyProvider.java:178) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 02 Jun 2017 15:48:34,512 ERROR [pool-9-thread-28067] BaseProvider:240 - Caught exception getting JMX metrics : Connection refused, skipping same exceptions for next 5 minutes java.net.ConnectException: Connection refused at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:589) at sun.net.NetworkClient.doConnect(NetworkClient.java:175) at sun.net.www.http.HttpClient.openServer(HttpClient.java:432) at sun.net.www.http.HttpClient.openServer(HttpClient.java:527) at sun.net.www.http.HttpClient.(HttpClient.java:211) at sun.net.www.http.HttpClient.New(HttpClient.java:308) at sun.net.www.http.HttpClient.New(HttpClient.java:326) at sun.net.www.protocol.http.HttpURLConnection.getNewHttpClient(HttpURLConnection.java:1169) at sun.net.www.protocol.http.HttpURLConnection.plainConnect0(HttpURLConnection.java:1105) at sun.net.www.protocol.http.HttpURLConnection.plainConnect(HttpURLConnection.java:999) at sun.net.www.protocol.http.HttpURLConnection.connect(HttpURLConnection.java:933) at sun.net.www.protocol.http.HttpURLConnection.getInputStream0(HttpURLConnection.java:1513) at sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1441) at java.net.HttpURLConnection.getResponseCode(HttpURLConnection.java:480) at org.apache.ambari.server.controller.internal.URLStreamProvider.processURL(URLStreamProvider.java:209) at org.apache.ambari.server.controller.internal.URLStreamProvider.processURL(URLStreamProvider.java:133) at org.apache.ambari.server.controller.internal.URLStreamProvider.readFrom(URLStreamProvider.java:107) at org.apache.ambari.server.controller.internal.URLStreamProvider.readFrom(URLStreamProvider.java:112) at org.apache.ambari.server.controller.jmx.JMXPropertyProvider.populateResource(JMXPropertyProvider.java:212) at org.apache.ambari.server.controller.metrics.ThreadPoolEnabledPropertyProvider$1.call(ThreadPoolEnabledPropertyProvider.java:180) at org.apache.ambari.server.controller.metrics.ThreadPoolEnabledPropertyProvider$1.call(ThreadPoolEnabledPropertyProvider.java:178) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 05 Jun 2017 15:38:48,691 ERROR [pool-9-thread-28525] BaseProvider:240 - Caught exception getting JMX metrics : Connection refused, skipping same exceptions for next 5 minutes java.net.ConnectException: Connection refused at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:589) at sun.net.NetworkClient.doConnect(NetworkClient.java:175) at sun.net.www.http.HttpClient.openServer(HttpClient.java:432) at sun.net.www.http.HttpClient.openServer(HttpClient.java:527) at sun.net.www.http.HttpClient.(HttpClient.java:211) at sun.net.www.http.HttpClient.New(HttpClient.java:308) at sun.net.www.http.HttpClient.New(HttpClient.java:326) at sun.net.www.protocol.http.HttpURLConnection.getNewHttpClient(HttpURLConnection.java:1169) at sun.net.www.protocol.http.HttpURLConnection.plainConnect0(HttpURLConnection.java:1105) at sun.net.www.protocol.http.HttpURLConnection.plainConnect(HttpURLConnection.java:999) at sun.net.www.protocol.http.HttpURLConnection.connect(HttpURLConnection.java:933) at sun.net.www.protocol.http.HttpURLConnection.getInputStream0(HttpURLConnection.java:1513) at sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1441) at java.net.HttpURLConnection.getResponseCode(HttpURLConnection.java:480) at org.apache.ambari.server.controller.internal.URLStreamProvider.processURL(URLStreamProvider.java:209) at org.apache.ambari.server.controller.internal.URLStreamProvider.processURL(URLStreamProvider.java:133) at org.apache.ambari.server.controller.internal.URLStreamProvider.readFrom(URLStreamProvider.java:107) at org.apache.ambari.server.controller.internal.URLStreamProvider.readFrom(URLStreamProvider.java:112) at org.apache.ambari.server.controller.jmx.JMXPropertyProvider.populateResource(JMXPropertyProvider.java:212) at org.apache.ambari.server.controller.metrics.ThreadPoolEnabledPropertyProvider$1.call(ThreadPoolEnabledPropertyProvider.java:180) at org.apache.ambari.server.controller.metrics.ThreadPoolEnabledPropertyProvider$1.call(ThreadPoolEnabledPropertyProvider.java:178) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 05 Jun 2017 17:11:39,808 ERROR [pool-9-thread-28596] BaseProvider:240 - Caught exception getting JMX metrics : Connection refused, skipping same exceptions for next 5 minutes java.net.ConnectException: Connection refused at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:589) at sun.net.NetworkClient.doConnect(NetworkClient.java:175) at sun.net.www.http.HttpClient.openServer(HttpClient.java:432) at sun.net.www.http.HttpClient.openServer(HttpClient.java:527) at sun.net.www.http.HttpClient.(HttpClient.java:211) at sun.net.www.http.HttpClient.New(HttpClient.java:308) at sun.net.www.http.HttpClient.New(HttpClient.java:326) at sun.net.www.protocol.http.HttpURLConnection.getNewHttpClient(HttpURLConnection.java:1169) at sun.net.www.protocol.http.HttpURLConnection.plainConnect0(HttpURLConnection.java:1105) at sun.net.www.protocol.http.HttpURLConnection.plainConnect(HttpURLConnection.java:999) at sun.net.www.protocol.http.HttpURLConnection.connect(HttpURLConnection.java:933) at sun.net.www.protocol.http.HttpURLConnection.getInputStream0(HttpURLConnection.java:1513) at sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1441) at java.net.HttpURLConnection.getResponseCode(HttpURLConnection.java:480) at org.apache.ambari.server.controller.internal.URLStreamProvider.processURL(URLStreamProvider.java:209) at org.apache.ambari.server.controller.internal.URLStreamProvider.processURL(URLStreamProvider.java:133) at org.apache.ambari.server.controller.internal.URLStreamProvider.readFrom(URLStreamProvider.java:107) at org.apache.ambari.server.controller.internal.URLStreamProvider.readFrom(URLStreamProvider.java:112) at org.apache.ambari.server.controller.jmx.JMXPropertyProvider.populateResource(JMXPropertyProvider.java:212) at org.apache.ambari.server.controller.metrics.ThreadPoolEnabledPropertyProvider$1.call(ThreadPoolEnabledPropertyProvider.java:180) at org.apache.ambari.server.controller.metrics.ThreadPoolEnabledPropertyProvider$1.call(ThreadPoolEnabledPropertyProvider.java:178) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 05 Jun 2017 21:28:11,320 WARN [ambari-hearbeat-monitor] HeartbeatMonitor:157 - Heartbeat lost from host nvmd1cbb190d00.ril.com 05 Jun 2017 21:28:11,322 INFO [ambari-hearbeat-monitor] TopologyManager:387 - Hearbeat for host nvmd1cbb190d00.ril.com lost thus removing it from available hosts. 05 Jun 2017 21:28:11,322 WARN [ambari-hearbeat-monitor] HeartbeatMonitor:172 - Setting component state to UNKNOWN for component METRICS_MONITOR on nvmd1cbb190d00.ril.com 05 Jun 2017 21:28:11,324 WARN [ambari-hearbeat-monitor] HeartbeatMonitor:172 - Setting component state to UNKNOWN for component METRICS_COLLECTOR on nvmd1cbb190d00.ril.com 05 Jun 2017 21:28:11,325 WARN [ambari-hearbeat-monitor] HeartbeatMonitor:172 - Setting component state to UNKNOWN for component HBASE_REGIONSERVER on nvmd1cbb190d00.ril.com 05 Jun 2017 21:28:11,326 WARN [ambari-hearbeat-monitor] HeartbeatMonitor:172 - Setting component state to UNKNOWN for component PHOENIX_QUERY_SERVER on nvmd1cbb190d00.ril.com 05 Jun 2017 21:28:11,328 WARN [ambari-hearbeat-monitor] HeartbeatMonitor:172 - Setting component state to UNKNOWN for component DATANODE on nvmd1cbb190d00.ril.com 05 Jun 2017 21:28:11,329 WARN [ambari-hearbeat-monitor] HeartbeatMonitor:172 - Setting component state to UNKNOWN for component NFS_GATEWAY on nvmd1cbb190d00.ril.com 05 Jun 2017 21:28:11,330 WARN [ambari-hearbeat-monitor] HeartbeatMonitor:172 - Setting component state to UNKNOWN for component SPARK_THRIFTSERVER on nvmd1cbb190d00.ril.com 05 Jun 2017 21:28:11,331 WARN [ambari-hearbeat-monitor] HeartbeatMonitor:172 - Setting component state to UNKNOWN for component NODEMANAGER on nvmd1cbb190d00.ril.com 05 Jun 2017 21:28:11,333 WARN [ambari-hearbeat-monitor] HeartbeatMonitor:172 - Setting component state to UNKNOWN for component ZOOKEEPER_SERVER on nvmd1cbb190d00.ril.com 05 Jun 2017 21:28:19,152 INFO [AlertNoticeDispatchService RUNNING] AlertNoticeDispatchService:279 - There are 3 pending alert notices about to be dispatched... 05 Jun 2017 21:28:19,160 INFO [alert-dispatch-14] EmailDispatcher:94 - Sending email: Notification{ type=ALERT, subject=Alert Summary: OK[0], Warning[0], Critical[3], Unknown[0]} 06 Jun 2017 10:48:53,703 INFO [qtp-ambari-client-71178] MetricsPropertyProvider:554 - METRICS_COLLECTOR host is not live. Skip populating resources with metrics, next message will be logged after 1000 attempts. 06 Jun 2017 10:48:54,799 ERROR [pool-9-thread-28669] BaseProvider:240 - Caught exception getting JMX metrics : Connection refused, skipping same exceptions for next 5 minutes java.net.ConnectException: Connection refused at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:589) at sun.net.NetworkClient.doConnect(NetworkClient.java:175) at sun.net.www.http.HttpClient.openServer(HttpClient.java:432) at sun.net.www.http.HttpClient.openServer(HttpClient.java:527) at sun.net.www.http.HttpClient.(HttpClient.java:211) at sun.net.www.http.HttpClient.New(HttpClient.java:308) at sun.net.www.http.HttpClient.New(HttpClient.java:326) at sun.net.www.protocol.http.HttpURLConnection.getNewHttpClient(HttpURLConnection.java:1169) at sun.net.www.protocol.http.HttpURLConnection.plainConnect0(HttpURLConnection.java:1105) at sun.net.www.protocol.http.HttpURLConnection.plainConnect(HttpURLConnection.java:999) at sun.net.www.protocol.http.HttpURLConnection.connect(HttpURLConnection.java:933) at sun.net.www.protocol.http.HttpURLConnection.getInputStream0(HttpURLConnection.java:1513) at sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1441) at java.net.HttpURLConnection.getResponseCode(HttpURLConnection.java:480) at org.apache.ambari.server.controller.internal.URLStreamProvider.processURL(URLStreamProvider.java:209) at org.apache.ambari.server.controller.internal.URLStreamProvider.processURL(URLStreamProvider.java:133) at org.apache.ambari.server.controller.internal.URLStreamProvider.readFrom(URLStreamProvider.java:107) at org.apache.ambari.server.controller.internal.URLStreamProvider.readFrom(URLStreamProvider.java:112) at org.apache.ambari.server.controller.jmx.JMXPropertyProvider.populateResource(JMXPropertyProvider.java:212) at org.apache.ambari.server.controller.metrics.ThreadPoolEnabledPropertyProvider$1.call(ThreadPoolEnabledPropertyProvider.java:180) at org.apache.ambari.server.controller.metrics.ThreadPoolEnabledPropertyProvider$1.call(ThreadPoolEnabledPropertyProvider.java:178) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 06 Jun 2017 10:48:57,799 ERROR [pool-9-thread-28670] BaseProvider:240 - Caught exception getting JMX metrics : No route to host, skipping same exceptions for next 5 minutes java.net.NoRouteToHostException: No route to host at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:589) at sun.net.NetworkClient.doConnect(NetworkClient.java:175) at sun.net.www.http.HttpClient.openServer(HttpClient.java:432) at sun.net.www.http.HttpClient.openServer(HttpClient.java:527) at sun.net.www.http.HttpClient.(HttpClient.java:211) at sun.net.www.http.HttpClient.New(HttpClient.java:308) at sun.net.www.http.HttpClient.New(HttpClient.java:326) at sun.net.www.protocol.http.HttpURLConnection.getNewHttpClient(HttpURLConnection.java:1169) at sun.net.www.protocol.http.HttpURLConnection.plainConnect0(HttpURLConnection.java:1105) at sun.net.www.protocol.http.HttpURLConnection.plainConnect(HttpURLConnection.java:999) at sun.net.www.protocol.http.HttpURLConnection.connect(HttpURLConnection.java:933) at sun.net.www.protocol.http.HttpURLConnection.getInputStream0(HttpURLConnection.java:1513) at sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1441) at java.net.HttpURLConnection.getResponseCode(HttpURLConnection.java:480) at org.apache.ambari.server.controller.internal.URLStreamProvider.processURL(URLStreamProvider.java:209) at org.apache.ambari.server.controller.internal.URLStreamProvider.processURL(URLStreamProvider.java:133) at org.apache.ambari.server.controller.internal.URLStreamProvider.readFrom(URLStreamProvider.java:107) at org.apache.ambari.server.controller.internal.URLStreamProvider.readFrom(URLStreamProvider.java:112) at org.apache.ambari.server.controller.jmx.JMXPropertyProvider.populateResource(JMXPropertyProvider.java:212) at org.apache.ambari.server.controller.metrics.ThreadPoolEnabledPropertyProvider$1.call(ThreadPoolEnabledPropertyProvider.java:180) at org.apache.ambari.server.controller.metrics.ThreadPoolEnabledPropertyProvider$1.call(ThreadPoolEnabledPropertyProvider.java:178) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 06 Jun 2017 10:48:59,821 ERROR [pool-9-thread-28660] BaseProvider:240 - Caught exception getting JMX metrics : connect timed out, skipping same exceptions for next 5 minutes java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:589) at sun.net.NetworkClient.doConnect(NetworkClient.java:175) at sun.net.www.http.HttpClient.openServer(HttpClient.java:432) at sun.net.www.http.HttpClient.openServer(HttpClient.java:527) at sun.net.www.http.HttpClient.(HttpClient.java:211) at sun.net.www.http.HttpClient.New(HttpClient.java:308) at sun.net.www.http.HttpClient.New(HttpClient.java:326) at sun.net.www.protocol.http.HttpURLConnection.getNewHttpClient(HttpURLConnection.java:1169) at sun.net.www.protocol.http.HttpURLConnection.plainConnect0(HttpURLConnection.java:1105) at sun.net.www.protocol.http.HttpURLConnection.plainConnect(HttpURLConnection.java:999) at sun.net.www.protocol.http.HttpURLConnection.connect(HttpURLConnection.java:933) at sun.net.www.protocol.http.HttpURLConnection.getInputStream0(HttpURLConnection.java:1513) at sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1441) at java.net.HttpURLConnection.getResponseCode(HttpURLConnection.java:480) at org.apache.ambari.server.controller.internal.URLStreamProvider.processURL(URLStreamProvider.java:209) at org.apache.ambari.server.controller.internal.URLStreamProvider.processURL(URLStreamProvider.java:133) at org.apache.ambari.server.controller.internal.URLStreamProvider.readFrom(URLStreamProvider.java:107) at org.apache.ambari.server.controller.internal.URLStreamProvider.readFrom(URLStreamProvider.java:112) at org.apache.ambari.server.controller.jmx.JMXPropertyProvider.populateResource(JMXPropertyProvider.java:212) at org.apache.ambari.server.controller.metrics.ThreadPoolEnabledPropertyProvider$1.call(ThreadPoolEnabledPropertyProvider.java:180) at org.apache.ambari.server.controller.metrics.ThreadPoolEnabledPropertyProvider$1.call(ThreadPoolEnabledPropertyProvider.java:178) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 06 Jun 2017 11:17:50,301 INFO [qtp-ambari-client-71287] AbstractProviderModule:878 - Current Metrics collector Host : null 06 Jun 2017 11:17:50,302 INFO [qtp-ambari-client-71287] AbstractProviderModule:883 - New Metrics collector Host : nvmd1cbb190d00.ril.com 06 Jun 2017 11:19:00,216 ERROR [pool-9-thread-28690] BaseProvider:240 - Caught exception getting JMX metrics : Connection refused, skipping same exceptions for next 5 minutes java.net.ConnectException: Connection refused at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:589) at sun.net.NetworkClient.doConnect(NetworkClient.java:175) at sun.net.www.http.HttpClient.openServer(HttpClient.java:432) at sun.net.www.http.HttpClient.openServer(HttpClient.java:527) at sun.net.www.http.HttpClient.(HttpClient.java:211) at sun.net.www.http.HttpClient.New(HttpClient.java:308) at sun.net.www.http.HttpClient.New(HttpClient.java:326) at sun.net.www.protocol.http.HttpURLConnection.getNewHttpClient(HttpURLConnection.java:1169) at sun.net.www.protocol.http.HttpURLConnection.plainConnect0(HttpURLConnection.java:1105) at sun.net.www.protocol.http.HttpURLConnection.plainConnect(HttpURLConnection.java:999) at sun.net.www.protocol.http.HttpURLConnection.connect(HttpURLConnection.java:933) at sun.net.www.protocol.http.HttpURLConnection.getInputStream0(HttpURLConnection.java:1513) at sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1441) at java.net.HttpURLConnection.getResponseCode(HttpURLConnection.java:480) at org.apache.ambari.server.controller.internal.URLStreamProvider.processURL(URLStreamProvider.java:209) at org.apache.ambari.server.controller.internal.URLStreamProvider.processURL(URLStreamProvider.java:133) at org.apache.ambari.server.controller.internal.URLStreamProvider.readFrom(URLStreamProvider.java:107) at org.apache.ambari.server.controller.internal.URLStreamProvider.readFrom(URLStreamProvider.java:112) at org.apache.ambari.server.controller.jmx.JMXPropertyProvider.populateResource(JMXPropertyProvider.java:212) at org.apache.ambari.server.controller.metrics.ThreadPoolEnabledPropertyProvider$1.call(ThreadPoolEnabledPropertyProvider.java:180) at org.apache.ambari.server.controller.metrics.ThreadPoolEnabledPropertyProvider$1.call(ThreadPoolEnabledPropertyProvider.java:178) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 06 Jun 2017 11:19:03,215 ERROR [pool-9-thread-28689] BaseProvider:240 - Caught exception getting JMX metrics : No route to host, skipping same exceptions for next 5 minutes java.net.NoRouteToHostException: No route to host at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:589) at sun.net.NetworkClient.doConnect(NetworkClient.java:175) at sun.net.www.http.HttpClient.openServer(HttpClient.java:432) at sun.net.www.http.HttpClient.openServer(HttpClient.java:527) at sun.net.www.http.HttpClient.(HttpClient.java:211) at sun.net.www.http.HttpClient.New(HttpClient.java:308) at sun.net.www.http.HttpClient.New(HttpClient.java:326) at sun.net.www.protocol.http.HttpURLConnection.getNewHttpClient(HttpURLConnection.java:1169) at sun.net.www.protocol.http.HttpURLConnection.plainConnect0(HttpURLConnection.java:1105) at sun.net.www.protocol.http.HttpURLConnection.plainConnect(HttpURLConnection.java:999) at sun.net.www.protocol.http.HttpURLConnection.connect(HttpURLConnection.java:933) at sun.net.www.protocol.http.HttpURLConnection.getInputStream0(HttpURLConnection.java:1513) at sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1441) at java.net.HttpURLConnection.getResponseCode(HttpURLConnection.java:480) at org.apache.ambari.server.controller.internal.URLStreamProvider.processURL(URLStreamProvider.java:209) at org.apache.ambari.server.controller.internal.URLStreamProvider.processURL(URLStreamProvider.java:133) at org.apache.ambari.server.controller.internal.URLStreamProvider.readFrom(URLStreamProvider.java:107) at org.apache.ambari.server.controller.internal.URLStreamProvider.readFrom(URLStreamProvider.java:112) at org.apache.ambari.server.controller.jmx.JMXPropertyProvider.populateResource(JMXPropertyProvider.java:212) at org.apache.ambari.server.controller.metrics.ThreadPoolEnabledPropertyProvider$1.call(ThreadPoolEnabledPropertyProvider.java:180) at org.apache.ambari.server.controller.metrics.ThreadPoolEnabledPropertyProvider$1.call(ThreadPoolEnabledPropertyProvider.java:178) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 06 Jun 2017 11:19:05,240 ERROR [pool-9-thread-28683] BaseProvider:240 - Caught exception getting JMX metrics : connect timed out, skipping same exceptions for next 5 minutes java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:589) at sun.net.NetworkClient.doConnect(NetworkClient.java:175) at sun.net.www.http.HttpClient.openServer(HttpClient.java:432) at sun.net.www.http.HttpClient.openServer(HttpClient.java:527) at sun.net.www.http.HttpClient.(HttpClient.java:211) at sun.net.www.http.HttpClient.New(HttpClient.java:308) at sun.net.www.http.HttpClient.New(HttpClient.java:326) at sun.net.www.protocol.http.HttpURLConnection.getNewHttpClient(HttpURLConnection.java:1169) at sun.net.www.protocol.http.HttpURLConnection.plainConnect0(HttpURLConnection.java:1105) at sun.net.www.protocol.http.HttpURLConnection.plainConnect(HttpURLConnection.java:999) at sun.net.www.protocol.http.HttpURLConnection.connect(HttpURLConnection.java:933) at sun.net.www.protocol.http.HttpURLConnection.getInputStream0(HttpURLConnection.java:1513) at sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1441) at java.net.HttpURLConnection.getResponseCode(HttpURLConnection.java:480) at org.apache.ambari.server.controller.internal.URLStreamProvider.processURL(URLStreamProvider.java:209) at org.apache.ambari.server.controller.internal.URLStreamProvider.processURL(URLStreamProvider.java:133) at org.apache.ambari.server.controller.internal.URLStreamProvider.readFrom(URLStreamProvider.java:107) at org.apache.ambari.server.controller.internal.URLStreamProvider.readFrom(URLStreamProvider.java:112) at org.apache.ambari.server.controller.jmx.JMXPropertyProvider.populateResource(JMXPropertyProvider.java:212) at org.apache.ambari.server.controller.metrics.ThreadPoolEnabledPropertyProvider$1.call(ThreadPoolEnabledPropertyProvider.java:180) at org.apache.ambari.server.controller.metrics.ThreadPoolEnabledPropertyProvider$1.call(ThreadPoolEnabledPropertyProvider.java:178) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 06 Jun 2017 11:24:23,067 INFO [AlertNoticeDispatchService RUNNING] AlertNoticeDispatchService:279 - There are 1 pending alert notices about to be dispatched... 06 Jun 2017 11:24:23,071 INFO [alert-dispatch-15] EmailDispatcher:94 - Sending email: Notification{ type=ALERT, subject=Alert Summary: OK[1], Warning[0], Critical[0], Unknown[0]} 06 Jun 2017 11:27:19,681 ERROR [pool-9-thread-28891] BaseProvider:240 - Caught exception getting JMX metrics : Connection refused, skipping same exceptions for next 5 minutes java.net.ConnectException: Connection refused at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:589) at sun.net.NetworkClient.doConnect(NetworkClient.java:175) at sun.net.www.http.HttpClient.openServer(HttpClient.java:432) at sun.net.www.http.HttpClient.openServer(HttpClient.java:527) at sun.net.www.http.HttpClient.(HttpClient.java:211) at sun.net.www.http.HttpClient.New(HttpClient.java:308) at sun.net.www.http.HttpClient.New(HttpClient.java:326) at sun.net.www.protocol.http.HttpURLConnection.getNewHttpClient(HttpURLConnection.java:1169) at sun.net.www.protocol.http.HttpURLConnection.plainConnect0(HttpURLConnection.java:1105) at sun.net.www.protocol.http.HttpURLConnection.plainConnect(HttpURLConnection.java:999) at sun.net.www.protocol.http.HttpURLConnection.connect(HttpURLConnection.java:933) at sun.net.www.protocol.http.HttpURLConnection.getInputStream0(HttpURLConnection.java:1513) at sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1441) at java.net.HttpURLConnection.getResponseCode(HttpURLConnection.java:480) at org.apache.ambari.server.controller.internal.URLStreamProvider.processURL(URLStreamProvider.java:209) at org.apache.ambari.server.controller.internal.URLStreamProvider.processURL(URLStreamProvider.java:133) at org.apache.ambari.server.controller.internal.URLStreamProvider.readFrom(URLStreamProvider.java:107) at org.apache.ambari.server.controller.internal.URLStreamProvider.readFrom(URLStreamProvider.java:112) at org.apache.ambari.server.controller.jmx.JMXPropertyProvider.populateResource(JMXPropertyProvider.java:212) at org.apache.ambari.server.controller.metrics.ThreadPoolEnabledPropertyProvider$1.call(ThreadPoolEnabledPropertyProvider.java:180) at org.apache.ambari.server.controller.metrics.ThreadPoolEnabledPropertyProvider$1.call(ThreadPoolEnabledPropertyProvider.java:178) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 06 Jun 2017 11:27:22,682 ERROR [pool-9-thread-28884] BaseProvider:240 - Caught exception getting JMX metrics : No route to host, skipping same exceptions for next 5 minutes java.net.NoRouteToHostException: No route to host at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:589) at sun.net.NetworkClient.doConnect(NetworkClient.java:175) at sun.net.www.http.HttpClient.openServer(HttpClient.java:432) at sun.net.www.http.HttpClient.openServer(HttpClient.java:527) at sun.net.www.http.HttpClient.(HttpClient.java:211) at sun.net.www.http.HttpClient.New(HttpClient.java:308) at sun.net.www.http.HttpClient.New(HttpClient.java:326) at sun.net.www.protocol.http.HttpURLConnection.getNewHttpClient(HttpURLConnection.java:1169) at sun.net.www.protocol.http.HttpURLConnection.plainConnect0(HttpURLConnection.java:1105) at sun.net.www.protocol.http.HttpURLConnection.plainConnect(HttpURLConnection.java:999) at sun.net.www.protocol.http.HttpURLConnection.connect(HttpURLConnection.java:933) at sun.net.www.protocol.http.HttpURLConnection.getInputStream0(HttpURLConnection.java:1513) at sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1441) at java.net.HttpURLConnection.getResponseCode(HttpURLConnection.java:480) at org.apache.ambari.server.controller.internal.URLStreamProvider.processURL(URLStreamProvider.java:209) at org.apache.ambari.server.controller.internal.URLStreamProvider.processURL(URLStreamProvider.java:133) at org.apache.ambari.server.controller.internal.URLStreamProvider.readFrom(URLStreamProvider.java:107) at org.apache.ambari.server.controller.internal.URLStreamProvider.readFrom(URLStreamProvider.java:112) at org.apache.ambari.server.controller.jmx.JMXPropertyProvider.populateResource(JMXPropertyProvider.java:212) at org.apache.ambari.server.controller.metrics.ThreadPoolEnabledPropertyProvider$1.call(ThreadPoolEnabledPropertyProvider.java:180) at org.apache.ambari.server.controller.metrics.ThreadPoolEnabledPropertyProvider$1.call(ThreadPoolEnabledPropertyProvider.java:178) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 06 Jun 2017 11:28:11,845 ERROR [pool-9-thread-28886] BaseProvider:240 - Caught exception getting JMX metrics : connect timed out, skipping same exceptions for next 5 minutes java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:589) at sun.net.NetworkClient.doConnect(NetworkClient.java:175) at sun.net.www.http.HttpClient.openServer(HttpClient.java:432) at sun.net.www.http.HttpClient.openServer(HttpClient.java:527) at sun.net.www.http.HttpClient.(HttpClient.java:211) at sun.net.www.http.HttpClient.New(HttpClient.java:308) at sun.net.www.http.HttpClient.New(HttpClient.java:326) at sun.net.www.protocol.http.HttpURLConnection.getNewHttpClient(HttpURLConnection.java:1169) at sun.net.www.protocol.http.HttpURLConnection.plainConnect0(HttpURLConnection.java:1105) at sun.net.www.protocol.http.HttpURLConnection.plainConnect(HttpURLConnection.java:999) at sun.net.www.protocol.http.HttpURLConnection.connect(HttpURLConnection.java:933) at sun.net.www.protocol.http.HttpURLConnection.getInputStream0(HttpURLConnection.java:1513) at sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1441) at java.net.HttpURLConnection.getResponseCode(HttpURLConnection.java:480) at org.apache.ambari.server.controller.internal.URLStreamProvider.processURL(URLStreamProvider.java:209) at org.apache.ambari.server.controller.internal.URLStreamProvider.processURL(URLStreamProvider.java:133) at org.apache.ambari.server.controller.internal.URLStreamProvider.readFrom(URLStreamProvider.java:107) at org.apache.ambari.server.controller.internal.URLStreamProvider.readFrom(URLStreamProvider.java:112) at org.apache.ambari.server.controller.jmx.JMXPropertyProvider.populateResource(JMXPropertyProvider.java:212) at org.apache.ambari.server.controller.metrics.ThreadPoolEnabledPropertyProvider$1.call(ThreadPoolEnabledPropertyProvider.java:180) at org.apache.ambari.server.controller.metrics.ThreadPoolEnabledPropertyProvider$1.call(ThreadPoolEnabledPropertyProvider.java:178) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 06 Jun 2017 11:28:29,250 INFO [qtp-ambari-client-71527] AbstractProviderModule:878 - Current Metrics collector Host : null 06 Jun 2017 11:28:29,251 INFO [qtp-ambari-client-71527] AbstractProviderModule:883 - New Metrics collector Host : nvmd1cbb190d00.ril.com 06 Jun 2017 11:35:34,936 WARN [qtp-ambari-agent-71536] SecurityFilter:103 - Request https://nvmd1cbb210d00.ril.com:8440/ca doesn't match any pattern. 06 Jun 2017 11:35:34,937 WARN [qtp-ambari-agent-71536] SecurityFilter:62 - This request is not allowed on this port: https://nvmd1cbb210d00.ril.com:8440/ca 06 Jun 2017 11:35:37,673 INFO [qtp-ambari-agent-71540] HeartBeatHandler:402 - agentOsType = centos6 06 Jun 2017 11:35:37,690 INFO [qtp-ambari-agent-71540] HostImpl:285 - Received host registration, host=[hostname=nvmd1cbb190d00,fqdn=nvmd1cbb190d00.ril.com,domain=ril.com,architecture=x86_64,processorcount=20,physicalprocessorcount=20,osname=centos,osversion=6.2,osfamily=redhat,memory=132125420,uptime_hours=0,mounts=(available=82669264,mountpoint=/,used=15300176,percent=16%,size=103212320,device=/dev/mapper/vg_nvmbd01psr214-LogVol00,type=ext4)(available=66062708,mountpoint=/dev/shm,used=0,percent=0%,size=66062708,device=tmpfs,type=tmpfs)(available=919304,mountpoint=/boot,used=60356,percent=7%,size=1032088,device=/dev/sda1,type=ext4)(available=4625025484,mountpoint=/data1,used=1233165876,percent=22%,size=5858191360,device=/dev/mapper/datavg1-datalv1,type=xfs)(available=4632951500,mountpoint=/data2,used=1225239860,percent=21%,size=5858191360,device=/dev/mapper/datavg2-datalv2,type=xfs)] , registrationTime=1496729137673, agentVersion=2.2.2.0 06 Jun 2017 11:35:37,691 INFO [qtp-ambari-agent-71540] TopologyManager:311 - TopologyManager.onHostRegistered: Entering 06 Jun 2017 11:35:37,691 INFO [qtp-ambari-agent-71540] TopologyManager:313 - TopologyManager.onHostRegistered: host = nvmd1cbb190d00.ril.com is already associated with the cluster or is currently being processed 06 Jun 2017 11:35:37,710 INFO [qtp-ambari-agent-71540] HeartBeatHandler:469 - Recovery configuration set to RecoveryConfig{, type=AUTO_START, maxCount=6, windowInMinutes=60, retryGap=5, maxLifetimeCount=1024, disabledComponents=, enabledComponents=METRICS_COLLECTOR} 06 Jun 2017 11:35:50,465 INFO [ambari-heartbeat-processor-0] HeartbeatProcessor:603 - State of service component DATANODE of service HDFS of cluster rrahdpqa has changed from UNKNOWN to INSTALLED at host nvmd1cbb190d00.ril.com according to STATUS_COMMAND report 06 Jun 2017 11:35:50,468 INFO [ambari-heartbeat-processor-0] HeartbeatProcessor:603 - State of service component METRICS_COLLECTOR of service AMBARI_METRICS of cluster rrahdpqa has changed from UNKNOWN to INSTALLED at host nvmd1cbb190d00.ril.com according to STATUS_COMMAND report 06 Jun 2017 11:35:50,469 INFO [ambari-heartbeat-processor-0] HeartbeatProcessor:603 - State of service component NFS_GATEWAY of service HDFS of cluster rrahdpqa has changed from UNKNOWN to INSTALLED at host nvmd1cbb190d00.ril.com according to STATUS_COMMAND report 06 Jun 2017 11:35:50,471 INFO [ambari-heartbeat-processor-0] HeartbeatProcessor:603 - State of service component HBASE_REGIONSERVER of service HBASE of cluster rrahdpqa has changed from UNKNOWN to INSTALLED at host nvmd1cbb190d00.ril.com according to STATUS_COMMAND report 06 Jun 2017 11:35:50,473 INFO [ambari-heartbeat-processor-0] HeartbeatProcessor:603 - State of service component METRICS_MONITOR of service AMBARI_METRICS of cluster rrahdpqa has changed from UNKNOWN to INSTALLED at host nvmd1cbb190d00.ril.com according to STATUS_COMMAND report 06 Jun 2017 11:35:50,474 INFO [ambari-heartbeat-processor-0] HeartbeatProcessor:603 - State of service component PHOENIX_QUERY_SERVER of service HBASE of cluster rrahdpqa has changed from UNKNOWN to INSTALLED at host nvmd1cbb190d00.ril.com according to STATUS_COMMAND report 06 Jun 2017 11:35:50,476 INFO [ambari-heartbeat-processor-0] HeartbeatProcessor:603 - State of service component SPARK_THRIFTSERVER of service SPARK of cluster rrahdpqa has changed from UNKNOWN to INSTALLED at host nvmd1cbb190d00.ril.com according to STATUS_COMMAND report 06 Jun 2017 11:35:50,477 INFO [ambari-heartbeat-processor-0] HeartbeatProcessor:603 - State of service component ZOOKEEPER_SERVER of service ZOOKEEPER of cluster rrahdpqa has changed from UNKNOWN to INSTALLED at host nvmd1cbb190d00.ril.com according to STATUS_COMMAND report 06 Jun 2017 11:35:50,479 INFO [ambari-heartbeat-processor-0] HeartbeatProcessor:603 - State of service component NODEMANAGER of service YARN of cluster rrahdpqa has changed from UNKNOWN to INSTALLED at host nvmd1cbb190d00.ril.com according to STATUS_COMMAND report 06 Jun 2017 11:35:52,831 INFO [ambari-hearbeat-monitor] HeartbeatMonitor:311 - METRICS_COLLECTOR is at INSTALLED adding more payload per agent ask from nvmd1cbb190d00.ril.com 06 Jun 2017 11:35:52,845 INFO [ambari-hearbeat-monitor] AmbariManagementControllerImpl:1935 - Adding service type info in createHostAction:: null 06 Jun 2017 11:35:52,845 INFO [ambari-hearbeat-monitor] AmbariManagementControllerImpl:1952 - Iterating service type Instance in createHostAction:: SQOOP 06 Jun 2017 11:35:52,845 INFO [ambari-hearbeat-monitor] AmbariManagementControllerImpl:1952 - Iterating service type Instance in createHostAction:: HDFS 06 Jun 2017 11:35:52,845 INFO [ambari-hearbeat-monitor] AmbariManagementControllerImpl:1952 - Iterating service type Instance in createHostAction:: MAPREDUCE2 06 Jun 2017 11:35:52,845 INFO [ambari-hearbeat-monitor] AmbariManagementControllerImpl:1952 - Iterating service type Instance in createHostAction:: OOZIE 06 Jun 2017 11:35:52,845 INFO [ambari-hearbeat-monitor] AmbariManagementControllerImpl:1952 - Iterating service type Instance in createHostAction:: TEZ 06 Jun 2017 11:35:52,846 INFO [ambari-hearbeat-monitor] AmbariManagementControllerImpl:1952 - Iterating service type Instance in createHostAction:: SPARK 06 Jun 2017 11:35:52,846 INFO [ambari-hearbeat-monitor] AmbariManagementControllerImpl:1952 - Iterating service type Instance in createHostAction:: HBASE 06 Jun 2017 11:35:52,846 INFO [ambari-hearbeat-monitor] AmbariManagementControllerImpl:1952 - Iterating service type Instance in createHostAction:: ZOOKEEPER 06 Jun 2017 11:35:52,846 INFO [ambari-hearbeat-monitor] AmbariManagementControllerImpl:1952 - Iterating service type Instance in createHostAction:: YARN 06 Jun 2017 11:35:52,846 INFO [ambari-hearbeat-monitor] AmbariManagementControllerImpl:1952 - Iterating service type Instance in createHostAction:: PIG 06 Jun 2017 11:35:52,846 INFO [ambari-hearbeat-monitor] AmbariManagementControllerImpl:1952 - Iterating service type Instance in createHostAction:: HIVE 06 Jun 2017 11:35:52,846 INFO [ambari-hearbeat-monitor] AmbariManagementControllerImpl:1952 - Iterating service type Instance in createHostAction:: AMBARI_METRICS 06 Jun 2017 11:35:52,854 INFO [ambari-hearbeat-monitor] AmbariManagementControllerImpl:2107 - AmbariManagementControllerImpl.createHostAction: created ExecutionCommand for host nvmd1cbb190d00.ril.com, role METRICS_COLLECTOR, roleCommand START, and command ID 1-0, with cluster-env tags version1 06 Jun 2017 11:35:57,716 INFO [qtp-ambari-client-71539] AbstractProviderModule:354 - Metrics Collector Host or host component not live : nvmd1cbb190d00.ril.com 06 Jun 2017 11:35:57,717 INFO [qtp-ambari-client-71539] MetricsPropertyProvider:568 - METRICS_COLLECTOR is not live. Skip populating resources with metrics., next message will be logged after 1000 attempts. 06 Jun 2017 11:35:57,721 INFO [qtp-ambari-client-71539] AbstractProviderModule:354 - Metrics Collector Host or host component not live : nvmd1cbb190d00.ril.com 06 Jun 2017 11:35:57,724 INFO [qtp-ambari-client-71539] AbstractProviderModule:354 - Metrics Collector Host or host component not live : nvmd1cbb190d00.ril.com 06 Jun 2017 11:35:57,728 INFO [qtp-ambari-client-71539] AbstractProviderModule:354 - Metrics Collector Host or host component not live : nvmd1cbb190d00.ril.com 06 Jun 2017 11:36:33,754 INFO [qtp-ambari-client-71529] AbstractProviderModule:354 - Metrics Collector Host or host component not live : nvmd1cbb190d00.ril.com 06 Jun 2017 11:36:33,758 INFO [qtp-ambari-client-71529] AbstractProviderModule:354 - Metrics Collector Host or host component not live : nvmd1cbb190d00.ril.com 06 Jun 2017 11:36:33,761 INFO [qtp-ambari-client-71529] AbstractProviderModule:354 - Metrics Collector Host or host component not live : nvmd1cbb190d00.ril.com 06 Jun 2017 11:36:33,764 INFO [qtp-ambari-client-71529] AbstractProviderModule:354 - Metrics Collector Host or host component not live : nvmd1cbb190d00.ril.com 06 Jun 2017 11:36:49,466 INFO [ambari-heartbeat-processor-0] HeartbeatProcessor:603 - State of service component METRICS_COLLECTOR of service AMBARI_METRICS of cluster rrahdpqa has changed from INSTALLED to STARTED at host nvmd1cbb190d00.ril.com according to STATUS_COMMAND report 06 Jun 2017 11:40:29,849 INFO [qtp-ambari-client-71534] AbstractProviderModule:878 - Current Metrics collector Host : null 06 Jun 2017 11:40:29,850 INFO [qtp-ambari-client-71534] AbstractProviderModule:883 - New Metrics collector Host : nvmd1cbb190d00.ril.com 06 Jun 2017 11:40:45,158 INFO [qtp-ambari-client-71534] AmbariManagementControllerImpl:3385 - Received action execution request, clusterName=rrahdpqa, request=isCommand :true, action :null, command :RESTART, inputs :{}, resourceFilters: [RequestResourceFilter{serviceName='HDFS', componentName='DATANODE', hostNames=[nvmd1cbb190d00.ril.com]}, RequestResourceFilter{serviceName='HBASE', componentName='HBASE_REGIONSERVER', hostNames=[nvmd1cbb190d00.ril.com]}, RequestResourceFilter{serviceName='AMBARI_METRICS', componentName='METRICS_COLLECTOR', hostNames=[nvmd1cbb190d00.ril.com]}, RequestResourceFilter{serviceName='AMBARI_METRICS', componentName='METRICS_MONITOR', hostNames=[nvmd1cbb190d00.ril.com]}, RequestResourceFilter{serviceName='HDFS', componentName='NFS_GATEWAY', hostNames=[nvmd1cbb190d00.ril.com]}, RequestResourceFilter{serviceName='YARN', componentName='NODEMANAGER', hostNames=[nvmd1cbb190d00.ril.com]}, RequestResourceFilter{serviceName='HBASE', componentName='PHOENIX_QUERY_SERVER', hostNames=[nvmd1cbb190d00.ril.com]}, RequestResourceFilter{serviceName='SPARK', componentName='SPARK_THRIFTSERVER', hostNames=[nvmd1cbb190d00.ril.com]}, RequestResourceFilter{serviceName='ZOOKEEPER', componentName='ZOOKEEPER_SERVER', hostNames=[nvmd1cbb190d00.ril.com]}], exclusive: false, clusterName :rrahdpqa 06 Jun 2017 11:40:45,165 INFO [qtp-ambari-client-71534] AmbariCustomCommandExecutionHelper:1135 - Iterating service type Instance in getCommandJson:: SQOOP 06 Jun 2017 11:40:45,165 INFO [qtp-ambari-client-71534] AmbariCustomCommandExecutionHelper:1135 - Iterating service type Instance in getCommandJson:: HDFS 06 Jun 2017 11:40:45,166 INFO [qtp-ambari-client-71534] AmbariCustomCommandExecutionHelper:1135 - Iterating service type Instance in getCommandJson:: MAPREDUCE2 06 Jun 2017 11:40:45,166 INFO [qtp-ambari-client-71534] AmbariCustomCommandExecutionHelper:1135 - Iterating service type Instance in getCommandJson:: OOZIE 06 Jun 2017 11:40:45,167 INFO [qtp-ambari-client-71534] AmbariCustomCommandExecutionHelper:1135 - Iterating service type Instance in getCommandJson:: TEZ 06 Jun 2017 11:40:45,167 INFO [qtp-ambari-client-71534] AmbariCustomCommandExecutionHelper:1135 - Iterating service type Instance in getCommandJson:: SPARK 06 Jun 2017 11:40:45,167 INFO [qtp-ambari-client-71534] AmbariCustomCommandExecutionHelper:1135 - Iterating service type Instance in getCommandJson:: HBASE 06 Jun 2017 11:40:45,168 INFO [qtp-ambari-client-71534] AmbariCustomCommandExecutionHelper:1135 - Iterating service type Instance in getCommandJson:: ZOOKEEPER 06 Jun 2017 11:40:45,168 INFO [qtp-ambari-client-71534] AmbariCustomCommandExecutionHelper:1135 - Iterating service type Instance in getCommandJson:: YARN 06 Jun 2017 11:40:45,169 INFO [qtp-ambari-client-71534] AmbariCustomCommandExecutionHelper:1135 - Iterating service type Instance in getCommandJson:: PIG 06 Jun 2017 11:40:45,169 INFO [qtp-ambari-client-71534] AmbariCustomCommandExecutionHelper:1135 - Iterating service type Instance in getCommandJson:: HIVE 06 Jun 2017 11:40:45,170 INFO [qtp-ambari-client-71534] AmbariCustomCommandExecutionHelper:1135 - Iterating service type Instance in getCommandJson:: AMBARI_METRICS 06 Jun 2017 11:40:50,940 INFO [qtp-ambari-agent-71559] HeartBeatHandler:309 - HeartBeatHandler.sendCommands: sending ExecutionCommand for host nvmd1cbb190d00.ril.com, role DATANODE, roleCommand CUSTOM_COMMAND, and command ID 340-0, task ID 3560 06 Jun 2017 11:40:50,941 INFO [qtp-ambari-agent-71559] HeartBeatHandler:309 - HeartBeatHandler.sendCommands: sending ExecutionCommand for host nvmd1cbb190d00.ril.com, role HBASE_REGIONSERVER, roleCommand CUSTOM_COMMAND, and command ID 340-0, task ID 3561 06 Jun 2017 11:40:50,942 INFO [qtp-ambari-agent-71559] HeartBeatHandler:309 - HeartBeatHandler.sendCommands: sending ExecutionCommand for host nvmd1cbb190d00.ril.com, role METRICS_COLLECTOR, roleCommand CUSTOM_COMMAND, and command ID 340-0, task ID 3562 06 Jun 2017 11:40:50,942 INFO [qtp-ambari-agent-71559] HeartBeatHandler:309 - HeartBeatHandler.sendCommands: sending ExecutionCommand for host nvmd1cbb190d00.ril.com, role METRICS_MONITOR, roleCommand CUSTOM_COMMAND, and command ID 340-0, task ID 3563 06 Jun 2017 11:40:50,942 INFO [qtp-ambari-agent-71559] HeartBeatHandler:309 - HeartBeatHandler.sendCommands: sending ExecutionCommand for host nvmd1cbb190d00.ril.com, role NFS_GATEWAY, roleCommand CUSTOM_COMMAND, and command ID 340-0, task ID 3564 06 Jun 2017 11:40:50,943 INFO [qtp-ambari-agent-71559] HeartBeatHandler:309 - HeartBeatHandler.sendCommands: sending ExecutionCommand for host nvmd1cbb190d00.ril.com, role NODEMANAGER, roleCommand CUSTOM_COMMAND, and command ID 340-0, task ID 3565 06 Jun 2017 11:40:50,943 INFO [qtp-ambari-agent-71559] HeartBeatHandler:309 - HeartBeatHandler.sendCommands: sending ExecutionCommand for host nvmd1cbb190d00.ril.com, role PHOENIX_QUERY_SERVER, roleCommand CUSTOM_COMMAND, and command ID 340-0, task ID 3566 06 Jun 2017 11:40:50,943 INFO [qtp-ambari-agent-71559] HeartBeatHandler:309 - HeartBeatHandler.sendCommands: sending ExecutionCommand for host nvmd1cbb190d00.ril.com, role SPARK_THRIFTSERVER, roleCommand CUSTOM_COMMAND, and command ID 340-0, task ID 3567 06 Jun 2017 11:40:50,943 INFO [qtp-ambari-agent-71559] HeartBeatHandler:309 - HeartBeatHandler.sendCommands: sending ExecutionCommand for host nvmd1cbb190d00.ril.com, role ZOOKEEPER_SERVER, roleCommand CUSTOM_COMMAND, and command ID 340-0, task ID 3568 06 Jun 2017 11:40:58,471 INFO [ambari-heartbeat-processor-0] HeartbeatProcessor:496 - Updating applied config on service HDFS, component DATANODE, host nvmd1cbb190d00.ril.com 06 Jun 2017 11:41:01,470 INFO [ambari-heartbeat-processor-0] HeartbeatProcessor:496 - Updating applied config on service HBASE, component HBASE_REGIONSERVER, host nvmd1cbb190d00.ril.com 06 Jun 2017 11:41:01,480 INFO [ambari-heartbeat-processor-0] HeartbeatProcessor:603 - State of service component HBASE_REGIONSERVER of service HBASE of cluster rrahdpqa has changed from INSTALLED to STARTED at host nvmd1cbb190d00.ril.com according to STATUS_COMMAND report 06 Jun 2017 11:41:01,483 INFO [ambari-heartbeat-processor-0] HeartbeatProcessor:603 - State of service component DATANODE of service HDFS of cluster rrahdpqa has changed from INSTALLED to STARTED at host nvmd1cbb190d00.ril.com according to STATUS_COMMAND report 06 Jun 2017 11:41:05,730 ERROR [qtp-ambari-client-71548] MetricsRequestHelper:114 - Error getting timeline metrics : Connection refused 06 Jun 2017 11:41:06,327 ERROR [qtp-ambari-client-71544] MetricsRequestHelper:114 - Error getting timeline metrics : Connection refused 06 Jun 2017 11:41:06,498 ERROR [qtp-ambari-client-71534] MetricsRequestHelper:114 - Error getting timeline metrics : Connection refused 06 Jun 2017 11:41:10,615 ERROR [qtp-ambari-client-71534] MetricsRequestHelper:114 - Error getting timeline metrics : Connection refused 06 Jun 2017 11:41:12,462 ERROR [qtp-ambari-client-71534] MetricsRequestHelper:114 - Error getting timeline metrics : Connection refused 06 Jun 2017 11:41:12,595 ERROR [qtp-ambari-client-71544] MetricsRequestHelper:114 - Error getting timeline metrics : Connection refused 06 Jun 2017 11:41:13,399 ERROR [qtp-ambari-client-71548] MetricsRequestHelper:114 - Error getting timeline metrics : Connection refused 06 Jun 2017 11:41:18,594 ERROR [qtp-ambari-client-71548] MetricsRequestHelper:114 - Error getting timeline metrics : Connection refused 06 Jun 2017 11:41:18,746 ERROR [qtp-ambari-client-71534] MetricsRequestHelper:114 - Error getting timeline metrics : Connection refused 06 Jun 2017 11:41:20,716 ERROR [qtp-ambari-client-71544] MetricsRequestHelper:114 - Error getting timeline metrics : Connection refused 06 Jun 2017 11:41:23,177 ERROR [qtp-ambari-client-71534] MetricsRequestHelper:114 - Error getting timeline metrics : Connection refused 06 Jun 2017 11:41:24,719 ERROR [qtp-ambari-client-71544] MetricsRequestHelper:114 - Error getting timeline metrics : Connection refused 06 Jun 2017 11:41:24,924 ERROR [qtp-ambari-client-71544] MetricsRequestHelper:114 - Error getting timeline metrics : Connection refused 06 Jun 2017 11:41:26,513 ERROR [qtp-ambari-client-71544] MetricsRequestHelper:114 - Error getting timeline metrics : Connection refused 06 Jun 2017 11:41:30,465 INFO [ambari-heartbeat-processor-0] HeartbeatProcessor:496 - Updating applied config on service AMBARI_METRICS, component METRICS_COLLECTOR, host nvmd1cbb190d00.ril.com 06 Jun 2017 11:41:33,466 INFO [ambari-heartbeat-processor-0] HeartbeatProcessor:496 - Updating applied config on service AMBARI_METRICS, component METRICS_MONITOR, host nvmd1cbb190d00.ril.com 06 Jun 2017 11:41:40,471 INFO [ambari-heartbeat-processor-0] HeartbeatProcessor:496 - Updating applied config on service HDFS, component NFS_GATEWAY, host nvmd1cbb190d00.ril.com 06 Jun 2017 11:41:45,471 INFO [ambari-heartbeat-processor-0] HeartbeatProcessor:496 - Updating applied config on service YARN, component NODEMANAGER, host nvmd1cbb190d00.ril.com 06 Jun 2017 11:41:47,472 INFO [ambari-heartbeat-processor-0] HeartbeatProcessor:496 - Updating applied config on service HBASE, component PHOENIX_QUERY_SERVER, host nvmd1cbb190d00.ril.com 06 Jun 2017 11:41:51,472 INFO [ambari-heartbeat-processor-0] HeartbeatProcessor:496 - Updating applied config on service SPARK, component SPARK_THRIFTSERVER, host nvmd1cbb190d00.ril.com 06 Jun 2017 11:41:54,471 INFO [ambari-heartbeat-processor-0] HeartbeatProcessor:496 - Updating applied config on service ZOOKEEPER, component ZOOKEEPER_SERVER, host nvmd1cbb190d00.ril.com 06 Jun 2017 11:42:14,466 INFO [ambari-heartbeat-processor-0] HeartbeatProcessor:603 - State of service component NFS_GATEWAY of service HDFS of cluster rrahdpqa has changed from INSTALLED to STARTED at host nvmd1cbb190d00.ril.com according to STATUS_COMMAND report 06 Jun 2017 11:42:14,468 INFO [ambari-heartbeat-processor-0] HeartbeatProcessor:603 - State of service component ZOOKEEPER_SERVER of service ZOOKEEPER of cluster rrahdpqa has changed from INSTALLED to STARTED at host nvmd1cbb190d00.ril.com according to STATUS_COMMAND report 06 Jun 2017 11:42:14,469 INFO [ambari-heartbeat-processor-0] HeartbeatProcessor:603 - State of service component SPARK_THRIFTSERVER of service SPARK of cluster rrahdpqa has changed from INSTALLED to STARTED at host nvmd1cbb190d00.ril.com according to STATUS_COMMAND report 06 Jun 2017 11:42:14,471 INFO [ambari-heartbeat-processor-0] HeartbeatProcessor:603 - State of service component METRICS_MONITOR of service AMBARI_METRICS of cluster rrahdpqa has changed from INSTALLED to STARTED at host nvmd1cbb190d00.ril.com according to STATUS_COMMAND report 06 Jun 2017 11:42:14,473 INFO [ambari-heartbeat-processor-0] HeartbeatProcessor:603 - State of service component NODEMANAGER of service YARN of cluster rrahdpqa has changed from INSTALLED to STARTED at host nvmd1cbb190d00.ril.com according to STATUS_COMMAND report 06 Jun 2017 11:42:14,476 INFO [ambari-heartbeat-processor-0] HeartbeatProcessor:603 - State of service component PHOENIX_QUERY_SERVER of service HBASE of cluster rrahdpqa has changed from INSTALLED to STARTED at host nvmd1cbb190d00.ril.com according to STATUS_COMMAND report 06 Jun 2017 11:42:23,538 INFO [AlertNoticeDispatchService RUNNING] AlertNoticeDispatchService:279 - There are 7 pending alert notices about to be dispatched... 06 Jun 2017 11:42:23,548 INFO [alert-dispatch-16] EmailDispatcher:94 - Sending email: Notification{ type=ALERT, subject=Alert Summary: OK[7], Warning[0], Critical[0], Unknown[0]} 06 Jun 2017 11:43:24,510 ERROR [pool-9-thread-28897] BaseProvider:240 - Caught exception getting JMX metrics : Connection refused, skipping same exceptions for next 5 minutes java.net.ConnectException: Connection refused at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:589) at sun.net.NetworkClient.doConnect(NetworkClient.java:175) at sun.net.www.http.HttpClient.openServer(HttpClient.java:432) at sun.net.www.http.HttpClient.openServer(HttpClient.java:527) at sun.net.www.http.HttpClient.(HttpClient.java:211) at sun.net.www.http.HttpClient.New(HttpClient.java:308) at sun.net.www.http.HttpClient.New(HttpClient.java:326) at sun.net.www.protocol.http.HttpURLConnection.getNewHttpClient(HttpURLConnection.java:1169) at sun.net.www.protocol.http.HttpURLConnection.plainConnect0(HttpURLConnection.java:1105) at sun.net.www.protocol.http.HttpURLConnection.plainConnect(HttpURLConnection.java:999) at sun.net.www.protocol.http.HttpURLConnection.connect(HttpURLConnection.java:933) at sun.net.www.protocol.http.HttpURLConnection.getInputStream0(HttpURLConnection.java:1513) at sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1441) at java.net.HttpURLConnection.getResponseCode(HttpURLConnection.java:480) at org.apache.ambari.server.controller.internal.URLStreamProvider.processURL(URLStreamProvider.java:209) at org.apache.ambari.server.controller.internal.URLStreamProvider.processURL(URLStreamProvider.java:133) at org.apache.ambari.server.controller.internal.URLStreamProvider.readFrom(URLStreamProvider.java:107) at org.apache.ambari.server.controller.internal.URLStreamProvider.readFrom(URLStreamProvider.java:112) at org.apache.ambari.server.controller.jmx.JMXPropertyProvider.populateResource(JMXPropertyProvider.java:212) at org.apache.ambari.server.controller.metrics.ThreadPoolEnabledPropertyProvider$1.call(ThreadPoolEnabledPropertyProvider.java:180) at org.apache.ambari.server.controller.metrics.ThreadPoolEnabledPropertyProvider$1.call(ThreadPoolEnabledPropertyProvider.java:178) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 06 Jun 2017 11:44:23,550 INFO [AlertNoticeDispatchService RUNNING] AlertNoticeDispatchService:279 - There are 4 pending alert notices about to be dispatched... 06 Jun 2017 11:44:23,557 INFO [alert-dispatch-16] EmailDispatcher:94 - Sending email: Notification{ type=ALERT, subject=Alert Summary: OK[4], Warning[0], Critical[0], Unknown[0]} 06 Jun 2017 13:03:16,203 ERROR [pool-9-thread-29475] BaseProvider:240 - Caught exception getting JMX metrics : Connection refused, skipping same exceptions for next 5 minutes java.net.ConnectException: Connection refused at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:589) at sun.net.NetworkClient.doConnect(NetworkClient.java:175) at sun.net.www.http.HttpClient.openServer(HttpClient.java:432) at sun.net.www.http.HttpClient.openServer(HttpClient.java:527) at sun.net.www.http.HttpClient.(HttpClient.java:211) at sun.net.www.http.HttpClient.New(HttpClient.java:308) at sun.net.www.http.HttpClient.New(HttpClient.java:326) at sun.net.www.protocol.http.HttpURLConnection.getNewHttpClient(HttpURLConnection.java:1169) at sun.net.www.protocol.http.HttpURLConnection.plainConnect0(HttpURLConnection.java:1105) at sun.net.www.protocol.http.HttpURLConnection.plainConnect(HttpURLConnection.java:999) at sun.net.www.protocol.http.HttpURLConnection.connect(HttpURLConnection.java:933) at sun.net.www.protocol.http.HttpURLConnection.getInputStream0(HttpURLConnection.java:1513) at sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1441) at java.net.HttpURLConnection.getResponseCode(HttpURLConnection.java:480) at org.apache.ambari.server.controller.internal.URLStreamProvider.processURL(URLStreamProvider.java:209) at org.apache.ambari.server.controller.internal.URLStreamProvider.processURL(URLStreamProvider.java:133) at org.apache.ambari.server.controller.internal.URLStreamProvider.readFrom(URLStreamProvider.java:107) at org.apache.ambari.server.controller.internal.URLStreamProvider.readFrom(URLStreamProvider.java:112) at org.apache.ambari.server.controller.jmx.JMXPropertyProvider.populateResource(JMXPropertyProvider.java:212) at org.apache.ambari.server.controller.metrics.ThreadPoolEnabledPropertyProvider$1.call(ThreadPoolEnabledPropertyProvider.java:180) at org.apache.ambari.server.controller.metrics.ThreadPoolEnabledPropertyProvider$1.call(ThreadPoolEnabledPropertyProvider.java:178) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 06 Jun 2017 13:09:06,208 WARN [qtp-ambari-client-72504] ViewRegistry:855 - Could not find the cluster identified by rahdpdev. 06 Jun 2017 13:09:06,209 WARN [qtp-ambari-client-72504] ViewRegistry:855 - Could not find the cluster identified by rahdpdev. 06 Jun 2017 13:09:06,391 WARN [qtp-ambari-client-72498] ViewRegistry:855 - Could not find the cluster identified by rahdpdev. 06 Jun 2017 13:09:06,392 WARN [qtp-ambari-client-72498] ViewRegistry:855 - Could not find the cluster identified by rahdpdev. 06 Jun 2017 13:09:06,434 WARN [qtp-ambari-client-72498] ViewRegistry:855 - Could not find the cluster identified by rahdpdev. 06 Jun 2017 13:09:06,434 WARN [qtp-ambari-client-72498] ViewRegistry:855 - Could not find the cluster identified by rahdpdev. 06 Jun 2017 13:10:05,434 WARN [qtp-ambari-client-72497] ViewRegistry:855 - Could not find the cluster identified by rahdpdev. 06 Jun 2017 13:10:05,434 WARN [qtp-ambari-client-72497] ViewRegistry:855 - Could not find the cluster identified by rahdpdev. 06 Jun 2017 13:10:05,673 WARN [qtp-ambari-client-72498] ViewRegistry:855 - Could not find the cluster identified by rahdpdev. 06 Jun 2017 13:10:05,674 WARN [qtp-ambari-client-72498] ViewRegistry:855 - Could not find the cluster identified by rahdpdev. 06 Jun 2017 13:10:05,684 WARN [qtp-ambari-client-72497] ViewRegistry:855 - Could not find the cluster identified by rahdpdev. 06 Jun 2017 13:10:05,684 WARN [qtp-ambari-client-72497] ViewRegistry:855 - Could not find the cluster identified by rahdpdev. 06 Jun 2017 13:11:15,099 ERROR [pool-9-thread-29479] BaseProvider:240 - Caught exception getting JMX metrics : Connection refused, skipping same exceptions for next 5 minutes java.net.ConnectException: Connection refused at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:589) at sun.net.NetworkClient.doConnect(NetworkClient.java:175) at sun.net.www.http.HttpClient.openServer(HttpClient.java:432) at sun.net.www.http.HttpClient.openServer(HttpClient.java:527) at sun.net.www.http.HttpClient.(HttpClient.java:211) at sun.net.www.http.HttpClient.New(HttpClient.java:308) at sun.net.www.http.HttpClient.New(HttpClient.java:326) at sun.net.www.protocol.http.HttpURLConnection.getNewHttpClient(HttpURLConnection.java:1169) at sun.net.www.protocol.http.HttpURLConnection.plainConnect0(HttpURLConnection.java:1105) at sun.net.www.protocol.http.HttpURLConnection.plainConnect(HttpURLConnection.java:999) at sun.net.www.protocol.http.HttpURLConnection.connect(HttpURLConnection.java:933) at sun.net.www.protocol.http.HttpURLConnection.getInputStream0(HttpURLConnection.java:1513) at sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1441) at java.net.HttpURLConnection.getResponseCode(HttpURLConnection.java:480) at org.apache.ambari.server.controller.internal.URLStreamProvider.processURL(URLStreamProvider.java:209) at org.apache.ambari.server.controller.internal.URLStreamProvider.processURL(URLStreamProvider.java:133) at org.apache.ambari.server.controller.internal.URLStreamProvider.readFrom(URLStreamProvider.java:107) at org.apache.ambari.server.controller.internal.URLStreamProvider.readFrom(URLStreamProvider.java:112) at org.apache.ambari.server.controller.jmx.JMXPropertyProvider.populateResource(JMXPropertyProvider.java:212) at org.apache.ambari.server.controller.metrics.ThreadPoolEnabledPropertyProvider$1.call(ThreadPoolEnabledPropertyProvider.java:180) at org.apache.ambari.server.controller.metrics.ThreadPoolEnabledPropertyProvider$1.call(ThreadPoolEnabledPropertyProvider.java:178) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 07 Jun 2017 03:36:23,301 WARN [qtp-ambari-client-74351] AbstractHttpConnection:469 - Failed UTF-8 decode for request path, trying ISO-8859-1 07 Jun 2017 03:36:23,302 WARN [qtp-ambari-client-74351] AbstractHttpConnection:552 - %. java.lang.IllegalArgumentException: Bad % encoding: %. at org.eclipse.jetty.http.HttpURI.getDecodedPath(HttpURI.java:634) at org.eclipse.jetty.server.AbstractHttpConnection.handleRequest(AbstractHttpConnection.java:471) at org.eclipse.jetty.server.AbstractHttpConnection.headerComplete(AbstractHttpConnection.java:971) at org.eclipse.jetty.server.AbstractHttpConnection$RequestHandler.headerComplete(AbstractHttpConnection.java:1033) at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:644) at org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:235) at org.eclipse.jetty.server.AsyncHttpConnection.handle(AsyncHttpConnection.java:82) at org.eclipse.jetty.io.nio.SelectChannelEndPoint.handle(SelectChannelEndPoint.java:696) at org.eclipse.jetty.io.nio.SelectChannelEndPoint$1.run(SelectChannelEndPoint.java:53) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608) at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543) at java.lang.Thread.run(Thread.java:745) 07 Jun 2017 03:36:36,396 WARN [qtp-ambari-client-74352] AbstractHttpConnection:469 - Failed UTF-8 decode for request path, trying ISO-8859-1 07 Jun 2017 03:36:36,401 WARN [qtp-ambari-client-74351] AbstractHttpConnection:469 - Failed UTF-8 decode for request path, trying ISO-8859-1 07 Jun 2017 03:36:36,404 WARN [qtp-ambari-client-74352] AbstractHttpConnection:469 - Failed UTF-8 decode for request path, trying ISO-8859-1 07 Jun 2017 03:36:36,409 WARN [qtp-ambari-client-74351] AbstractHttpConnection:469 - Failed UTF-8 decode for request path, trying ISO-8859-1 07 Jun 2017 03:36:36,414 WARN [qtp-ambari-client-74352] AbstractHttpConnection:469 - Failed UTF-8 decode for request path, trying ISO-8859-1 07 Jun 2017 03:36:36,421 WARN [qtp-ambari-client-74351] AbstractHttpConnection:469 - Failed UTF-8 decode for request path, trying ISO-8859-1 07 Jun 2017 03:36:39,207 WARN [qtp-ambari-client-74352] AbstractHttpConnection:469 - Failed UTF-8 decode for request path, trying ISO-8859-1 07 Jun 2017 03:36:39,207 WARN [qtp-ambari-client-74352] AbstractHttpConnection:552 - /%NETHOOD%/ java.lang.NumberFormatException: NE at org.eclipse.jetty.util.TypeUtil.parseInt(TypeUtil.java:319) at org.eclipse.jetty.http.HttpURI.getDecodedPath(HttpURI.java:655) at org.eclipse.jetty.server.AbstractHttpConnection.handleRequest(AbstractHttpConnection.java:471) at org.eclipse.jetty.server.AbstractHttpConnection.headerComplete(AbstractHttpConnection.java:971) at org.eclipse.jetty.server.AbstractHttpConnection$RequestHandler.headerComplete(AbstractHttpConnection.java:1033) at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:644) at org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:235) at org.eclipse.jetty.server.AsyncHttpConnection.handle(AsyncHttpConnection.java:82) at org.eclipse.jetty.io.nio.SelectChannelEndPoint.handle(SelectChannelEndPoint.java:696) at org.eclipse.jetty.io.nio.SelectChannelEndPoint$1.run(SelectChannelEndPoint.java:53) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608) at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543) at java.lang.Thread.run(Thread.java:745) 07 Jun 2017 10:48:51,602 ERROR [pool-9-thread-29554] BaseProvider:240 - Caught exception getting JMX metrics : Connection refused, skipping same exceptions for next 5 minutes java.net.ConnectException: Connection refused at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:589) at sun.net.NetworkClient.doConnect(NetworkClient.java:175) at sun.net.www.http.HttpClient.openServer(HttpClient.java:432) at sun.net.www.http.HttpClient.openServer(HttpClient.java:527) at sun.net.www.http.HttpClient.(HttpClient.java:211) at sun.net.www.http.HttpClient.New(HttpClient.java:308) at sun.net.www.http.HttpClient.New(HttpClient.java:326) at sun.net.www.protocol.http.HttpURLConnection.getNewHttpClient(HttpURLConnection.java:1169) at sun.net.www.protocol.http.HttpURLConnection.plainConnect0(HttpURLConnection.java:1105) at sun.net.www.protocol.http.HttpURLConnection.plainConnect(HttpURLConnection.java:999) at sun.net.www.protocol.http.HttpURLConnection.connect(HttpURLConnection.java:933) at sun.net.www.protocol.http.HttpURLConnection.getInputStream0(HttpURLConnection.java:1513) at sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1441) at java.net.HttpURLConnection.getResponseCode(HttpURLConnection.java:480) at org.apache.ambari.server.controller.internal.URLStreamProvider.processURL(URLStreamProvider.java:209) at org.apache.ambari.server.controller.internal.URLStreamProvider.processURL(URLStreamProvider.java:133) at org.apache.ambari.server.controller.internal.URLStreamProvider.readFrom(URLStreamProvider.java:107) at org.apache.ambari.server.controller.internal.URLStreamProvider.readFrom(URLStreamProvider.java:112) at org.apache.ambari.server.controller.jmx.JMXPropertyProvider.populateResource(JMXPropertyProvider.java:212) at org.apache.ambari.server.controller.metrics.ThreadPoolEnabledPropertyProvider$1.call(ThreadPoolEnabledPropertyProvider.java:180) at org.apache.ambari.server.controller.metrics.ThreadPoolEnabledPropertyProvider$1.call(ThreadPoolEnabledPropertyProvider.java:178) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 07 Jun 2017 12:14:50,833 ERROR [pool-9-thread-29632] BaseProvider:240 - Caught exception getting JMX metrics : Connection refused, skipping same exceptions for next 5 minutes java.net.ConnectException: Connection refused at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:589) at sun.net.NetworkClient.doConnect(NetworkClient.java:175) at sun.net.www.http.HttpClient.openServer(HttpClient.java:432) at sun.net.www.http.HttpClient.openServer(HttpClient.java:527) at sun.net.www.http.HttpClient.(HttpClient.java:211) at sun.net.www.http.HttpClient.New(HttpClient.java:308) at sun.net.www.http.HttpClient.New(HttpClient.java:326) at sun.net.www.protocol.http.HttpURLConnection.getNewHttpClient(HttpURLConnection.java:1169) at sun.net.www.protocol.http.HttpURLConnection.plainConnect0(HttpURLConnection.java:1105) at sun.net.www.protocol.http.HttpURLConnection.plainConnect(HttpURLConnection.java:999) at sun.net.www.protocol.http.HttpURLConnection.connect(HttpURLConnection.java:933) at sun.net.www.protocol.http.HttpURLConnection.getInputStream0(HttpURLConnection.java:1513) at sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1441) at java.net.HttpURLConnection.getResponseCode(HttpURLConnection.java:480) at org.apache.ambari.server.controller.internal.URLStreamProvider.processURL(URLStreamProvider.java:209) at org.apache.ambari.server.controller.internal.URLStreamProvider.processURL(URLStreamProvider.java:133) at org.apache.ambari.server.controller.internal.URLStreamProvider.readFrom(URLStreamProvider.java:107) at org.apache.ambari.server.controller.internal.URLStreamProvider.readFrom(URLStreamProvider.java:112) at org.apache.ambari.server.controller.jmx.JMXPropertyProvider.populateResource(JMXPropertyProvider.java:212) at org.apache.ambari.server.controller.metrics.ThreadPoolEnabledPropertyProvider$1.call(ThreadPoolEnabledPropertyProvider.java:180) at org.apache.ambari.server.controller.metrics.ThreadPoolEnabledPropertyProvider$1.call(ThreadPoolEnabledPropertyProvider.java:178) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 07 Jun 2017 12:14:54,421 WARN [qtp-ambari-client-75533] ViewRegistry:855 - Could not find the cluster identified by rahdpdev. 07 Jun 2017 12:14:54,422 WARN [qtp-ambari-client-75533] ViewRegistry:855 - Could not find the cluster identified by rahdpdev. 07 Jun 2017 12:14:54,609 WARN [qtp-ambari-client-75533] ViewRegistry:855 - Could not find the cluster identified by rahdpdev. 07 Jun 2017 12:14:54,609 WARN [qtp-ambari-client-75533] ViewRegistry:855 - Could not find the cluster identified by rahdpdev. 07 Jun 2017 12:14:54,618 WARN [qtp-ambari-client-75556] ViewRegistry:855 - Could not find the cluster identified by rahdpdev. 07 Jun 2017 12:14:54,619 WARN [qtp-ambari-client-75556] ViewRegistry:855 - Could not find the cluster identified by rahdpdev. 07 Jun 2017 17:07:01,524 ERROR [pool-9-thread-32264] BaseProvider:240 - Caught exception getting JMX metrics : Connection refused, skipping same exceptions for next 5 minutes java.net.ConnectException: Connection refused at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:589) at sun.net.NetworkClient.doConnect(NetworkClient.java:175) at sun.net.www.http.HttpClient.openServer(HttpClient.java:432) at sun.net.www.http.HttpClient.openServer(HttpClient.java:527) at sun.net.www.http.HttpClient.(HttpClient.java:211) at sun.net.www.http.HttpClient.New(HttpClient.java:308) at sun.net.www.http.HttpClient.New(HttpClient.java:326) at sun.net.www.protocol.http.HttpURLConnection.getNewHttpClient(HttpURLConnection.java:1169) at sun.net.www.protocol.http.HttpURLConnection.plainConnect0(HttpURLConnection.java:1105) at sun.net.www.protocol.http.HttpURLConnection.plainConnect(HttpURLConnection.java:999) at sun.net.www.protocol.http.HttpURLConnection.connect(HttpURLConnection.java:933) at sun.net.www.protocol.http.HttpURLConnection.getInputStream0(HttpURLConnection.java:1513) at sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1441) at java.net.HttpURLConnection.getResponseCode(HttpURLConnection.java:480) at org.apache.ambari.server.controller.internal.URLStreamProvider.processURL(URLStreamProvider.java:209) at org.apache.ambari.server.controller.internal.URLStreamProvider.processURL(URLStreamProvider.java:133) at org.apache.ambari.server.controller.internal.URLStreamProvider.readFrom(URLStreamProvider.java:107) at org.apache.ambari.server.controller.internal.URLStreamProvider.readFrom(URLStreamProvider.java:112) at org.apache.ambari.server.controller.jmx.JMXPropertyProvider.populateResource(JMXPropertyProvider.java:212) at org.apache.ambari.server.controller.metrics.ThreadPoolEnabledPropertyProvider$1.call(ThreadPoolEnabledPropertyProvider.java:180) at org.apache.ambari.server.controller.metrics.ThreadPoolEnabledPropertyProvider$1.call(ThreadPoolEnabledPropertyProvider.java:178) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 07 Jun 2017 19:00:03,910 ERROR [pool-9-thread-32376] BaseProvider:240 - Caught exception getting JMX metrics : Connection refused, skipping same exceptions for next 5 minutes java.net.ConnectException: Connection refused at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:589) at sun.net.NetworkClient.doConnect(NetworkClient.java:175) at sun.net.www.http.HttpClient.openServer(HttpClient.java:432) at sun.net.www.http.HttpClient.openServer(HttpClient.java:527) at sun.net.www.http.HttpClient.(HttpClient.java:211) at sun.net.www.http.HttpClient.New(HttpClient.java:308) at sun.net.www.http.HttpClient.New(HttpClient.java:326) at sun.net.www.protocol.http.HttpURLConnection.getNewHttpClient(HttpURLConnection.java:1169) at sun.net.www.protocol.http.HttpURLConnection.plainConnect0(HttpURLConnection.java:1105) at sun.net.www.protocol.http.HttpURLConnection.plainConnect(HttpURLConnection.java:999) at sun.net.www.protocol.http.HttpURLConnection.connect(HttpURLConnection.java:933) at sun.net.www.protocol.http.HttpURLConnection.getInputStream0(HttpURLConnection.java:1513) at sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1441) at java.net.HttpURLConnection.getResponseCode(HttpURLConnection.java:480) at org.apache.ambari.server.controller.internal.URLStreamProvider.processURL(URLStreamProvider.java:209) at org.apache.ambari.server.controller.internal.URLStreamProvider.processURL(URLStreamProvider.java:133) at org.apache.ambari.server.controller.internal.URLStreamProvider.readFrom(URLStreamProvider.java:107) at org.apache.ambari.server.controller.internal.URLStreamProvider.readFrom(URLStreamProvider.java:112) at org.apache.ambari.server.controller.jmx.JMXPropertyProvider.populateResource(JMXPropertyProvider.java:212) at org.apache.ambari.server.controller.metrics.ThreadPoolEnabledPropertyProvider$1.call(ThreadPoolEnabledPropertyProvider.java:180) at org.apache.ambari.server.controller.metrics.ThreadPoolEnabledPropertyProvider$1.call(ThreadPoolEnabledPropertyProvider.java:178) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 07 Jun 2017 19:17:09,657 ERROR [pool-9-thread-32399] BaseProvider:240 - Caught exception getting JMX metrics : Connection refused, skipping same exceptions for next 5 minutes java.net.ConnectException: Connection refused at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:589) at sun.net.NetworkClient.doConnect(NetworkClient.java:175) at sun.net.www.http.HttpClient.openServer(HttpClient.java:432) at sun.net.www.http.HttpClient.openServer(HttpClient.java:527) at sun.net.www.http.HttpClient.(HttpClient.java:211) at sun.net.www.http.HttpClient.New(HttpClient.java:308) at sun.net.www.http.HttpClient.New(HttpClient.java:326) at sun.net.www.protocol.http.HttpURLConnection.getNewHttpClient(HttpURLConnection.java:1169) at sun.net.www.protocol.http.HttpURLConnection.plainConnect0(HttpURLConnection.java:1105) at sun.net.www.protocol.http.HttpURLConnection.plainConnect(HttpURLConnection.java:999) at sun.net.www.protocol.http.HttpURLConnection.connect(HttpURLConnection.java:933) at sun.net.www.protocol.http.HttpURLConnection.getInputStream0(HttpURLConnection.java:1513) at sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1441) at java.net.HttpURLConnection.getResponseCode(HttpURLConnection.java:480) at org.apache.ambari.server.controller.internal.URLStreamProvider.processURL(URLStreamProvider.java:209) at org.apache.ambari.server.controller.internal.URLStreamProvider.processURL(URLStreamProvider.java:133) at org.apache.ambari.server.controller.internal.URLStreamProvider.readFrom(URLStreamProvider.java:107) at org.apache.ambari.server.controller.internal.URLStreamProvider.readFrom(URLStreamProvider.java:112) at org.apache.ambari.server.controller.jmx.JMXPropertyProvider.populateResource(JMXPropertyProvider.java:212) at org.apache.ambari.server.controller.metrics.ThreadPoolEnabledPropertyProvider$1.call(ThreadPoolEnabledPropertyProvider.java:180) at org.apache.ambari.server.controller.metrics.ThreadPoolEnabledPropertyProvider$1.call(ThreadPoolEnabledPropertyProvider.java:178) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 07 Jun 2017 19:17:14,576 WARN [qtp-ambari-client-80206] ViewRegistry:855 - Could not find the cluster identified by rahdpdev. 07 Jun 2017 19:17:14,577 WARN [qtp-ambari-client-80206] ViewRegistry:855 - Could not find the cluster identified by rahdpdev. 07 Jun 2017 19:17:14,736 WARN [qtp-ambari-client-80227] ViewRegistry:855 - Could not find the cluster identified by rahdpdev. 07 Jun 2017 19:17:14,737 WARN [qtp-ambari-client-80227] ViewRegistry:855 - Could not find the cluster identified by rahdpdev. 07 Jun 2017 19:17:14,744 WARN [qtp-ambari-client-80206] ViewRegistry:855 - Could not find the cluster identified by rahdpdev. 07 Jun 2017 19:17:14,744 WARN [qtp-ambari-client-80206] ViewRegistry:855 - Could not find the cluster identified by rahdpdev. 07 Jun 2017 19:27:04,054 ERROR [pool-9-thread-32418] BaseProvider:240 - Caught exception getting JMX metrics : Connection refused, skipping same exceptions for next 5 minutes java.net.ConnectException: Connection refused at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:589) at sun.net.NetworkClient.doConnect(NetworkClient.java:175) at sun.net.www.http.HttpClient.openServer(HttpClient.java:432) at sun.net.www.http.HttpClient.openServer(HttpClient.java:527) at sun.net.www.http.HttpClient.(HttpClient.java:211) at sun.net.www.http.HttpClient.New(HttpClient.java:308) at sun.net.www.http.HttpClient.New(HttpClient.java:326) at sun.net.www.protocol.http.HttpURLConnection.getNewHttpClient(HttpURLConnection.java:1169) at sun.net.www.protocol.http.HttpURLConnection.plainConnect0(HttpURLConnection.java:1105) at sun.net.www.protocol.http.HttpURLConnection.plainConnect(HttpURLConnection.java:999) at sun.net.www.protocol.http.HttpURLConnection.connect(HttpURLConnection.java:933) at sun.net.www.protocol.http.HttpURLConnection.getInputStream0(HttpURLConnection.java:1513) at sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1441) at java.net.HttpURLConnection.getResponseCode(HttpURLConnection.java:480) at org.apache.ambari.server.controller.internal.URLStreamProvider.processURL(URLStreamProvider.java:209) at org.apache.ambari.server.controller.internal.URLStreamProvider.processURL(URLStreamProvider.java:133) at org.apache.ambari.server.controller.internal.URLStreamProvider.readFrom(URLStreamProvider.java:107) at org.apache.ambari.server.controller.internal.URLStreamProvider.readFrom(URLStreamProvider.java:112) at org.apache.ambari.server.controller.jmx.JMXPropertyProvider.populateResource(JMXPropertyProvider.java:212) at org.apache.ambari.server.controller.metrics.ThreadPoolEnabledPropertyProvider$1.call(ThreadPoolEnabledPropertyProvider.java:180) at org.apache.ambari.server.controller.metrics.ThreadPoolEnabledPropertyProvider$1.call(ThreadPoolEnabledPropertyProvider.java:178) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 07 Jun 2017 19:28:17,292 WARN [qtp-ambari-client-80250] ViewRegistry:855 - Could not find the cluster identified by rahdpdev. 07 Jun 2017 19:28:17,293 WARN [qtp-ambari-client-80250] ViewRegistry:855 - Could not find the cluster identified by rahdpdev. 07 Jun 2017 19:28:17,386 WARN [qtp-ambari-client-80261] ViewRegistry:855 - Could not find the cluster identified by rahdpdev. 07 Jun 2017 19:28:17,387 WARN [qtp-ambari-client-80261] ViewRegistry:855 - Could not find the cluster identified by rahdpdev. 07 Jun 2017 19:28:17,396 WARN [qtp-ambari-client-80256] ViewRegistry:855 - Could not find the cluster identified by rahdpdev. 07 Jun 2017 19:28:17,396 WARN [qtp-ambari-client-80256] ViewRegistry:855 - Could not find the cluster identified by rahdpdev. 12 Jun 2017 11:41:36,782 ERROR [pool-9-thread-32426] BaseProvider:240 - Caught exception getting JMX metrics : Connection refused, skipping same exceptions for next 5 minutes java.net.ConnectException: Connection refused at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:589) at sun.net.NetworkClient.doConnect(NetworkClient.java:175) at sun.net.www.http.HttpClient.openServer(HttpClient.java:432) at sun.net.www.http.HttpClient.openServer(HttpClient.java:527) at sun.net.www.http.HttpClient.(HttpClient.java:211) at sun.net.www.http.HttpClient.New(HttpClient.java:308) at sun.net.www.http.HttpClient.New(HttpClient.java:326) at sun.net.www.protocol.http.HttpURLConnection.getNewHttpClient(HttpURLConnection.java:1169) at sun.net.www.protocol.http.HttpURLConnection.plainConnect0(HttpURLConnection.java:1105) at sun.net.www.protocol.http.HttpURLConnection.plainConnect(HttpURLConnection.java:999) at sun.net.www.protocol.http.HttpURLConnection.connect(HttpURLConnection.java:933) at sun.net.www.protocol.http.HttpURLConnection.getInputStream0(HttpURLConnection.java:1513) at sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1441) at java.net.HttpURLConnection.getResponseCode(HttpURLConnection.java:480) at org.apache.ambari.server.controller.internal.URLStreamProvider.processURL(URLStreamProvider.java:209) at org.apache.ambari.server.controller.internal.URLStreamProvider.processURL(URLStreamProvider.java:133) at org.apache.ambari.server.controller.internal.URLStreamProvider.readFrom(URLStreamProvider.java:107) at org.apache.ambari.server.controller.internal.URLStreamProvider.readFrom(URLStreamProvider.java:112) at org.apache.ambari.server.controller.jmx.JMXPropertyProvider.populateResource(JMXPropertyProvider.java:212) at org.apache.ambari.server.controller.metrics.ThreadPoolEnabledPropertyProvider$1.call(ThreadPoolEnabledPropertyProvider.java:180) at org.apache.ambari.server.controller.metrics.ThreadPoolEnabledPropertyProvider$1.call(ThreadPoolEnabledPropertyProvider.java:178) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 12 Jun 2017 12:43:56,621 ERROR [pool-9-thread-33502] BaseProvider:240 - Caught exception getting JMX metrics : Connection refused, skipping same exceptions for next 5 minutes java.net.ConnectException: Connection refused at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:589) at sun.net.NetworkClient.doConnect(NetworkClient.java:175) at sun.net.www.http.HttpClient.openServer(HttpClient.java:432) at sun.net.www.http.HttpClient.openServer(HttpClient.java:527) at sun.net.www.http.HttpClient.(HttpClient.java:211) at sun.net.www.http.HttpClient.New(HttpClient.java:308) at sun.net.www.http.HttpClient.New(HttpClient.java:326) at sun.net.www.protocol.http.HttpURLConnection.getNewHttpClient(HttpURLConnection.java:1169) at sun.net.www.protocol.http.HttpURLConnection.plainConnect0(HttpURLConnection.java:1105) at sun.net.www.protocol.http.HttpURLConnection.plainConnect(HttpURLConnection.java:999) at sun.net.www.protocol.http.HttpURLConnection.connect(HttpURLConnection.java:933) at sun.net.www.protocol.http.HttpURLConnection.getInputStream0(HttpURLConnection.java:1513) at sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1441) at java.net.HttpURLConnection.getResponseCode(HttpURLConnection.java:480) at org.apache.ambari.server.controller.internal.URLStreamProvider.processURL(URLStreamProvider.java:209) at org.apache.ambari.server.controller.internal.URLStreamProvider.processURL(URLStreamProvider.java:133) at org.apache.ambari.server.controller.internal.URLStreamProvider.readFrom(URLStreamProvider.java:107) at org.apache.ambari.server.controller.internal.URLStreamProvider.readFrom(URLStreamProvider.java:112) at org.apache.ambari.server.controller.jmx.JMXPropertyProvider.populateResource(JMXPropertyProvider.java:212) at org.apache.ambari.server.controller.metrics.ThreadPoolEnabledPropertyProvider$1.call(ThreadPoolEnabledPropertyProvider.java:180) at org.apache.ambari.server.controller.metrics.ThreadPoolEnabledPropertyProvider$1.call(ThreadPoolEnabledPropertyProvider.java:178) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 12 Jun 2017 13:52:36,677 WARN [qtp-ambari-client-96010] ViewRegistry:855 - Could not find the cluster identified by rahdpdev. 12 Jun 2017 13:52:36,678 WARN [qtp-ambari-client-96010] ViewRegistry:855 - Could not find the cluster identified by rahdpdev. 12 Jun 2017 13:52:36,815 WARN [qtp-ambari-client-95935] ViewRegistry:855 - Could not find the cluster identified by rahdpdev. 12 Jun 2017 13:52:36,815 WARN [qtp-ambari-client-95935] ViewRegistry:855 - Could not find the cluster identified by rahdpdev. 12 Jun 2017 13:52:36,826 WARN [qtp-ambari-client-96069] ViewRegistry:855 - Could not find the cluster identified by rahdpdev. 12 Jun 2017 13:52:36,827 WARN [qtp-ambari-client-96069] ViewRegistry:855 - Could not find the cluster identified by rahdpdev. 12 Jun 2017 13:52:56,297 ERROR [pool-9-thread-34220] BaseProvider:240 - Caught exception getting JMX metrics : Connection refused, skipping same exceptions for next 5 minutes java.net.ConnectException: Connection refused at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:589) at sun.net.NetworkClient.doConnect(NetworkClient.java:175) at sun.net.www.http.HttpClient.openServer(HttpClient.java:432) at sun.net.www.http.HttpClient.openServer(HttpClient.java:527) at sun.net.www.http.HttpClient.(HttpClient.java:211) at sun.net.www.http.HttpClient.New(HttpClient.java:308) at sun.net.www.http.HttpClient.New(HttpClient.java:326) at sun.net.www.protocol.http.HttpURLConnection.getNewHttpClient(HttpURLConnection.java:1169) at sun.net.www.protocol.http.HttpURLConnection.plainConnect0(HttpURLConnection.java:1105) at sun.net.www.protocol.http.HttpURLConnection.plainConnect(HttpURLConnection.java:999) at sun.net.www.protocol.http.HttpURLConnection.connect(HttpURLConnection.java:933) at sun.net.www.protocol.http.HttpURLConnection.getInputStream0(HttpURLConnection.java:1513) at sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1441) at java.net.HttpURLConnection.getResponseCode(HttpURLConnection.java:480) at org.apache.ambari.server.controller.internal.URLStreamProvider.processURL(URLStreamProvider.java:209) at org.apache.ambari.server.controller.internal.URLStreamProvider.processURL(URLStreamProvider.java:133) at org.apache.ambari.server.controller.internal.URLStreamProvider.readFrom(URLStreamProvider.java:107) at org.apache.ambari.server.controller.internal.URLStreamProvider.readFrom(URLStreamProvider.java:112) at org.apache.ambari.server.controller.jmx.JMXPropertyProvider.populateResource(JMXPropertyProvider.java:212) at org.apache.ambari.server.controller.metrics.ThreadPoolEnabledPropertyProvider$1.call(ThreadPoolEnabledPropertyProvider.java:180) at org.apache.ambari.server.controller.metrics.ThreadPoolEnabledPropertyProvider$1.call(ThreadPoolEnabledPropertyProvider.java:178) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 12 Jun 2017 13:53:16,962 INFO [qtp-ambari-client-95935] StackAdvisorRunner:47 - Script=/var/lib/ambari-server/resources/scripts/stack_advisor.py, actionDirectory=/var/run/ambari-server/stack-recommendations/7, command=recommend-configurations 12 Jun 2017 13:53:16,966 INFO [qtp-ambari-client-95935] StackAdvisorRunner:61 - Stack-advisor output=/var/run/ambari-server/stack-recommendations/7/stackadvisor.out, error=/var/run/ambari-server/stack-recommendations/7/stackadvisor.err 12 Jun 2017 13:53:17,425 INFO [qtp-ambari-client-95935] StackAdvisorRunner:69 - Stack advisor output files 12 Jun 2017 13:53:17,425 INFO [qtp-ambari-client-95935] StackAdvisorRunner:70 - advisor script stdout: StackAdvisor implementation for stack HDP, version 2.0.6 was loaded StackAdvisor implementation for stack HDP, version 2.1 was loaded StackAdvisor implementation for stack HDP, version 2.2 was loaded StackAdvisor implementation for stack HDP, version 2.3 was loaded StackAdvisor implementation for stack HDP, version 2.4 was loaded Returning HDP24StackAdvisor implementation max_inmemory_regions: -2.7 Processing file: /var/lib/ambari-server/resources/stacks/HDP/2.4/services/../../../../common-services/AMBARI_METRICS/0.1.0/package/files/service-metrics/HDFS.txt Processing file: /var/lib/ambari-server/resources/stacks/HDP/2.4/services/../../../../common-services/AMBARI_METRICS/0.1.0/package/files/service-metrics/HOST.txt Processing file: /var/lib/ambari-server/resources/stacks/HDP/2.4/services/../../../../common-services/AMBARI_METRICS/0.1.0/package/files/service-metrics/HBASE.txt Processing file: /var/lib/ambari-server/resources/stacks/HDP/2.4/services/../../../../common-services/AMBARI_METRICS/0.1.0/package/files/service-metrics/AMBARI_METRICS.txt Processing file: /var/lib/ambari-server/resources/stacks/HDP/2.4/services/../../../../common-services/AMBARI_METRICS/0.1.0/package/files/service-metrics/YARN.txt metrics length: 216 12 Jun 2017 13:53:17,426 INFO [qtp-ambari-client-95935] StackAdvisorRunner:71 - advisor script stderr: 12 Jun 2017 13:54:01,635 WARN [qtp-ambari-client-96010] ViewRegistry:855 - Could not find the cluster identified by rahdpdev. 12 Jun 2017 13:54:01,636 WARN [qtp-ambari-client-96010] ViewRegistry:855 - Could not find the cluster identified by rahdpdev. 12 Jun 2017 13:54:01,747 WARN [qtp-ambari-client-95935] ViewRegistry:855 - Could not find the cluster identified by rahdpdev. 12 Jun 2017 13:54:01,748 WARN [qtp-ambari-client-95935] ViewRegistry:855 - Could not find the cluster identified by rahdpdev. 12 Jun 2017 13:54:01,766 WARN [qtp-ambari-client-96097] ViewRegistry:855 - Could not find the cluster identified by rahdpdev. 12 Jun 2017 13:54:01,767 WARN [qtp-ambari-client-96097] ViewRegistry:855 - Could not find the cluster identified by rahdpdev. 12 Jun 2017 13:56:26,328 WARN [qtp-ambari-client-96069] ViewRegistry:855 - Could not find the cluster identified by rahdpdev. 12 Jun 2017 13:56:26,329 WARN [qtp-ambari-client-96069] ViewRegistry:855 - Could not find the cluster identified by rahdpdev. 12 Jun 2017 13:56:26,448 WARN [qtp-ambari-client-96069] ViewRegistry:855 - Could not find the cluster identified by rahdpdev. 12 Jun 2017 13:56:26,448 WARN [qtp-ambari-client-96069] ViewRegistry:855 - Could not find the cluster identified by rahdpdev. 12 Jun 2017 13:56:26,459 WARN [qtp-ambari-client-96069] ViewRegistry:855 - Could not find the cluster identified by rahdpdev. 12 Jun 2017 13:56:26,460 WARN [qtp-ambari-client-96069] ViewRegistry:855 - Could not find the cluster identified by rahdpdev. 12 Jun 2017 13:59:20,782 ERROR [pool-9-thread-34299] BaseProvider:240 - Caught exception getting JMX metrics : Connection refused, skipping same exceptions for next 5 minutes java.net.ConnectException: Connection refused at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:589) at sun.net.NetworkClient.doConnect(NetworkClient.java:175) at sun.net.www.http.HttpClient.openServer(HttpClient.java:432) at sun.net.www.http.HttpClient.openServer(HttpClient.java:527) at sun.net.www.http.HttpClient.(HttpClient.java:211) at sun.net.www.http.HttpClient.New(HttpClient.java:308) at sun.net.www.http.HttpClient.New(HttpClient.java:326) at sun.net.www.protocol.http.HttpURLConnection.getNewHttpClient(HttpURLConnection.java:1169) at sun.net.www.protocol.http.HttpURLConnection.plainConnect0(HttpURLConnection.java:1105) at sun.net.www.protocol.http.HttpURLConnection.plainConnect(HttpURLConnection.java:999) at sun.net.www.protocol.http.HttpURLConnection.connect(HttpURLConnection.java:933) at sun.net.www.protocol.http.HttpURLConnection.getInputStream0(HttpURLConnection.java:1513) at sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1441) at java.net.HttpURLConnection.getResponseCode(HttpURLConnection.java:480) at org.apache.ambari.server.controller.internal.URLStreamProvider.processURL(URLStreamProvider.java:209) at org.apache.ambari.server.controller.internal.URLStreamProvider.processURL(URLStreamProvider.java:133) at org.apache.ambari.server.controller.internal.URLStreamProvider.readFrom(URLStreamProvider.java:107) at org.apache.ambari.server.controller.internal.URLStreamProvider.readFrom(URLStreamProvider.java:112) at org.apache.ambari.server.controller.jmx.JMXPropertyProvider.populateResource(JMXPropertyProvider.java:212) at org.apache.ambari.server.controller.metrics.ThreadPoolEnabledPropertyProvider$1.call(ThreadPoolEnabledPropertyProvider.java:180) at org.apache.ambari.server.controller.metrics.ThreadPoolEnabledPropertyProvider$1.call(ThreadPoolEnabledPropertyProvider.java:178) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 12 Jun 2017 13:59:25,520 INFO [qtp-ambari-client-96138] StackAdvisorRunner:47 - Script=/var/lib/ambari-server/resources/scripts/stack_advisor.py, actionDirectory=/var/run/ambari-server/stack-recommendations/8, command=recommend-configurations 12 Jun 2017 13:59:25,525 INFO [qtp-ambari-client-96138] StackAdvisorRunner:61 - Stack-advisor output=/var/run/ambari-server/stack-recommendations/8/stackadvisor.out, error=/var/run/ambari-server/stack-recommendations/8/stackadvisor.err 12 Jun 2017 13:59:25,904 INFO [qtp-ambari-client-96138] StackAdvisorRunner:69 - Stack advisor output files 12 Jun 2017 13:59:25,904 INFO [qtp-ambari-client-96138] StackAdvisorRunner:70 - advisor script stdout: StackAdvisor implementation for stack HDP, version 2.0.6 was loaded StackAdvisor implementation for stack HDP, version 2.1 was loaded StackAdvisor implementation for stack HDP, version 2.2 was loaded StackAdvisor implementation for stack HDP, version 2.3 was loaded StackAdvisor implementation for stack HDP, version 2.4 was loaded Returning HDP24StackAdvisor implementation max_inmemory_regions: -2.7 Processing file: /var/lib/ambari-server/resources/stacks/HDP/2.4/services/../../../../common-services/AMBARI_METRICS/0.1.0/package/files/service-metrics/HDFS.txt Processing file: /var/lib/ambari-server/resources/stacks/HDP/2.4/services/../../../../common-services/AMBARI_METRICS/0.1.0/package/files/service-metrics/HOST.txt Processing file: /var/lib/ambari-server/resources/stacks/HDP/2.4/services/../../../../common-services/AMBARI_METRICS/0.1.0/package/files/service-metrics/HBASE.txt Processing file: /var/lib/ambari-server/resources/stacks/HDP/2.4/services/../../../../common-services/AMBARI_METRICS/0.1.0/package/files/service-metrics/AMBARI_METRICS.txt Processing file: /var/lib/ambari-server/resources/stacks/HDP/2.4/services/../../../../common-services/AMBARI_METRICS/0.1.0/package/files/service-metrics/YARN.txt metrics length: 216 12 Jun 2017 13:59:25,905 INFO [qtp-ambari-client-96138] StackAdvisorRunner:71 - advisor script stderr: 12 Jun 2017 14:10:35,119 INFO [qtp-ambari-client-96223] StackAdvisorRunner:47 - Script=/var/lib/ambari-server/resources/scripts/stack_advisor.py, actionDirectory=/var/run/ambari-server/stack-recommendations/9, command=recommend-configuration-dependencies 12 Jun 2017 14:10:35,123 INFO [qtp-ambari-client-96223] StackAdvisorRunner:61 - Stack-advisor output=/var/run/ambari-server/stack-recommendations/9/stackadvisor.out, error=/var/run/ambari-server/stack-recommendations/9/stackadvisor.err 12 Jun 2017 14:10:35,603 INFO [qtp-ambari-client-96223] StackAdvisorRunner:69 - Stack advisor output files 12 Jun 2017 14:10:35,604 INFO [qtp-ambari-client-96223] StackAdvisorRunner:70 - advisor script stdout: StackAdvisor implementation for stack HDP, version 2.0.6 was loaded StackAdvisor implementation for stack HDP, version 2.1 was loaded StackAdvisor implementation for stack HDP, version 2.2 was loaded StackAdvisor implementation for stack HDP, version 2.3 was loaded StackAdvisor implementation for stack HDP, version 2.4 was loaded Returning HDP24StackAdvisor implementation max_inmemory_regions: -2.7 Processing file: /var/lib/ambari-server/resources/stacks/HDP/2.4/services/../../../../common-services/AMBARI_METRICS/0.1.0/package/files/service-metrics/HDFS.txt Processing file: /var/lib/ambari-server/resources/stacks/HDP/2.4/services/../../../../common-services/AMBARI_METRICS/0.1.0/package/files/service-metrics/HOST.txt Processing file: /var/lib/ambari-server/resources/stacks/HDP/2.4/services/../../../../common-services/AMBARI_METRICS/0.1.0/package/files/service-metrics/HBASE.txt Processing file: /var/lib/ambari-server/resources/stacks/HDP/2.4/services/../../../../common-services/AMBARI_METRICS/0.1.0/package/files/service-metrics/AMBARI_METRICS.txt Processing file: /var/lib/ambari-server/resources/stacks/HDP/2.4/services/../../../../common-services/AMBARI_METRICS/0.1.0/package/files/service-metrics/YARN.txt metrics length: 216 12 Jun 2017 14:10:35,604 INFO [qtp-ambari-client-96223] StackAdvisorRunner:71 - advisor script stderr: 12 Jun 2017 14:10:37,180 INFO [qtp-ambari-client-96223] StackAdvisorRunner:47 - Script=/var/lib/ambari-server/resources/scripts/stack_advisor.py, actionDirectory=/var/run/ambari-server/stack-recommendations/10, command=recommend-configuration-dependencies 12 Jun 2017 14:10:37,184 INFO [qtp-ambari-client-96223] StackAdvisorRunner:61 - Stack-advisor output=/var/run/ambari-server/stack-recommendations/10/stackadvisor.out, error=/var/run/ambari-server/stack-recommendations/10/stackadvisor.err 12 Jun 2017 14:10:37,567 INFO [qtp-ambari-client-96223] StackAdvisorRunner:69 - Stack advisor output files 12 Jun 2017 14:10:37,567 INFO [qtp-ambari-client-96223] StackAdvisorRunner:70 - advisor script stdout: StackAdvisor implementation for stack HDP, version 2.0.6 was loaded StackAdvisor implementation for stack HDP, version 2.1 was loaded StackAdvisor implementation for stack HDP, version 2.2 was loaded StackAdvisor implementation for stack HDP, version 2.3 was loaded StackAdvisor implementation for stack HDP, version 2.4 was loaded Returning HDP24StackAdvisor implementation max_inmemory_regions: -2.7 Processing file: /var/lib/ambari-server/resources/stacks/HDP/2.4/services/../../../../common-services/AMBARI_METRICS/0.1.0/package/files/service-metrics/HDFS.txt Processing file: /var/lib/ambari-server/resources/stacks/HDP/2.4/services/../../../../common-services/AMBARI_METRICS/0.1.0/package/files/service-metrics/HOST.txt Processing file: /var/lib/ambari-server/resources/stacks/HDP/2.4/services/../../../../common-services/AMBARI_METRICS/0.1.0/package/files/service-metrics/HBASE.txt Processing file: /var/lib/ambari-server/resources/stacks/HDP/2.4/services/../../../../common-services/AMBARI_METRICS/0.1.0/package/files/service-metrics/AMBARI_METRICS.txt Processing file: /var/lib/ambari-server/resources/stacks/HDP/2.4/services/../../../../common-services/AMBARI_METRICS/0.1.0/package/files/service-metrics/YARN.txt metrics length: 216 12 Jun 2017 14:10:37,568 INFO [qtp-ambari-client-96223] StackAdvisorRunner:71 - advisor script stderr: 12 Jun 2017 14:11:38,805 INFO [qtp-ambari-client-96289] StackAdvisorRunner:47 - Script=/var/lib/ambari-server/resources/scripts/stack_advisor.py, actionDirectory=/var/run/ambari-server/stack-recommendations/11, command=validate-configurations 12 Jun 2017 14:11:38,810 INFO [qtp-ambari-client-96289] StackAdvisorRunner:61 - Stack-advisor output=/var/run/ambari-server/stack-recommendations/11/stackadvisor.out, error=/var/run/ambari-server/stack-recommendations/11/stackadvisor.err 12 Jun 2017 14:11:39,247 INFO [qtp-ambari-client-96289] StackAdvisorRunner:69 - Stack advisor output files 12 Jun 2017 14:11:39,248 INFO [qtp-ambari-client-96289] StackAdvisorRunner:70 - advisor script stdout: StackAdvisor implementation for stack HDP, version 2.0.6 was loaded StackAdvisor implementation for stack HDP, version 2.1 was loaded StackAdvisor implementation for stack HDP, version 2.2 was loaded StackAdvisor implementation for stack HDP, version 2.3 was loaded StackAdvisor implementation for stack HDP, version 2.4 was loaded Returning HDP24StackAdvisor implementation max_inmemory_regions: -2.7 Processing file: /var/lib/ambari-server/resources/stacks/HDP/2.4/services/../../../../common-services/AMBARI_METRICS/0.1.0/package/files/service-metrics/HDFS.txt Processing file: /var/lib/ambari-server/resources/stacks/HDP/2.4/services/../../../../common-services/AMBARI_METRICS/0.1.0/package/files/service-metrics/HOST.txt Processing file: /var/lib/ambari-server/resources/stacks/HDP/2.4/services/../../../../common-services/AMBARI_METRICS/0.1.0/package/files/service-metrics/HBASE.txt Processing file: /var/lib/ambari-server/resources/stacks/HDP/2.4/services/../../../../common-services/AMBARI_METRICS/0.1.0/package/files/service-metrics/AMBARI_METRICS.txt Processing file: /var/lib/ambari-server/resources/stacks/HDP/2.4/services/../../../../common-services/AMBARI_METRICS/0.1.0/package/files/service-metrics/YARN.txt metrics length: 216 SiteName: hive-env, method: validateHiveConfigurationsEnv Site properties: {u'hive.client.heapsize': u'1024', u'hive.heapsize': u'48385', u'hive_user_nproc_limit': u'16000', u'hcat_user': u'hcat', u'hive_user_nofile_limit': u'32000', u'hive_database_type': u'mysql', u'hive_ambari_database': u'MySQL', u'webhcat_user': u'hcat', u'hcat_pid_dir': u'/var/run/webhcat', u'hive_security_authorization': u'None', u'content': u'\n if [ "$SERVICE" = "cli" ]; then\n if [ -z "$DEBUG" ]; then\n export HADOOP_OPTS="$HADOOP_OPTS -XX:NewRatio=12 -XX:MaxHeapFreeRatio=40 -XX:MinHeapFreeRatio=15 -XX:+UseNUMA -XX:+UseParallelGC -XX:-UseGCOverheadLimit"\n else\n export HADOOP_OPTS="$HADOOP_OPTS -XX:NewRatio=12 -XX:MaxHeapFreeRatio=40 -XX:MinHeapFreeRatio=15 -XX:-UseGCOverheadLimit"\n fi\n fi\n\n# The heap size of the jvm stared by hive shell script can be controlled via:\n\nif [ "$SERVICE" = "metastore" ]; then\n export HADOOP_HEAPSIZE={{hive_metastore_heapsize}} # Setting for HiveMetastore\nelse\n export HADOOP_HEAPSIZE={{hive_heapsize}} # Setting for HiveServer2 and Client\nfi\n\nexport HADOOP_CLIENT_OPTS="$HADOOP_CLIENT_OPTS -Xmx${HADOOP_HEAPSIZE}m"\n\n# Larger heap size may be required when running queries over large number of files or partitions.\n# By default hive shell scripts use a heap size of 256 (MB). Larger heap size would also be\n# appropriate for hive server (hwi etc).\n\n\n# Set HADOOP_HOME to point to a specific hadoop install directory\nHADOOP_HOME=${HADOOP_HOME:-{{hadoop_home}}}\n\n# Hive Configuration Directory can be controlled by:\nexport HIVE_CONF_DIR={{hive_config_dir}}\n\n# Folder containing extra libraries required for hive compilation/execution can be controlled by:\nif [ "${HIVE_AUX_JARS_PATH}" != "" ]; then\n if [ -f "${HIVE_AUX_JARS_PATH}" ]; then\n export HIVE_AUX_JARS_PATH=${HIVE_AUX_JARS_PATH}\n elif [ -d "/usr/hdp/current/hive-webhcat/share/hcatalog" ]; then\n export HIVE_AUX_JARS_PATH=/usr/hdp/current/hive-webhcat/share/hcatalog/hive-hcatalog-core.jar\n fi\nelif [ -d "/usr/hdp/current/hive-webhcat/share/hcatalog" ]; then\n export HIVE_AUX_JARS_PATH=/usr/hdp/current/hive-webhcat/share/hcatalog/hive-hcatalog-core.jar\nfi\n\nexport METASTORE_PORT={{hive_metastore_port}}\n\n{% if sqla_db_used or lib_dir_available %}\nexport LD_LIBRARY_PATH="$LD_LIBRARY_PATH:{{jdbc_libs_dir}}"\nexport JAVA_LIBRARY_PATH="$JAVA_LIBRARY_PATH:{{jdbc_libs_dir}}"\n{% endif %}', u'hive_timeline_logging_enabled': u'true', u'hive_database_name': u'hive', u'hive_exec_orc_storage_strategy': u'SPEED', u'hive_pid_dir': u'/var/run/hive', u'hive_log_dir': u'/var/log/hive', u'hive_txn_acid': u'off', u'hive_user': u'hive', u'hive.metastore.heapsize': u'16128', u'hcat_log_dir': u'/var/log/webhcat', u'hive_database': u'New MySQL Database'} Recommendations: {'hive.heapsize': '48385', 'hive.client.heapsize': '1024', 'hive_security_authorization': 'None', 'hive_exec_orc_storage_strategy': 'SPEED', 'hive_timeline_logging_enabled': 'true', 'hive_txn_acid': 'off', 'hive.metastore.heapsize': '16128'} ******** SiteName: hiveserver2-site, method: validateHiveServer2Configurations Site properties: {u'hive.security.authorization.enabled': u'false'} Recommendations: {} ******** SiteName: hive-site, method: validateHiveConfigurations Site properties: {u'javax.jdo.option.ConnectionDriverName': u'com.mysql.jdbc.Driver', u'hive.fetch.task.aggr': u'false', u'hive.execution.engine': u'tez', u'hive.tez.java.opts': u'-server -Djava.net.preferIPv4Stack=true -XX:NewRatio=8 -XX:+UseNUMA -XX:+UseG1GC -XX:+ResizeTLAB -XX:+PrintGCDetails -verbose:gc -XX:+PrintGCTimeStamps', u'hive.server2.thrift.http.port': u'10001', u'hive.tez.min.partition.factor': u'0.25', u'hive.tez.cpu.vcores': u'-1', u'hive.compute.query.using.stats': u'true', u'hive.stats.dbclass': u'fs', u'hive.merge.size.per.task': u'256000000', u'hive.fetch.task.conversion': u'more', u'hive.auto.convert.sortmerge.join.to.mapjoin': u'false', u'hive.server2.thrift.http.path': u'cliservice', u'hive.exec.scratchdir': u'/tmp/hive', u'hive.exec.post.hooks': u'org.apache.hadoop.hive.ql.hooks.ATSHook', u'hive.zookeeper.namespace': u'hive_zookeeper_namespace', u'hive.cbo.enable': u'true', u'hive.optimize.reducededuplication': u'true', u'hive.optimize.bucketmapjoin': u'true', u'hive.mapjoin.bucket.cache.size': u'10000', u'hive.limit.optimize.enable': u'true', u'hive.fetch.task.conversion.threshold': u'1073741824', u'hive.server2.enable.doAs': u'true', u'hive.exec.max.dynamic.partitions': u'5000', u'hive.metastore.sasl.enabled': u'false', u'hive.txn.manager': u'org.apache.hadoop.hive.ql.lockmgr.DummyTxnManager', u'hive.optimize.constant.propagation': u'true', u'hive.exec.submitviachild': u'false', u'hive.metastore.kerberos.principal': u'hive/_HOST@EXAMPLE.COM', u'hive.txn.max.open.batch': u'1000', u'hive.exec.compress.output': u'false', u'hive.tez.auto.reducer.parallelism': u'true', u'hive.security.authenticator.manager': u'org.apache.hadoop.hive.ql.security.ProxyUserAuthenticator', u'hive.merge.mapfiles': u'true', u'hive.exec.parallel.thread.number': u'8', u'hive.mapjoin.optimized.hashtable': u'true', u'hive.default.fileformat': u'TextFile', u'hive.optimize.metadataonly': u'true', u'hive.tez.dynamic.partition.pruning.max.event.size': u'1048576', u'hive.server2.thrift.max.worker.threads': u'500', u'hive.optimize.sort.dynamic.partition': u'false', u'hive.server2.table.type.mapping': u'CLASSIC', u'hive.metastore.pre.event.listeners': u'org.apache.hadoop.hive.ql.security.authorization.AuthorizationPreEventListener', u'hive.metastore.failure.retries': u'24', u'hive.merge.smallfiles.avgsize': u'16000000', u'hive.tez.max.partition.factor': u'2.0', u'hive.server2.transport.mode': u'binary', u'hive.tez.container.size': u'6820', u'hive.optimize.bucketmapjoin.sortedmerge': u'false', u'webhcat_server_hosts': u'[nvmd1cbb150d00.ril.com]', u'hive.security.metastore.authorization.manager': u'org.apache.hadoop.hive.ql.security.authorization.StorageBasedAuthorizationProvider', u'hive.map.aggr.hash.percentmemory': u'0.5', u'hive.user.install.directory': u'/user/', u'datanucleus.autoCreateSchema': u'false', u'hive.conf.restricted.list': u'hive.security.authenticator.manager,hive.security.authorization.manager,hive.users.in.admin.role', u'hive.merge.rcfile.block.level': u'true', u'hive.map.aggr': u'true', u'hive.metastore.client.connect.retry.delay': u'5s', u'hive.security.authorization.enabled': u'false', u'atlas.hook.hive.minThreads': u'1', u'hive.server2.tez.default.queues': u'default', u'hive.prewarm.enabled': u'false', u'hive.exec.reducers.max': u'1009', u'hive.metastore.kerberos.keytab.file': u'/etc/security/keytabs/hive.service.keytab', u'hive.stats.fetch.partition.stats': u'true', u'hive.cli.print.header': u'false', u'hive.server2.thrift.sasl.qop': u'auth', u'hive.server2.support.dynamic.service.discovery': u'true', u'hive.server2.thrift.port': u'10000', u'hive.exec.reducers.bytes.per.reducer': u'67108864', u'hive.compactor.abortedtxn.threshold': u'1000', u'hive.tez.dynamic.partition.pruning.max.data.size': u'104857600', u'hive.metastore.warehouse.dir': u'/apps/hive/warehouse', u'hive.metastore.client.socket.timeout': u'1800s', u'hive.server2.zookeeper.namespace': u'hiveserver2', u'hive.prewarm.numcontainers': u'3', u'hive.cluster.delegation.token.store.class': u'org.apache.hadoop.hive.thrift.ZooKeeperTokenStore', u'hive.security.metastore.authenticator.manager': u'org.apache.hadoop.hive.ql.security.HadoopDefaultMetastoreAuthenticator', u'atlas.hook.hive.maxThreads': u'1', u'hive.auto.convert.join': u'true', u'hive.enforce.bucketing': u'false', u'hive.server2.authentication.spnego.keytab': u'HTTP/_HOST@EXAMPLE.COM', u'hive.mapred.reduce.tasks.speculative.execution': u'false', u'javax.jdo.option.ConnectionURL': u'jdbc:mysql://nvmd1cbb150d00.ril.com/hive?createDatabaseIfNotExist=true', u'hive.exec.dynamic.partition.mode': u'strict', u'hive.auto.convert.sortmerge.join': u'true', u'hive.zookeeper.quorum': u'nvmd1cba190d00.ril.com:2181,nvmd1cbb150d00.ril.com:2181,nvmd1cbb190d00.ril.com:2181', u'hive.security.authorization.manager': u'org.apache.hadoop.hive.ql.security.authorization.plugin.sqlstd.SQLStdConfOnlyAuthorizerFactory', u'hive.exec.parallel': u'false', u'hive.exec.compress.intermediate': u'false', u'hive.enforce.sorting': u'true', u'hive.txn.timeout': u'300', u'hive.metastore.authorization.storage.checks': u'false', u'hive.exec.orc.default.stripe.size': u'67108864', u'hive.metastore.cache.pinobjtypes': u'Table,Database,Type,FieldSchema,Order', u'hive.server2.logging.operation.enabled': u'true', u'hive.merge.tezfiles': u'false', u'hive.compactor.initiator.on': u'false', u'hive.auto.convert.join.noconditionaltask': u'true', u'hive.compactor.worker.timeout': u'86400L', u'hive.optimize.null.scan': u'true', u'hive.server2.tez.initialize.default.sessions': u'false', u'datanucleus.cache.level2.type': u'none', u'hive.stats.autogather': u'true', u'hive.server2.use.SSL': u'false', u'hive.exec.submit.local.task.via.child': u'true', u'hive.merge.mapredfiles': u'false', u'hive.vectorized.execution.enabled': u'true', u'hive.cluster.delegation.token.store.zookeeper.connectString': u'nvmd1cba190d00.ril.com:2181,nvmd1cbb150d00.ril.com:2181,nvmd1cbb190d00.ril.com:2181', u'hive.map.aggr.hash.min.reduction': u'0.5', u'hive.tez.log.level': u'INFO', u'hive.server2.tez.sessions.per.default.queue': u'1', u'hive.exec.max.dynamic.partitions.pernode': u'2000', u'hive.tez.dynamic.partition.pruning': u'true', u'datanucleus.fixedDatastore': u'true', u'hive.compactor.worker.threads': u'0', u'hive.limit.pushdown.memory.usage': u'0.04', u'hive.security.metastore.authorization.auth.reads': u'true', u'ambari.hive.db.schema.name': u'hive', u'hive.vectorized.groupby.checkinterval': u'4096', u'hive.smbjoin.cache.rows': u'10000', u'hive.metastore.execute.setugi': u'true', u'hive.zookeeper.client.port': u'2181', u'hive.vectorized.groupby.maxentries': u'100000', u'hive.server2.authentication.spnego.principal': u'/etc/security/keytabs/spnego.service.keytab', u'hive.cluster.delegation.token.store.zookeeper.znode': u'/hive/cluster/delegation', u'javax.jdo.option.ConnectionPassword': u'SECRET:hive-site:13:javax.jdo.option.ConnectionPassword', u'hive.exec.max.created.files': u'100000', u'hive.default.fileformat.managed': u'TextFile', u'hive.vectorized.execution.reduce.enabled': u'false', u'hive.orc.splits.include.file.footer': u'false', u'hive.exec.pre.hooks': u'org.apache.hadoop.hive.ql.hooks.ATSHook', u'hive.merge.orcfile.stripe.level': u'true', u'hive_metastore_hosts': u'[nvmd1cbb150d00.ril.com]', u'hive.exec.failure.hooks': u'org.apache.hadoop.hive.ql.hooks.ATSHook', u'hive.server2.allow.user.substitution': u'true', u'hive.optimize.index.filter': u'true', u'hive.exec.orc.encoding.strategy': u'SPEED', u'hive.metastore.connect.retries': u'24', u'hive.metastore.server.max.threads': u'100000', u'hive.exec.orc.compression.strategy': u'SPEED', u'hive.vectorized.groupby.flush.percent': u'0.1', u'hive.metastore.uris': u'thrift://nvmd1cbb150d00.ril.com:9083', u'hive.enforce.sortmergebucketmapjoin': u'true', u'hive.auto.convert.join.noconditionaltask.size': u'2383762773', u'javax.jdo.option.ConnectionUserName': u'hive', u'hive.compactor.delta.num.threshold': u'10', u'hive.exec.dynamic.partition': u'true', u'hive.server2.authentication': u'NONE', u'hive.stats.fetch.column.stats': u'true', u'hive.orc.compute.splits.num.threads': u'10', u'hive.tez.smb.number.waves': u'0.5', u'hive.convert.join.bucket.mapjoin.tez': u'false', u'hive.optimize.reducededuplication.min.reducer': u'4', u'hive.server2.logging.operation.log.location': u'/tmp/hive/operation_logs', u'hive.tez.input.format': u'org.apache.hadoop.hive.ql.io.HiveInputFormat', u'hive.exec.orc.default.compress': u'ZLIB', u'hive.support.concurrency': u'false', u'hive.compactor.check.interval': u'300L', u'hive.compactor.delta.pct.threshold': u'0.1f', u'hive.map.aggr.hash.force.flush.memory.threshold': u'0.9'} Recommendations: {'hive.tez.container.size': '8704', 'hive.exec.orc.default.stripe.size': '67108864', 'hive.execution.engine': 'tez', 'hive.vectorized.execution.reduce.enabled': 'false', 'hive.compactor.worker.threads': '0', 'hive.compactor.initiator.on': 'false', 'hive.exec.pre.hooks': 'org.apache.hadoop.hive.ql.hooks.ATSHook', 'hive.compute.query.using.stats': 'true', 'hive.exec.orc.default.compress': 'ZLIB', 'hive.exec.orc.encoding.strategy': 'SPEED', 'hive.server2.tez.initialize.default.sessions': 'false', 'hive.security.authorization.enabled': 'false', 'hive.exec.post.hooks': 'org.apache.hadoop.hive.ql.hooks.ATSHook', 'hive.server2.tez.default.queues': 'default', 'hive.prewarm.enabled': 'false', 'hive.exec.orc.compression.strategy': 'SPEED', 'hive.optimize.index.filter': 'true', 'hive.stats.fetch.partition.stats': 'true', 'hive.auto.convert.join.noconditionaltask.size': '3042268501', 'hive.vectorized.execution.enabled': 'true', 'hive.exec.reducers.bytes.per.reducer': '67108864', 'hive.txn.manager': 'org.apache.hadoop.hive.ql.lockmgr.DummyTxnManager', 'hive.server2.tez.sessions.per.default.queue': '1', 'hive.prewarm.numcontainers': '3', 'hive.tez.dynamic.partition.pruning': 'true', 'hive.tez.auto.reducer.parallelism': 'true', 'hive.server2.use.SSL': 'false', 'hive.enforce.bucketing': 'false', 'hive.exec.failure.hooks': 'org.apache.hadoop.hive.ql.hooks.ATSHook', 'hive.support.concurrency': 'false', 'hive.tez.java.opts': '-server -Djava.net.preferIPv4Stack=true -XX:NewRatio=8 -XX:+UseNUMA -XX:+UseG1GC -XX:+ResizeTLAB -XX:+PrintGCDetails -verbose:gc -XX:+PrintGCTimeStamps', 'hive.security.metastore.authorization.manager': 'org.apache.hadoop.hive.ql.security.authorization.StorageBasedAuthorizationProvider', 'hive.exec.dynamic.partition.mode': 'strict', 'hive.security.authorization.manager': 'org.apache.hadoop.hive.ql.security.authorization.plugin.sqlstd.SQLStdConfOnlyAuthorizerFactory', 'hive.stats.fetch.column.stats': 'true', 'hive.optimize.sort.dynamic.partition': 'false', 'hive.server2.enable.doAs': 'true'} ******** SiteName: mapred-site, method: validateMapReduce2Configurations Site properties: {u'yarn.app.mapreduce.am.log.level': u'INFO', u'mapreduce.jobhistory.address': u'nvmd1cbb150d00.ril.com:10020', u'mapreduce.cluster.administrators': u' hadoop', u'mapreduce.reduce.input.buffer.percent': u'0.0', u'mapreduce.output.fileoutputformat.compress': u'false', u'mapreduce.framework.name': u'yarn', u'mapreduce.map.speculative': u'false', u'mapreduce.reduce.shuffle.merge.percent': u'0.66', u'yarn.app.mapreduce.am.resource.mb': u'8704', u'mapreduce.map.java.opts': u'-Xmx6963m', u'mapreduce.application.classpath': u'$PWD/mr-framework/hadoop/share/hadoop/mapreduce/*:$PWD/mr-framework/hadoop/share/hadoop/mapreduce/lib/*:$PWD/mr-framework/hadoop/share/hadoop/common/*:$PWD/mr-framework/hadoop/share/hadoop/common/lib/*:$PWD/mr-framework/hadoop/share/hadoop/yarn/*:$PWD/mr-framework/hadoop/share/hadoop/yarn/lib/*:$PWD/mr-framework/hadoop/share/hadoop/hdfs/*:$PWD/mr-framework/hadoop/share/hadoop/hdfs/lib/*:$PWD/mr-framework/hadoop/share/hadoop/tools/lib/*:/usr/hdp/${hdp.version}/hadoop/lib/hadoop-lzo-0.6.0.${hdp.version}.jar:/etc/hadoop/conf/secure', u'mapreduce.job.reduce.slowstart.completedmaps': u'0.05', u'mapreduce.output.fileoutputformat.compress.type': u'BLOCK', u'mapreduce.reduce.speculative': u'false', u'mapreduce.reduce.java.opts': u'-Xmx13926m', u'mapreduce.am.max-attempts': u'2', u'yarn.app.mapreduce.am.admin-command-opts': u'-Dhdp.version=${hdp.version}', u'mapreduce.reduce.log.level': u'INFO', u'mapreduce.map.sort.spill.percent': u'0.7', u'mapreduce.job.emit-timeline-data': u'false', u'mapreduce.application.framework.path': u'/hdp/apps/${hdp.version}/mapreduce/mapreduce.tar.gz#mr-framework', u'mapreduce.task.timeout': u'300000', u'mapreduce.map.memory.mb': u'8704', u'mapreduce.task.io.sort.factor': u'100', u'mapreduce.jobhistory.intermediate-done-dir': u'/mr-history/tmp', u'mapreduce.reduce.memory.mb': u'17408', u'mapreduce.jobhistory.recovery.enable': u'true', u'mapreduce.job.counters.max': u'130', u'mapreduce.map.log.level': u'INFO', u'mapreduce.shuffle.port': u'13562', u'mapreduce.jobhistory.recovery.store.leveldb.path': u'/hadoop/mapreduce/jhs', u'mapreduce.reduce.shuffle.fetch.retry.timeout-ms': u'30000', u'mapreduce.admin.user.env': u'LD_LIBRARY_PATH=/usr/hdp/${hdp.version}/hadoop/lib/native:/usr/hdp/${hdp.version}/hadoop/lib/native/Linux-amd64-64', u'mapreduce.jobhistory.recovery.store.class': u'org.apache.hadoop.mapreduce.v2.hs.HistoryServerLeveldbStateStoreService', u'mapreduce.map.output.compress': u'false', u'yarn.app.mapreduce.am.staging-dir': u'/user', u'mapreduce.reduce.shuffle.parallelcopies': u'30', u'yarn.app.mapreduce.am.command-opts': u'-Xmx6963m -Dhdp.version=${hdp.version}', u'mapreduce.jobhistory.webapp.address': u'nvmd1cbb150d00.ril.com:19888', u'mapreduce.jobhistory.done-dir': u'/mr-history/done', u'mapreduce.admin.reduce.child.java.opts': u'-server -XX:NewRatio=8 -Djava.net.preferIPv4Stack=true -Dhdp.version=${hdp.version}', u'mapreduce.reduce.shuffle.fetch.retry.enabled': u'1', u'mapreduce.task.io.sort.mb': u'2047', u'mapreduce.reduce.shuffle.input.buffer.percent': u'0.7', u'mapreduce.reduce.shuffle.fetch.retry.interval-ms': u'1000', u'mapreduce.jobhistory.bind-host': u'0.0.0.0', u'mapreduce.admin.map.child.java.opts': u'-server -XX:NewRatio=8 -Djava.net.preferIPv4Stack=true -Dhdp.version=${hdp.version}'} Recommendations: {'mapreduce.map.memory.mb': '8704', 'mapreduce.reduce.memory.mb': '17408', 'yarn.app.mapreduce.am.command-opts': '-Xmx6963m -Dhdp.version=${hdp.version}', 'mapreduce.reduce.java.opts': '-Xmx13926m', 'yarn.app.mapreduce.am.resource.mb': '8704', 'mapreduce.map.java.opts': '-Xmx6963m', 'mapreduce.task.io.sort.mb': '2047'} ******** SiteName: tez-site, method: validateTezConfigurations Site properties: {u'tez.task.get-task.sleep.interval-ms.max': u'200', u'tez.task.max-events-per-heartbeat': u'500', u'tez.task.launch.cmd-opts': u'-XX:+PrintGCDetails -verbose:gc -XX:+PrintGCTimeStamps -XX:+UseNUMA -XX:+UseG1GC -XX:+ResizeTLAB', u'tez.runtime.compress': u'true', u'tez.runtime.io.sort.mb': u'3481', u'tez.runtime.convert.user-payload.to.history-text': u'false', u'tez.generate.debug.artifacts': u'false', u'tez.am.tez-ui.history-url.template': u'__HISTORY_URL_BASE__?viewPath=%2F%23%2Ftez-app%2F__APPLICATION_ID__', u'tez.am.view-acls': u'*', u'tez.am.log.level': u'INFO', u'tez.counters.max.groups': u'3000', u'tez.counters.max': u'10000', u'tez.shuffle-vertex-manager.max-src-fraction': u'0.4', u'tez.runtime.unordered.output.buffer.size-mb': u'652', u'tez.task.resource.memory.mb': u'8704', u'tez.history.logging.service.class': u'org.apache.tez.dag.history.logging.ats.ATSV15HistoryLoggingService', u'tez.runtime.optimize.local.fetch': u'true', u'tez.am.launch.cmd-opts': u'-XX:+PrintGCDetails -verbose:gc -XX:+PrintGCTimeStamps -XX:+UseNUMA -XX:+UseG1GC -XX:+ResizeTLAB', u'tez.task.am.heartbeat.counter.interval-ms.max': u'4000', u'tez.am.max.app.attempts': u'2', u'tez.am.launch.env': u'LD_LIBRARY_PATH=/usr/hdp/${hdp.version}/hadoop/lib/native:/usr/hdp/${hdp.version}/hadoop/lib/native/Linux-amd64-64', u'tez.am.container.idle.release-timeout-max.millis': u'20000', u'tez.use.cluster.hadoop-libs': u'false', u'tez.am.launch.cluster-default.cmd-opts': u'-server -Djava.net.preferIPv4Stack=true -Dhdp.version=${hdp.version}', u'tez.am.container.idle.release-timeout-min.millis': u'10000', u'tez.grouping.min-size': u'16777216', u'tez.runtime.sorter.class': u'PIPELINED', u'tez.runtime.compress.codec': u'org.apache.hadoop.io.compress.SnappyCodec', u'tez.task.launch.cluster-default.cmd-opts': u'-server -Djava.net.preferIPv4Stack=true -Dhdp.version=${hdp.version}', u'tez.task.launch.env': u'LD_LIBRARY_PATH=/usr/hdp/${hdp.version}/hadoop/lib/native:/usr/hdp/${hdp.version}/hadoop/lib/native/Linux-amd64-64', u'tez.am.container.reuse.enabled': u'true', u'tez.session.am.dag.submit.timeout.secs': u'600', u'tez.grouping.split-waves': u'1.7', u'tez.grouping.max-size': u'1073741824', u'tez.session.client.timeout.secs': u'-1', u'tez.cluster.additional.classpath.prefix': u'/usr/hdp/${hdp.version}/hadoop/lib/hadoop-lzo-0.6.0.${hdp.version}.jar:/etc/hadoop/conf/secure', u'tez.lib.uris': u'/hdp/apps/${hdp.version}/tez/tez.tar.gz', u'tez.staging-dir': u'/tmp/${user.name}/staging', u'tez.am.am-rm.heartbeat.interval-ms.max': u'250', u'tez.am.maxtaskfailures.per.node': u'10', u'tez.task.generate.counters.per.io': u'true', u'tez.am.container.reuse.non-local-fallback.enabled': u'false', u'tez.am.container.reuse.rack-fallback.enabled': u'true', u'tez.tez-ui.history-url.base': u'http://nvmd1cbb210d00.ril.com:8080/#/main/views/TEZ/0.7.0.2.3.4.0-460/TEZ_CLUSTER_INSTANCE', u'tez.runtime.pipelined.sorter.sort.threads': u'2', u'tez.am.container.reuse.locality.delay-allocation-millis': u'250', u'tez.shuffle-vertex-manager.min-src-fraction': u'0.2', u'tez.am.resource.memory.mb': u'8704'} Recommendations: {'tez.task.resource.memory.mb': '8704', 'tez.am.launch.cmd-opts': '-XX:+PrintGCDetails -verbose:gc -XX:+PrintGCTimeStamps -XX:+UseNUMA -XX:+UseG1GC -XX:+ResizeTLAB', 'tez.task.launch.cmd-opts': '-XX:+PrintGCDetails -verbose:gc -XX:+PrintGCTimeStamps -XX:+UseNUMA -XX:+UseG1GC -XX:+ResizeTLAB', 'tez.runtime.io.sort.mb': '3481', 'tez.session.am.dag.submit.timeout.secs': '600', 'tez.tez-ui.history-url.base': 'http://nvmd1cbb210d00.ril.com:8080/#/main/views/TEZ/0.7.0.2.3.4.0-460/TEZ_CLUSTER_INSTANCE', 'tez.runtime.unordered.output.buffer.size-mb': '652', 'tez.am.resource.memory.mb': '8704'} ******** SiteName: yarn-env, method: validateYARNEnvConfigurations Site properties: {u'yarn_pid_dir_prefix': u'/var/run/hadoop-yarn', u'yarn_user_nproc_limit': u'65536', u'apptimelineserver_heapsize': u'1024', u'yarn_user_nofile_limit': u'32768', u'is_supported_yarn_ranger': u'true', u'nodemanager_heapsize': u'2048', u'content': u'\n export HADOOP_YARN_HOME={{hadoop_yarn_home}}\n export YARN_LOG_DIR={{yarn_log_dir_prefix}}/$USER\n export YARN_PID_DIR={{yarn_pid_dir_prefix}}/$USER\n export HADOOP_LIBEXEC_DIR={{hadoop_libexec_dir}}\n export JAVA_HOME={{java64_home}}\n export JAVA_LIBRARY_PATH="${JAVA_LIBRARY_PATH}:{{hadoop_java_io_tmpdir}}"\n\n # We need to add the EWMA appender for the yarn daemons only;\n # however, YARN_ROOT_LOGGER is shared by the yarn client and the\n # daemons. This is restrict the EWMA appender to daemons only.\n INVOKER="${0##*/}"\n if [ "$INVOKER" == "yarn-daemon.sh" ]; then\n export YARN_ROOT_LOGGER=${YARN_ROOT_LOGGER:-INFO,EWMA,RFA}\n fi\n\n # User for YARN daemons\n export HADOOP_YARN_USER=${HADOOP_YARN_USER:-yarn}\n\n # resolve links - $0 may be a softlink\n export YARN_CONF_DIR="${YARN_CONF_DIR:-$HADOOP_YARN_HOME/conf}"\n\n # some Java parameters\n # export JAVA_HOME=/home/y/libexec/jdk1.6.0/\n if [ "$JAVA_HOME" != "" ]; then\n #echo "run java in $JAVA_HOME"\n JAVA_HOME=$JAVA_HOME\n fi\n\n if [ "$JAVA_HOME" = "" ]; then\n echo "Error: JAVA_HOME is not set."\n exit 1\n fi\n\n JAVA=$JAVA_HOME/bin/java\n JAVA_HEAP_MAX=-Xmx1000m\n\n # For setting YARN specific HEAP sizes please use this\n # Parameter and set appropriately\n YARN_HEAPSIZE={{yarn_heapsize}}\n\n # check envvars which might override default args\n if [ "$YARN_HEAPSIZE" != "" ]; then\n JAVA_HEAP_MAX="-Xmx""$YARN_HEAPSIZE""m"\n fi\n\n # Resource Manager specific parameters\n\n # Specify the max Heapsize for the ResourceManager using a numerical value\n # in the scale of MB. For example, to specify an jvm option of -Xmx1000m, set\n # the value to 1000.\n # This value will be overridden by an Xmx setting specified in either YARN_OPTS\n # and/or YARN_RESOURCEMANAGER_OPTS.\n # If not specified, the default value will be picked from either YARN_HEAPMAX\n # or JAVA_HEAP_MAX with YARN_HEAPMAX as the preferred option of the two.\n export YARN_RESOURCEMANAGER_HEAPSIZE={{resourcemanager_heapsize}}\n\n # Specify the JVM options to be used when starting the ResourceManager.\n # These options will be appended to the options specified as YARN_OPTS\n # and therefore may override any similar flags set in YARN_OPTS\n #export YARN_RESOURCEMANAGER_OPTS=\n\n # Node Manager specific parameters\n\n # Specify the max Heapsize for the NodeManager using a numerical value\n # in the scale of MB. For example, to specify an jvm option of -Xmx1000m, set\n # the value to 1000.\n # This value will be overridden by an Xmx setting specified in either YARN_OPTS\n # and/or YARN_NODEMANAGER_OPTS.\n # If not specified, the default value will be picked from either YARN_HEAPMAX\n # or JAVA_HEAP_MAX with YARN_HEAPMAX as the preferred option of the two.\n export YARN_NODEMANAGER_HEAPSIZE={{nodemanager_heapsize}}\n\n # Specify the max Heapsize for the timeline server using a numerical value\n # in the scale of MB. For example, to specify an jvm option of -Xmx1000m, set\n # the value to 1024.\n # This value will be overridden by an Xmx setting specified in either YARN_OPTS\n # and/or YARN_TIMELINESERVER_OPTS.\n # If not specified, the default value will be picked from either YARN_HEAPMAX\n # or JAVA_HEAP_MAX with YARN_HEAPMAX as the preferred option of the two.\n export YARN_TIMELINESERVER_HEAPSIZE={{apptimelineserver_heapsize}}\n\n # Specify the JVM options to be used when starting the NodeManager.\n # These options will be appended to the options specified as YARN_OPTS\n # and therefore may override any similar flags set in YARN_OPTS\n #export YARN_NODEMANAGER_OPTS=\n\n # so that filenames w/ spaces are handled correctly in loops below\n IFS=\n\n\n # default log directory and file\n if [ "$YARN_LOG_DIR" = "" ]; then\n YARN_LOG_DIR="$HADOOP_YARN_HOME/logs"\n fi\n if [ "$YARN_LOGFILE" = "" ]; then\n YARN_LOGFILE=\'yarn.log\'\n fi\n\n # default policy file for service-level authorization\n if [ "$YARN_POLICYFILE" = "" ]; then\n YARN_POLICYFILE="hadoop-policy.xml"\n fi\n\n # restore ordinary behaviour\n unset IFS\n\n\n YARN_OPTS="$YARN_OPTS -Dhadoop.log.dir=$YARN_LOG_DIR"\n YARN_OPTS="$YARN_OPTS -Dyarn.log.dir=$YARN_LOG_DIR"\n YARN_OPTS="$YARN_OPTS -Dhadoop.log.file=$YARN_LOGFILE"\n YARN_OPTS="$YARN_OPTS -Dyarn.log.file=$YARN_LOGFILE"\n YARN_OPTS="$YARN_OPTS -Dyarn.home.dir=$YARN_COMMON_HOME"\n YARN_OPTS="$YARN_OPTS -Dyarn.id.str=$YARN_IDENT_STRING"\n YARN_OPTS="$YARN_OPTS -Dhadoop.root.logger=${YARN_ROOT_LOGGER:-INFO,console}"\n YARN_OPTS="$YARN_OPTS -Dyarn.root.logger=${YARN_ROOT_LOGGER:-INFO,console}"\n if [ "x$JAVA_LIBRARY_PATH" != "x" ]; then\n YARN_OPTS="$YARN_OPTS -Djava.library.path=$JAVA_LIBRARY_PATH"\n fi\n YARN_OPTS="$YARN_OPTS -Dyarn.policy.file=$YARN_POLICYFILE"\n YARN_OPTS="$YARN_OPTS -Djava.io.tmpdir={{hadoop_java_io_tmpdir}}"', u'yarn_heapsize': u'1024', u'min_user_id': u'500', u'yarn_cgroups_enabled': u'false', u'yarn_user': u'yarn', u'resourcemanager_heapsize': u'2048', u'yarn_log_dir_prefix': u'/var/log/hadoop-yarn'} Recommendations: {'min_user_id': '500'} ******** SiteName: yarn-site, method: validateYARNConfigurations Site properties: {u'nodemanager_hosts': u'[nvmd1cbb150d00.ril.com, nvmd1cbb190d00.ril.com]', u'yarn.client.nodemanager-connect.max-wait-ms': u'60000', u'yarn.node-labels.enabled': u'false', u'yarn.resourcemanager.scheduler.monitor.enable': u'false', u'yarn.resourcemanager.zk-num-retries': u'1000', u'yarn.timeline-service.bind-host': u'0.0.0.0', u'yarn.resourcemanager.ha.enabled': u'false', u'yarn.nodemanager.linux-container-executor.cgroups.hierarchy': u'hadoop-yarn', u'yarn.timeline-service.webapp.address': u'nvmd1cbb150d00.ril.com:8188', u'yarn.resourcemanager.state-store.max-completed-applications': u'${yarn.resourcemanager.max-completed-applications}', u'yarn.timeline-service.enabled': u'true', u'yarn.nodemanager.recovery.enabled': u'true', u'yarn.timeline-service.http-authentication.type': u'simple', u'yarn.resourcemanager.webapp.https.address': u'nvmd1cbb150d00.ril.com:8090', u'yarn.timeline-service.entity-group-fs-store.summary-store': u'org.apache.hadoop.yarn.server.timeline.RollingLevelDBTimelineStore', u'yarn.resourcemanager.hostname': u'nvmd1cbb150d00.ril.com', u'yarn.resourcemanager.am.max-attempts': u'2', u'yarn.nodemanager.log-aggregation.debug-enabled': u'false', u'yarn.scheduler.maximum-allocation-vcores': u'16', u'yarn.nodemanager.health-checker.script.timeout-ms': u'60000', u'yarn.nodemanager.vmem-pmem-ratio': u'2.1', u'yarn.resourcemanager.nodes.exclude-path': u'/etc/hadoop/conf/yarn.exclude', u'yarn.nodemanager.linux-container-executor.cgroups.mount': u'false', u'yarn.resourcemanager.system-metrics-publisher.dispatcher.pool-size': u'10', u'yarn.log.server.url': u'http://nvmd1cbb150d00.ril.com:19888/jobhistory/logs', u'yarn.application.classpath': u'$HADOOP_CONF_DIR,/usr/hdp/current/hadoop-client/*,/usr/hdp/current/hadoop-client/lib/*,/usr/hdp/current/hadoop-hdfs-client/*,/usr/hdp/current/hadoop-hdfs-client/lib/*,/usr/hdp/current/hadoop-yarn-client/*,/usr/hdp/current/hadoop-yarn-client/lib/*', u'yarn.resourcemanager.webapp.delegation-token-auth-filter.enabled': u'false', u'yarn.nodemanager.resource.cpu-vcores': u'16', u'yarn.nodemanager.local-dirs': u'/data1/hadoop/yarn/local,/data2/hadoop/yarn/local', u'yarn.nodemanager.linux-container-executor.cgroups.strict-resource-usage': u'false', u'yarn.nodemanager.remote-app-log-dir-suffix': u'logs', u'yarn.resourcemanager.connect.max-wait.ms': u'900000', u'yarn.resourcemanager.address': u'nvmd1cbb150d00.ril.com:8050', u'yarn.scheduler.maximum-allocation-mb': u'78336', u'yarn.nodemanager.container-monitor.interval-ms': u'3000', u'yarn.node-labels.fs-store.retry-policy-spec': u'2000, 500', u'yarn.resourcemanager.zk-acl': u'world:anyone:rwcda', u'yarn.timeline-service.leveldb-state-store.path': u'/data1/hadoop/yarn/timeline', u'yarn.timeline-service.address': u'nvmd1cbb150d00.ril.com:10200', u'yarn.log-aggregation-enable': u'true', u'yarn.nodemanager.delete.debug-delay-sec': u'0', u'yarn.timeline-service.store-class': u'org.apache.hadoop.yarn.server.timeline.EntityGroupFSTimelineStore', u'yarn.timeline-service.client.retry-interval-ms': u'1000', u'yarn.timeline-service.entity-group-fs-store.group-id-plugin-classes': u'org.apache.tez.dag.history.logging.ats.TimelineCachePluginImpl', u'hadoop.registry.zk.quorum': u'nvmd1cba190d00.ril.com:2181,nvmd1cbb150d00.ril.com:2181,nvmd1cbb190d00.ril.com:2181', u'yarn.nodemanager.aux-services': u'mapreduce_shuffle,spark_shuffle', u'yarn.nodemanager.aux-services.mapreduce_shuffle.class': u'org.apache.hadoop.mapred.ShuffleHandler', u'yarn.nodemanager.disk-health-checker.max-disk-utilization-per-disk-percentage': u'90', u'yarn.resourcemanager.zk-timeout-ms': u'10000', u'yarn.resourcemanager.fs.state-store.uri': u' ', u'yarn.nodemanager.linux-container-executor.group': u'hadoop', u'yarn.nodemanager.remote-app-log-dir': u'/app-logs', u'yarn.timeline-service.entity-group-fs-store.cleaner-interval-seconds': u'3600', u'yarn.resourcemanager.fs.state-store.retry-policy-spec': u'2000, 500', u'yarn.timeline-service.generic-application-history.store-class': u'org.apache.hadoop.yarn.server.applicationhistoryservice.NullApplicationHistoryStore', u'yarn.nodemanager.disk-health-checker.min-healthy-disks': u'0.25', u'yarn.resourcemanager.work-preserving-recovery.enabled': u'true', u'yarn.resourcemanager.resource-tracker.address': u'nvmd1cbb150d00.ril.com:8025', u'yarn.resourcemanager.system-metrics-publisher.enabled': u'true', u'yarn.resourcemanager.scheduler.class': u'org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler', u'yarn.nodemanager.resource.memory-mb': u'78336', u'yarn.timeline-service.entity-group-fs-store.active-dir': u'/ats/active/', u'yarn.timeline-service.ttl-ms': u'2678400000', u'yarn.nodemanager.resource.percentage-physical-cpu-limit': u'80', u'yarn.nodemanager.disk-health-checker.min-free-space-per-disk-mb': u'1000', u'yarn.nodemanager.log-aggregation.roll-monitoring-interval-seconds': u'-1', u'yarn.nodemanager.log.retain-second': u'604800', u'yarn.timeline-service.state-store-class': u'org.apache.hadoop.yarn.server.timeline.recovery.LeveldbTimelineStateStore', u'yarn.nodemanager.log-dirs': u'/data1/hadoop/yarn/log,/data2/hadoop/yarn/log', u'yarn.timeline-service.client.max-retries': u'30', u'yarn.nodemanager.health-checker.interval-ms': u'135000', u'resourcemanager_hosts': u'[nvmd1cbb150d00.ril.com]', u'yarn.nodemanager.admin-env': u'MALLOC_ARENA_MAX=$MALLOC_ARENA_MAX', u'yarn.nodemanager.vmem-check-enabled': u'false', u'yarn.acl.enable': u'false', u'yarn.timeline-service.leveldb-timeline-store.read-cache-size': u'104857600', u'yarn.nodemanager.linux-container-executor.resources-handler.class': u'org.apache.hadoop.yarn.server.nodemanager.util.DefaultLCEResourcesHandler', u'yarn.resourcemanager.webapp.address': u'nvmd1cbb150d00.ril.com:8088', u'yarn.timeline-service.http-authentication.simple.anonymous.allowed': u'true', u'yarn.timeline-service.leveldb-timeline-store.start-time-read-cache-size': u'10000', u'yarn.resourcemanager.bind-host': u'0.0.0.0', u'yarn.http.policy': u'HTTP_ONLY', u'yarn.timeline-service.version': u'1.5', u'yarn.resourcemanager.zk-address': u'nvmd1cba190d00.ril.com:2181,nvmd1cbb150d00.ril.com:2181,nvmd1cbb190d00.ril.com:2181', u'yarn.nodemanager.recovery.dir': u'{{yarn_log_dir_prefix}}/nodemanager/recovery-state', u'yarn.nodemanager.container-executor.class': u'org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor', u'yarn.resourcemanager.store.class': u'org.apache.hadoop.yarn.server.resourcemanager.recovery.ZKRMStateStore', u'yarn.timeline-service.entity-group-fs-store.retain-seconds': u'604800', u'yarn.scheduler.minimum-allocation-vcores': u'1', u'yarn.timeline-service.leveldb-timeline-store.path': u'/data1/hadoop/yarn/timeline', u'yarn.scheduler.minimum-allocation-mb': u'8704', u'yarn.timeline-service.ttl-enable': u'true', u'yarn.resourcemanager.scheduler.address': u'nvmd1cbb150d00.ril.com:8030', u'yarn.log-aggregation.retain-seconds': u'2592000', u'yarn.nodemanager.address': u'0.0.0.0:45454', u'hadoop.registry.rm.enabled': u'false', u'app_timeline_server_host': u'[nvmd1cbb150d00.ril.com]', u'yarn.resourcemanager.work-preserving-recovery.scheduling-wait-ms': u'10000', u'yarn.resourcemanager.zk-state-store.parent-path': u'/rmstore', u'yarn.nodemanager.log-aggregation.compression-type': u'gz', u'yarn.nodemanager.log-aggregation.num-log-files-per-app': u'30', u'yarn.resourcemanager.recovery.enabled': u'true', u'yarn.timeline-service.recovery.enabled': u'true', u'yarn.nodemanager.bind-host': u'0.0.0.0', u'yarn.resourcemanager.zk-retry-interval-ms': u'1000', u'yarn.timeline-service.leveldb-timeline-store.ttl-interval-ms': u'300000', u'yarn.admin.acl': u'yarn', u'yarn.node-labels.fs-store.root-dir': u'/system/yarn/node-labels', u'yarn.timeline-service.entity-group-fs-store.scan-interval-seconds': u'60', u'yarn.timeline-service.entity-group-fs-store.done-dir': u'/ats/done/', u'yarn.nodemanager.aux-services.spark_shuffle.class': u'org.apache.spark.network.yarn.YarnShuffleService', u'yarn.client.nodemanager-connect.retry-interval-ms': u'10000', u'yarn.resourcemanager.admin.address': u'nvmd1cbb150d00.ril.com:8141', u'yarn.timeline-service.webapp.https.address': u'nvmd1cbb150d00.ril.com:8190', u'yarn.resourcemanager.connect.retry-interval.ms': u'30000', u'yarn.timeline-service.leveldb-timeline-store.start-time-write-cache-size': u'10000'} Recommendations: {'yarn.timeline-service.entity-group-fs-store.group-id-plugin-classes': 'org.apache.tez.dag.history.logging.ats.TimelineCachePluginImpl', 'yarn.nodemanager.container-executor.class': 'org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor', 'yarn.scheduler.minimum-allocation-vcores': '1', 'yarn.scheduler.maximum-allocation-vcores': '16', 'yarn.nodemanager.resource.memory-mb': '78336', 'yarn.scheduler.minimum-allocation-mb': '8704', 'yarn.nodemanager.resource.cpu-vcores': '16', 'yarn.scheduler.maximum-allocation-mb': '78336', 'yarn.nodemanager.linux-container-executor.group': 'hadoop'} ******** 12 Jun 2017 14:11:39,249 INFO [qtp-ambari-client-96289] StackAdvisorRunner:71 - advisor script stderr: 12 Jun 2017 14:11:46,174 INFO [qtp-ambari-client-96252] AmbariManagementControllerImpl:1355 - Received a updateCluster request, clusterId=3, clusterName=rrahdpqa, securityType=null, request={ clusterName=rrahdpqa, clusterId=3, provisioningState=null, securityType=null, stackVersion=HDP-2.4, desired_scv=null, hosts=[] } 12 Jun 2017 14:11:46,176 INFO [qtp-ambari-client-96252] AmbariManagementControllerImpl:1474 - Applying configuration with tag 'version1497256899433' to cluster 'rrahdpqa' for configuration type capacity-scheduler 12 Jun 2017 14:11:46,457 INFO [qtp-ambari-client-96289] AbstractProviderModule:878 - Current Metrics collector Host : null 12 Jun 2017 14:11:46,458 INFO [qtp-ambari-client-96289] AbstractProviderModule:883 - New Metrics collector Host : nvmd1cbb190d00.ril.com 12 Jun 2017 14:11:47,430 ERROR [pool-9-thread-34342] BaseProvider:240 - Caught exception getting JMX metrics : Connection refused, skipping same exceptions for next 5 minutes java.net.ConnectException: Connection refused at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:589) at sun.net.NetworkClient.doConnect(NetworkClient.java:175) at sun.net.www.http.HttpClient.openServer(HttpClient.java:432) at sun.net.www.http.HttpClient.openServer(HttpClient.java:527) at sun.net.www.http.HttpClient.(HttpClient.java:211) at sun.net.www.http.HttpClient.New(HttpClient.java:308) at sun.net.www.http.HttpClient.New(HttpClient.java:326) at sun.net.www.protocol.http.HttpURLConnection.getNewHttpClient(HttpURLConnection.java:1169) at sun.net.www.protocol.http.HttpURLConnection.plainConnect0(HttpURLConnection.java:1105) at sun.net.www.protocol.http.HttpURLConnection.plainConnect(HttpURLConnection.java:999) at sun.net.www.protocol.http.HttpURLConnection.connect(HttpURLConnection.java:933) at sun.net.www.protocol.http.HttpURLConnection.getInputStream0(HttpURLConnection.java:1513) at sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1441) at java.net.HttpURLConnection.getResponseCode(HttpURLConnection.java:480) at org.apache.ambari.server.controller.internal.URLStreamProvider.processURL(URLStreamProvider.java:209) at org.apache.ambari.server.controller.internal.URLStreamProvider.processURL(URLStreamProvider.java:133) at org.apache.ambari.server.controller.internal.URLStreamProvider.readFrom(URLStreamProvider.java:107) at org.apache.ambari.server.controller.internal.URLStreamProvider.readFrom(URLStreamProvider.java:112) at org.apache.ambari.server.controller.jmx.JMXPropertyProvider.populateResource(JMXPropertyProvider.java:212) at org.apache.ambari.server.controller.metrics.ThreadPoolEnabledPropertyProvider$1.call(ThreadPoolEnabledPropertyProvider.java:180) at org.apache.ambari.server.controller.metrics.ThreadPoolEnabledPropertyProvider$1.call(ThreadPoolEnabledPropertyProvider.java:178) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 12 Jun 2017 14:11:49,942 INFO [qtp-ambari-client-96296] StackAdvisorRunner:47 - Script=/var/lib/ambari-server/resources/scripts/stack_advisor.py, actionDirectory=/var/run/ambari-server/stack-recommendations/12, command=recommend-configurations 12 Jun 2017 14:11:49,946 INFO [qtp-ambari-client-96296] StackAdvisorRunner:61 - Stack-advisor output=/var/run/ambari-server/stack-recommendations/12/stackadvisor.out, error=/var/run/ambari-server/stack-recommendations/12/stackadvisor.err 12 Jun 2017 14:11:50,315 INFO [qtp-ambari-client-96296] StackAdvisorRunner:69 - Stack advisor output files 12 Jun 2017 14:11:50,316 INFO [qtp-ambari-client-96296] StackAdvisorRunner:70 - advisor script stdout: StackAdvisor implementation for stack HDP, version 2.0.6 was loaded StackAdvisor implementation for stack HDP, version 2.1 was loaded StackAdvisor implementation for stack HDP, version 2.2 was loaded StackAdvisor implementation for stack HDP, version 2.3 was loaded StackAdvisor implementation for stack HDP, version 2.4 was loaded Returning HDP24StackAdvisor implementation max_inmemory_regions: -2.7 Processing file: /var/lib/ambari-server/resources/stacks/HDP/2.4/services/../../../../common-services/AMBARI_METRICS/0.1.0/package/files/service-metrics/HDFS.txt Processing file: /var/lib/ambari-server/resources/stacks/HDP/2.4/services/../../../../common-services/AMBARI_METRICS/0.1.0/package/files/service-metrics/HOST.txt Processing file: /var/lib/ambari-server/resources/stacks/HDP/2.4/services/../../../../common-services/AMBARI_METRICS/0.1.0/package/files/service-metrics/HBASE.txt Processing file: /var/lib/ambari-server/resources/stacks/HDP/2.4/services/../../../../common-services/AMBARI_METRICS/0.1.0/package/files/service-metrics/AMBARI_METRICS.txt Processing file: /var/lib/ambari-server/resources/stacks/HDP/2.4/services/../../../../common-services/AMBARI_METRICS/0.1.0/package/files/service-metrics/YARN.txt metrics length: 216 12 Jun 2017 14:11:50,316 INFO [qtp-ambari-client-96296] StackAdvisorRunner:71 - advisor script stderr: 12 Jun 2017 14:12:00,327 INFO [qtp-ambari-client-96298] AmbariManagementControllerImpl:3385 - Received action execution request, clusterName=rrahdpqa, request=isCommand :true, action :null, command :RESTART, inputs :{}, resourceFilters: [RequestResourceFilter{serviceName='YARN', componentName='RESOURCEMANAGER', hostNames=[nvmd1cbb150d00.ril.com]}], exclusive: false, clusterName :rrahdpqa 12 Jun 2017 14:12:00,335 INFO [qtp-ambari-client-96298] AmbariCustomCommandExecutionHelper:1135 - Iterating service type Instance in getCommandJson:: SQOOP 12 Jun 2017 14:12:00,335 INFO [qtp-ambari-client-96298] AmbariCustomCommandExecutionHelper:1135 - Iterating service type Instance in getCommandJson:: HDFS 12 Jun 2017 14:12:00,336 INFO [qtp-ambari-client-96298] AmbariCustomCommandExecutionHelper:1135 - Iterating service type Instance in getCommandJson:: MAPREDUCE2 12 Jun 2017 14:12:00,336 INFO [qtp-ambari-client-96298] AmbariCustomCommandExecutionHelper:1135 - Iterating service type Instance in getCommandJson:: OOZIE 12 Jun 2017 14:12:00,336 INFO [qtp-ambari-client-96298] AmbariCustomCommandExecutionHelper:1135 - Iterating service type Instance in getCommandJson:: TEZ 12 Jun 2017 14:12:00,337 INFO [qtp-ambari-client-96298] AmbariCustomCommandExecutionHelper:1135 - Iterating service type Instance in getCommandJson:: SPARK 12 Jun 2017 14:12:00,337 INFO [qtp-ambari-client-96298] AmbariCustomCommandExecutionHelper:1135 - Iterating service type Instance in getCommandJson:: HBASE 12 Jun 2017 14:12:00,338 INFO [qtp-ambari-client-96298] AmbariCustomCommandExecutionHelper:1135 - Iterating service type Instance in getCommandJson:: ZOOKEEPER 12 Jun 2017 14:12:00,338 INFO [qtp-ambari-client-96298] AmbariCustomCommandExecutionHelper:1135 - Iterating service type Instance in getCommandJson:: YARN 12 Jun 2017 14:12:00,339 INFO [qtp-ambari-client-96298] AmbariCustomCommandExecutionHelper:1135 - Iterating service type Instance in getCommandJson:: PIG 12 Jun 2017 14:12:00,339 INFO [qtp-ambari-client-96298] AmbariCustomCommandExecutionHelper:1135 - Iterating service type Instance in getCommandJson:: HIVE 12 Jun 2017 14:12:00,339 INFO [qtp-ambari-client-96298] AmbariCustomCommandExecutionHelper:1135 - Iterating service type Instance in getCommandJson:: AMBARI_METRICS 12 Jun 2017 14:12:01,004 INFO [qtp-ambari-agent-96250] HeartBeatHandler:309 - HeartBeatHandler.sendCommands: sending ExecutionCommand for host nvmd1cbb150d00.ril.com, role RESOURCEMANAGER, roleCommand CUSTOM_COMMAND, and command ID 341-0, task ID 3569 12 Jun 2017 14:12:11,906 INFO [ambari-heartbeat-processor-0] HeartbeatProcessor:496 - Updating applied config on service YARN, component RESOURCEMANAGER, host nvmd1cbb150d00.ril.com 12 Jun 2017 19:35:51,926 ERROR [pool-9-thread-34425] BaseProvider:240 - Caught exception getting JMX metrics : Connection refused, skipping same exceptions for next 5 minutes java.net.ConnectException: Connection refused at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:589) at sun.net.NetworkClient.doConnect(NetworkClient.java:175) at sun.net.www.http.HttpClient.openServer(HttpClient.java:432) at sun.net.www.http.HttpClient.openServer(HttpClient.java:527) at sun.net.www.http.HttpClient.(HttpClient.java:211) at sun.net.www.http.HttpClient.New(HttpClient.java:308) at sun.net.www.http.HttpClient.New(HttpClient.java:326) at sun.net.www.protocol.http.HttpURLConnection.getNewHttpClient(HttpURLConnection.java:1169) at sun.net.www.protocol.http.HttpURLConnection.plainConnect0(HttpURLConnection.java:1105) at sun.net.www.protocol.http.HttpURLConnection.plainConnect(HttpURLConnection.java:999) at sun.net.www.protocol.http.HttpURLConnection.connect(HttpURLConnection.java:933) at sun.net.www.protocol.http.HttpURLConnection.getInputStream0(HttpURLConnection.java:1513) at sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1441) at java.net.HttpURLConnection.getResponseCode(HttpURLConnection.java:480) at org.apache.ambari.server.controller.internal.URLStreamProvider.processURL(URLStreamProvider.java:209) at org.apache.ambari.server.controller.internal.URLStreamProvider.processURL(URLStreamProvider.java:133) at org.apache.ambari.server.controller.internal.URLStreamProvider.readFrom(URLStreamProvider.java:107) at org.apache.ambari.server.controller.internal.URLStreamProvider.readFrom(URLStreamProvider.java:112) at org.apache.ambari.server.controller.jmx.JMXPropertyProvider.populateResource(JMXPropertyProvider.java:212) at org.apache.ambari.server.controller.metrics.ThreadPoolEnabledPropertyProvider$1.call(ThreadPoolEnabledPropertyProvider.java:180) at org.apache.ambari.server.controller.metrics.ThreadPoolEnabledPropertyProvider$1.call(ThreadPoolEnabledPropertyProvider.java:178) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 13 Jun 2017 16:09:35,826 ERROR [pool-9-thread-34456] BaseProvider:240 - Caught exception getting JMX metrics : Connection refused, skipping same exceptions for next 5 minutes java.net.ConnectException: Connection refused at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:589) at sun.net.NetworkClient.doConnect(NetworkClient.java:175) at sun.net.www.http.HttpClient.openServer(HttpClient.java:432) at sun.net.www.http.HttpClient.openServer(HttpClient.java:527) at sun.net.www.http.HttpClient.(HttpClient.java:211) at sun.net.www.http.HttpClient.New(HttpClient.java:308) at sun.net.www.http.HttpClient.New(HttpClient.java:326) at sun.net.www.protocol.http.HttpURLConnection.getNewHttpClient(HttpURLConnection.java:1169) at sun.net.www.protocol.http.HttpURLConnection.plainConnect0(HttpURLConnection.java:1105) at sun.net.www.protocol.http.HttpURLConnection.plainConnect(HttpURLConnection.java:999) at sun.net.www.protocol.http.HttpURLConnection.connect(HttpURLConnection.java:933) at sun.net.www.protocol.http.HttpURLConnection.getInputStream0(HttpURLConnection.java:1513) at sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1441) at java.net.HttpURLConnection.getResponseCode(HttpURLConnection.java:480) at org.apache.ambari.server.controller.internal.URLStreamProvider.processURL(URLStreamProvider.java:209) at org.apache.ambari.server.controller.internal.URLStreamProvider.processURL(URLStreamProvider.java:133) at org.apache.ambari.server.controller.internal.URLStreamProvider.readFrom(URLStreamProvider.java:107) at org.apache.ambari.server.controller.internal.URLStreamProvider.readFrom(URLStreamProvider.java:112) at org.apache.ambari.server.controller.jmx.JMXPropertyProvider.populateResource(JMXPropertyProvider.java:212) at org.apache.ambari.server.controller.metrics.ThreadPoolEnabledPropertyProvider$1.call(ThreadPoolEnabledPropertyProvider.java:180) at org.apache.ambari.server.controller.metrics.ThreadPoolEnabledPropertyProvider$1.call(ThreadPoolEnabledPropertyProvider.java:178) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 13 Jun 2017 17:10:31,157 ERROR [pool-9-thread-34955] BaseProvider:240 - Caught exception getting JMX metrics : Connection refused, skipping same exceptions for next 5 minutes java.net.ConnectException: Connection refused at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:589) at sun.net.NetworkClient.doConnect(NetworkClient.java:175) at sun.net.www.http.HttpClient.openServer(HttpClient.java:432) at sun.net.www.http.HttpClient.openServer(HttpClient.java:527) at sun.net.www.http.HttpClient.(HttpClient.java:211) at sun.net.www.http.HttpClient.New(HttpClient.java:308) at sun.net.www.http.HttpClient.New(HttpClient.java:326) at sun.net.www.protocol.http.HttpURLConnection.getNewHttpClient(HttpURLConnection.java:1169) at sun.net.www.protocol.http.HttpURLConnection.plainConnect0(HttpURLConnection.java:1105) at sun.net.www.protocol.http.HttpURLConnection.plainConnect(HttpURLConnection.java:999) at sun.net.www.protocol.http.HttpURLConnection.connect(HttpURLConnection.java:933) at sun.net.www.protocol.http.HttpURLConnection.getInputStream0(HttpURLConnection.java:1513) at sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1441) at java.net.HttpURLConnection.getResponseCode(HttpURLConnection.java:480) at org.apache.ambari.server.controller.internal.URLStreamProvider.processURL(URLStreamProvider.java:209) at org.apache.ambari.server.controller.internal.URLStreamProvider.processURL(URLStreamProvider.java:133) at org.apache.ambari.server.controller.internal.URLStreamProvider.readFrom(URLStreamProvider.java:107) at org.apache.ambari.server.controller.internal.URLStreamProvider.readFrom(URLStreamProvider.java:112) at org.apache.ambari.server.controller.jmx.JMXPropertyProvider.populateResource(JMXPropertyProvider.java:212) at org.apache.ambari.server.controller.metrics.ThreadPoolEnabledPropertyProvider$1.call(ThreadPoolEnabledPropertyProvider.java:180) at org.apache.ambari.server.controller.metrics.ThreadPoolEnabledPropertyProvider$1.call(ThreadPoolEnabledPropertyProvider.java:178) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 14 Jun 2017 13:13:50,630 ERROR [pool-9-thread-37234] BaseProvider:240 - Caught exception getting JMX metrics : Connection refused, skipping same exceptions for next 5 minutes java.net.ConnectException: Connection refused at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:589) at sun.net.NetworkClient.doConnect(NetworkClient.java:175) at sun.net.www.http.HttpClient.openServer(HttpClient.java:432) at sun.net.www.http.HttpClient.openServer(HttpClient.java:527) at sun.net.www.http.HttpClient.(HttpClient.java:211) at sun.net.www.http.HttpClient.New(HttpClient.java:308) at sun.net.www.http.HttpClient.New(HttpClient.java:326) at sun.net.www.protocol.http.HttpURLConnection.getNewHttpClient(HttpURLConnection.java:1169) at sun.net.www.protocol.http.HttpURLConnection.plainConnect0(HttpURLConnection.java:1105) at sun.net.www.protocol.http.HttpURLConnection.plainConnect(HttpURLConnection.java:999) at sun.net.www.protocol.http.HttpURLConnection.connect(HttpURLConnection.java:933) at sun.net.www.protocol.http.HttpURLConnection.getInputStream0(HttpURLConnection.java:1513) at sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1441) at java.net.HttpURLConnection.getResponseCode(HttpURLConnection.java:480) at org.apache.ambari.server.controller.internal.URLStreamProvider.processURL(URLStreamProvider.java:209) at org.apache.ambari.server.controller.internal.URLStreamProvider.processURL(URLStreamProvider.java:133) at org.apache.ambari.server.controller.internal.URLStreamProvider.readFrom(URLStreamProvider.java:107) at org.apache.ambari.server.controller.internal.URLStreamProvider.readFrom(URLStreamProvider.java:112) at org.apache.ambari.server.controller.jmx.JMXPropertyProvider.populateResource(JMXPropertyProvider.java:212) at org.apache.ambari.server.controller.metrics.ThreadPoolEnabledPropertyProvider$1.call(ThreadPoolEnabledPropertyProvider.java:180) at org.apache.ambari.server.controller.metrics.ThreadPoolEnabledPropertyProvider$1.call(ThreadPoolEnabledPropertyProvider.java:178) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 14 Jun 2017 14:16:08,006 ERROR [pool-9-thread-37865] BaseProvider:240 - Caught exception getting JMX metrics : Connection refused, skipping same exceptions for next 5 minutes java.net.ConnectException: Connection refused at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:589) at sun.net.NetworkClient.doConnect(NetworkClient.java:175) at sun.net.www.http.HttpClient.openServer(HttpClient.java:432) at sun.net.www.http.HttpClient.openServer(HttpClient.java:527) at sun.net.www.http.HttpClient.(HttpClient.java:211) at sun.net.www.http.HttpClient.New(HttpClient.java:308) at sun.net.www.http.HttpClient.New(HttpClient.java:326) at sun.net.www.protocol.http.HttpURLConnection.getNewHttpClient(HttpURLConnection.java:1169) at sun.net.www.protocol.http.HttpURLConnection.plainConnect0(HttpURLConnection.java:1105) at sun.net.www.protocol.http.HttpURLConnection.plainConnect(HttpURLConnection.java:999) at sun.net.www.protocol.http.HttpURLConnection.connect(HttpURLConnection.java:933) at sun.net.www.protocol.http.HttpURLConnection.getInputStream0(HttpURLConnection.java:1513) at sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1441) at java.net.HttpURLConnection.getResponseCode(HttpURLConnection.java:480) at org.apache.ambari.server.controller.internal.URLStreamProvider.processURL(URLStreamProvider.java:209) at org.apache.ambari.server.controller.internal.URLStreamProvider.processURL(URLStreamProvider.java:133) at org.apache.ambari.server.controller.internal.URLStreamProvider.readFrom(URLStreamProvider.java:107) at org.apache.ambari.server.controller.internal.URLStreamProvider.readFrom(URLStreamProvider.java:112) at org.apache.ambari.server.controller.jmx.JMXPropertyProvider.populateResource(JMXPropertyProvider.java:212) at org.apache.ambari.server.controller.metrics.ThreadPoolEnabledPropertyProvider$1.call(ThreadPoolEnabledPropertyProvider.java:180) at org.apache.ambari.server.controller.metrics.ThreadPoolEnabledPropertyProvider$1.call(ThreadPoolEnabledPropertyProvider.java:178) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 15 Jun 2017 10:29:24,452 ERROR [pool-9-thread-38692] BaseProvider:240 - Caught exception getting JMX metrics : Connection refused, skipping same exceptions for next 5 minutes java.net.ConnectException: Connection refused at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:589) at sun.net.NetworkClient.doConnect(NetworkClient.java:175) at sun.net.www.http.HttpClient.openServer(HttpClient.java:432) at sun.net.www.http.HttpClient.openServer(HttpClient.java:527) at sun.net.www.http.HttpClient.(HttpClient.java:211) at sun.net.www.http.HttpClient.New(HttpClient.java:308) at sun.net.www.http.HttpClient.New(HttpClient.java:326) at sun.net.www.protocol.http.HttpURLConnection.getNewHttpClient(HttpURLConnection.java:1169) at sun.net.www.protocol.http.HttpURLConnection.plainConnect0(HttpURLConnection.java:1105) at sun.net.www.protocol.http.HttpURLConnection.plainConnect(HttpURLConnection.java:999) at sun.net.www.protocol.http.HttpURLConnection.connect(HttpURLConnection.java:933) at sun.net.www.protocol.http.HttpURLConnection.getInputStream0(HttpURLConnection.java:1513) at sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1441) at java.net.HttpURLConnection.getResponseCode(HttpURLConnection.java:480) at org.apache.ambari.server.controller.internal.URLStreamProvider.processURL(URLStreamProvider.java:209) at org.apache.ambari.server.controller.internal.URLStreamProvider.processURL(URLStreamProvider.java:133) at org.apache.ambari.server.controller.internal.URLStreamProvider.readFrom(URLStreamProvider.java:107) at org.apache.ambari.server.controller.internal.URLStreamProvider.readFrom(URLStreamProvider.java:112) at org.apache.ambari.server.controller.jmx.JMXPropertyProvider.populateResource(JMXPropertyProvider.java:212) at org.apache.ambari.server.controller.metrics.ThreadPoolEnabledPropertyProvider$1.call(ThreadPoolEnabledPropertyProvider.java:180) at org.apache.ambari.server.controller.metrics.ThreadPoolEnabledPropertyProvider$1.call(ThreadPoolEnabledPropertyProvider.java:178) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745)