I need help understanding the YARN ResourceManager Active/Standby behavior. Setup Context: Two nodes are configured to host the YARN ResourceManager service. One node acts as "Active" while the other is "Standby". High Availability is turned off. If the "Active" service is terminated, a fail-over should not occur. In an attempt to better understand how the YARN ResourceManager functions, I stopped the "Active" service to study the log output. A fail-over did not occur, as expected in my statement above. When starting the "Active" service back up, I found the service relabeled as "Standby". Well over 5 minutes have passed and the service remains labeled as "Standby". At this point, there are two "Standby" services. Only the original "Active" service shows log activity, as expected. The log activity displays a number of Metrics errors: No live collector to send metrics to. Metrics to be sent will be discarded. This message will be skipped for the next 20 times. Unable to connect to collector, http://null:6188/ws/v1/timeline/metricsThis exceptions will be ignored for next 100 times Would anyone happen to be familiar with such a situation? I greatly appreciate your time and input. ... View more

I have recently installed the SmartSense version 1.3.1.0-136 component in my HDP stack. When performing a manual capture, I discovered the bundle contains information for only one node, the HST-Server. The hst-server logs roll through a series of Java errors: 19 Apr 2017 11:54:47,041 WARN [pool-1-thread-1] UploadRunnable:152 - Exception type encountered : Unable to reach hortonworks.com:80. Please verify outbound connectivity on Gateway. 19 Apr 2017 11:54:47,042 INFO [pool-1-thread-1] UploadRunnable:161 - Waiting for 50000 milliseconds before next retry attempt. 19 Apr 2017 11:55:37,042 INFO [pool-1-thread-1] UploadRunnable:171 - Retry Attempt :10 19 Apr 2017 11:55:37,042 INFO [pool-1-thread-1] UploadRunnable:197 - Retrying File Upload. 19 Apr 2017 11:55:37,043 INFO [pool-1-thread-1] UploadRunnable:208 - Starting encryption for uploading bundle. 19 Apr 2017 11:55:37,044 INFO [pool-1-thread-1] GatewayConfigValidator:67 - Found configurations to be used for connectivity. 19 Apr 2017 11:55:37,044 INFO [pool-1-thread-1] GatewayValidator:149 - Trying to reach: smartsense.hortonworks.com:443 19 Apr 2017 11:55:37,046 ERROR [pool-1-thread-1] GatewayValidator:93 - Failed to reach SmartSense landing zone host: smartsense.hortonworks.com, port:443 19 Apr 2017 11:55:37,046 INFO [pool-1-thread-1] GatewayValidator:149 - Trying to reach: hortonworks.com:80 19 Apr 2017 11:55:37,048 ERROR [pool-1-thread-1] GatewayValidator:100 - Failed to reach hortonworks.com:80. 19 Apr 2017 11:55:37,048 ERROR [pool-1-thread-1] GatewayEmbeddedClient:134 - Failed during upload bundle : com.hortonworks.smartsense.gateway.GatewayException: Unable to reach hortonworks.com:80. Please verify outbound connectivity on Gateway. at com.hortonworks.smartsense.gateway.server.GatewayValidator.validateReachable(GatewayValidator.java:102) at com.hortonworks.smartsense.gateway.server.GatewayValidator.validateSetup(GatewayValidator.java:65) at com.hortonworks.smartsense.gateway.client.GatewayEmbeddedClient.validateSetup(GatewayEmbeddedClient.java:123) at com.hortonworks.smartsense.gateway.client.GatewayEmbeddedClient.uploadBundle(GatewayEmbeddedClient.java:77) at com.hortonworks.support.tools.gateway.UploadRunnable.uploadBundle(UploadRunnable.java:133) at com.hortonworks.support.tools.gateway.UploadRunnable.retryUploadBundle(UploadRunnable.java:198) at com.hortonworks.support.tools.gateway.UploadRunnable.uploadBundle(UploadRunnable.java:173) at com.hortonworks.support.tools.gateway.UploadRunnable.retryUploadBundle(UploadRunnable.java:198) at com.hortonworks.support.tools.gateway.UploadRunnable.uploadBundle(UploadRunnable.java:173) at com.hortonworks.support.tools.gateway.UploadRunnable.retryUploadBundle(UploadRunnable.java:198) at com.hortonworks.support.tools.gateway.UploadRunnable.uploadBundle(UploadRunnable.java:173) at com.hortonworks.support.tools.gateway.UploadRunnable.retryUploadBundle(UploadRunnable.java:198) at com.hortonworks.support.tools.gateway.UploadRunnable.uploadBundle(UploadRunnable.java:173) at com.hortonworks.support.tools.gateway.UploadRunnable.retryUploadBundle(UploadRunnable.java:198) at com.hortonworks.support.tools.gateway.UploadRunnable.uploadBundle(UploadRunnable.java:173) at com.hortonworks.support.tools.gateway.UploadRunnable.retryUploadBundle(UploadRunnable.java:198) at com.hortonworks.support.tools.gateway.UploadRunnable.uploadBundle(UploadRunnable.java:173) at com.hortonworks.support.tools.gateway.UploadRunnable.retryUploadBundle(UploadRunnable.java:198) at com.hortonworks.support.tools.gateway.UploadRunnable.uploadBundle(UploadRunnable.java:173) at com.hortonworks.support.tools.gateway.UploadRunnable.retryUploadBundle(UploadRunnable.java:198) at com.hortonworks.support.tools.gateway.UploadRunnable.uploadBundle(UploadRunnable.java:173) at com.hortonworks.support.tools.gateway.UploadRunnable.retryUploadBundle(UploadRunnable.java:198) at com.hortonworks.support.tools.gateway.UploadRunnable.uploadBundle(UploadRunnable.java:173) at com.hortonworks.support.tools.gateway.UploadRunnable.retryUploadBundle(UploadRunnable.java:198) at com.hortonworks.support.tools.gateway.UploadRunnable.uploadBundle(UploadRunnable.java:173) at com.hortonworks.support.tools.gateway.UploadRunnable.run(UploadRunnable.java:221) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) Caused by: java.net.UnknownHostException: smartsense.hortonworks.com at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:184) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:589) at com.hortonworks.smartsense.gateway.server.GatewayValidator.isReachable(GatewayValidator.java:150) at com.hortonworks.smartsense.gateway.server.GatewayValidator.validateReachable(GatewayValidator.java:90) ... 30 more These errors are to be expected as external network connectivity is not present within my environment. I have not experienced similar problems when using a previous version of SmartSense. Manual bundle uploads are preferred. I understand the benefits of a Gateway node, but I simply don't want to configure one. Hortonworks SmartSense documentation and conversations within this forum assume the desired use of a Gateway node. Ambari configurations for SmartSense do not provide an option to disable the Gateway. One method that I found to remove the Gateway results in completely uninstalling the HST service. I greatly appreciate any information or support that the Hortonworks Community can provide. ... View more