Hi I am using cloudera 5.7.0 . and running spark streaming application using kafka which doing some opencv operation . some of my containers killed by Yarn with below reason : ExecutorLostFailure (executor 1 exited caused by one of the running tasks) Reason: Container killed by YARN for exceeding memory limits. 3.1 GB of 3 GB physical memory used. Consider boosting spark.yarn.executor.memoryOverhead i am using below configuarion . spark-submit --num-executors 20 --executor-memory 2g --executor-cores 2 - --conf spark.yarn.executor.memoryOverhead=1000 . how can i solve this issue Regards Prateek ... View more

Hi   I have installed CDH 5.3.3 successfully on ubuntu 14.04  . but when i reboot  my ubuntu system , cloudera mangement service ( Event , Host , service monitor) fail to start.   show follwing errors:   Event Server :   12:37:40.957 PM WARN com.cloudera.cmf.event.publish.EventStorePublisherWithRetry Failed to publish event: SimpleEvent{attributes={STACKTRACE=[java.net.ConnectException: Connection refused at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:339) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:200) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:182) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:579) at sun.net.NetworkClient.doConnect(NetworkClient.java:175) at sun.net.www.http.HttpClient.openServer(HttpClient.java:432) at sun.net.www.http.HttpClient.openServer(HttpClient.java:527) at sun.net.www.http.HttpClient.<init>(HttpClient.java:211) at sun.net.www.http.HttpClient.New(HttpClient.java:308) at sun.net.www.http.HttpClient.New(HttpClient.java:326) at sun.net.www.protocol.http.HttpURLConnection.getNewHttpClient(HttpURLConnection.java:996) at sun.net.www.protocol.http.HttpURLConnection.plainConnect(HttpURLConnection.java:932) at sun.net.www.protocol.http.HttpURLConnection.connect(HttpURLConnection.java:850) at sun.net.www.protocol.http.HttpURLConnection.getOutputStream(HttpURLConnection.java:1091) at com.cloudera.cmf.BasicScmProxy.authenticate(BasicScmProxy.java:188) at com.cloudera.cmf.BasicScmProxy.authenticateAndFetchScmDescriptor(BasicScmProxy.java:301) at com.cloudera.cmf.BasicScmProxy.getScmDescriptor(BasicScmProxy.java:346) at com.cloudera.cmf.BasicScmProxy.getScmDescriptor(BasicScmProxy.java:326) at com.cloudera.cmf.eventcatcher.server.EventCatcherService.main(EventCatcherService.java:100) ], EXCEPTION_TYPES=[java.net.ConnectException], ROLE=[mgmt-EVENTSERVER-e8c92ccecb4376455a55563353303d3f], SEVERITY=[IMPORTANT], SERVICE=[mgmt], HOST_IDS=[0001a5a1-846a-4022-b4c6-a204abd12813], LOG_LEVEL=[WARN], ROLE_TYPE=[EVENTSERVER], CATEGORY=[LOG_MESSAGE], SERVICE_TYPE=[MGMT], HOSTS=[master.novalocal], EVENTCODE=[EV_LOG_EVENT]}, content=IOException while getting descriptor, timestamp=1429645060761} 12:37:42.831 PM WARN com.cloudera.cmf.eventcatcher.server.EventCatcherService No descriptor fetched from http://master.novalocal:7180 on after 2 tries, sleeping... 12:37:44.833 PM WARN com.cloudera.cmf.eventcatcher.server.EventCatcherService No descriptor fetched from http://master.novalocal:7180 on after 3 tries, sleeping... 12:37:46.837 PM WARN com.cloudera.cmf.eventcatcher.server.EventCatcherService No descriptor fetched from http://master.novalocal:7180 on after 4 tries, sleeping... 12:37:48.838 PM WARN com.cloudera.cmf.eventcatcher.server.EventCatcherService No descriptor fetched from http://master.novalocal:7180 on after 5 tries, sleeping... 12:37:50.838 PM ERROR com.cloudera.cmf.eventcatcher.server.EventCatcherService Could not fetch descriptor after 5 tries, exiting.     Event Server :   12:37:39.548 PM WARN com.cloudera.cmf.event.publish.EventStorePublisherWithRetry Failed to publish event: SimpleEvent{attributes={STACKTRACE=[java.net.ConnectException: Connection refused at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:339) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:200) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:182) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:579) at sun.net.NetworkClient.doConnect(NetworkClient.java:175) at sun.net.www.http.HttpClient.openServer(HttpClient.java:432) at sun.net.www.http.HttpClient.openServer(HttpClient.java:527) at sun.net.www.http.HttpClient.<init>(HttpClient.java:211) at sun.net.www.http.HttpClient.New(HttpClient.java:308) at sun.net.www.http.HttpClient.New(HttpClient.java:326) at sun.net.www.protocol.http.HttpURLConnection.getNewHttpClient(HttpURLConnection.java:996) at sun.net.www.protocol.http.HttpURLConnection.plainConnect(HttpURLConnection.java:932) at sun.net.www.protocol.http.HttpURLConnection.connect(HttpURLConnection.java:850) at sun.net.www.protocol.http.HttpURLConnection.getOutputStream(HttpURLConnection.java:1091) at com.cloudera.cmf.BasicScmProxy.authenticate(BasicScmProxy.java:188) at com.cloudera.cmf.BasicScmProxy.authenticateAndFetchScmDescriptor(BasicScmProxy.java:301) at com.cloudera.cmf.BasicScmProxy.getScmDescriptor(BasicScmProxy.java:346) at com.cloudera.cmon.firehose.Main.main(Main.java:374) ], EXCEPTION_TYPES=[java.net.ConnectException], ROLE=[mgmt-SERVICEMONITOR-e8c92ccecb4376455a55563353303d3f], SEVERITY=[IMPORTANT], SERVICE=[mgmt], HOST_IDS=[0001a5a1-846a-4022-b4c6-a204abd12813], LOG_LEVEL=[WARN], ROLE_TYPE=[SERVICEMONITOR], CATEGORY=[LOG_MESSAGE], SERVICE_TYPE=[MGMT], HOSTS=[master.novalocal], EVENTCODE=[EV_LOG_EVENT]}, content=IOException while getting descriptor, timestamp=1429645059382} 12:37:41.451 PM WARN com.cloudera.cmon.firehose.Main No descriptor fetched from http://master.novalocal:7180 on after 2 tries, sleeping... 12:37:43.452 PM WARN com.cloudera.cmon.firehose.Main No descriptor fetched from http://master.novalocal:7180 on after 3 tries, sleeping... 12:37:45.454 PM WARN com.cloudera.cmon.firehose.Main No descriptor fetched from http://master.novalocal:7180 on after 4 tries, sleeping... 12:37:47.456 PM WARN com.cloudera.cmon.firehose.Main No descriptor fetched from http://master.novalocal:7180 on after 5 tries, sleeping... 12:37:49.456 PM ERROR com.cloudera.cmon.firehose.Main Could not fetch descriptor after 5 tries, exiting.         Host Monitor :   12:37:40.676 PM WARN com.cloudera.cmf.event.publish.EventStorePublisherWithRetry Failed to publish event: SimpleEvent{attributes={STACKTRACE=[java.net.ConnectException: Connection refused at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:339) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:200) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:182) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:579) at sun.net.NetworkClient.doConnect(NetworkClient.java:175) at sun.net.www.http.HttpClient.openServer(HttpClient.java:432) at sun.net.www.http.HttpClient.openServer(HttpClient.java:527) at sun.net.www.http.HttpClient.<init>(HttpClient.java:211) at sun.net.www.http.HttpClient.New(HttpClient.java:308) at sun.net.www.http.HttpClient.New(HttpClient.java:326) at sun.net.www.protocol.http.HttpURLConnection.getNewHttpClient(HttpURLConnection.java:996) at sun.net.www.protocol.http.HttpURLConnection.plainConnect(HttpURLConnection.java:932) at sun.net.www.protocol.http.HttpURLConnection.connect(HttpURLConnection.java:850) at sun.net.www.protocol.http.HttpURLConnection.getOutputStream(HttpURLConnection.java:1091) at com.cloudera.cmf.BasicScmProxy.authenticate(BasicScmProxy.java:188) at com.cloudera.cmf.BasicScmProxy.authenticateAndFetchScmDescriptor(BasicScmProxy.java:301) at com.cloudera.cmf.BasicScmProxy.getScmDescriptor(BasicScmProxy.java:346) at com.cloudera.cmon.firehose.Main.main(Main.java:374) ], EXCEPTION_TYPES=[java.net.ConnectException], ROLE=[mgmt-HOSTMONITOR-e8c92ccecb4376455a55563353303d3f], SEVERITY=[IMPORTANT], SERVICE=[mgmt], HOST_IDS=[0001a5a1-846a-4022-b4c6-a204abd12813], LOG_LEVEL=[WARN], ROLE_TYPE=[HOSTMONITOR], CATEGORY=[LOG_MESSAGE], SERVICE_TYPE=[MGMT], HOSTS=[master.novalocal], EVENTCODE=[EV_LOG_EVENT]}, content=IOException while getting descriptor, timestamp=1429645060526} 12:37:42.599 PM WARN com.cloudera.cmon.firehose.Main No descriptor fetched from http://master.novalocal:7180 on after 2 tries, sleeping... 12:37:44.601 PM WARN com.cloudera.cmon.firehose.Main No descriptor fetched from http://master.novalocal:7180 on after 3 tries, sleeping... 12:37:46.602 PM WARN com.cloudera.cmon.firehose.Main No descriptor fetched from http://master.novalocal:7180 on after 4 tries, sleeping... 12:37:48.603 PM WARN com.cloudera.cmon.firehose.Main No descriptor fetched from http://master.novalocal:7180 on after 5 tries, sleeping... 12:37:50.604 PM ERROR com.cloudera.cmon.firehose.Main Could not fetch descriptor after 5 tries, exiting.       Your help is much appreciated.     Regards Prateek     ... View more