Member since
04-03-2014
14
Posts
0
Kudos Received
0
Solutions
07-10-2015
01:53 PM
Sweet! Thanks! Gonna try this out when we get a chance!
... View more
07-10-2015
11:53 AM
Out of curiosity, is there a JIRA task for any work relating to the programmatic API to submit spark jobs?
... View more
06-24-2015
10:48 AM
Hi Darren, Awesome! Good to know. Thanks for your help in all this! -Terry
... View more
06-24-2015
09:05 AM
Hi Darren, Thanks for responding. Yes, I noticed that the heap size assigned to the EventServer had been set to an extremely low value (128MB) compared to the default of 1GB. I bumped it up to 512MB and no longer saw the restarts. Not sure how/who in our organization had set to such a low amount, but the only logs which I know of were the ones under /var/log/cloudera-scm-eventserver and they were only the ones from stdout. These logs showed no OOM or any error, for that matter, which led to confusion over what was going on. Is there a setting/log config which I'm not aware where I can force stderr to be outputted to a file in the same directory as above? Also, thanks for the additional info with regards to the heap dump. This will all be useful if we ever encounter any future startup issues. -Terry
... View more
06-23-2015
09:24 AM
As part of upgrade our cluster to CDH5.4.2, we had to upgrade the Cloudera Manager to 5.4.1 so that the Impala Daemon metrics could be properly retrieved. After the upgrade to CM5.4.1, the Event Server health check reports two bad checks: "Process Status" and "Unexpected Exits". I looked into the event server logs (w/ the default log level set to INFO) and noticed that the Event Server constantly restarts itself, hence, the the two aformentioned bad checks. I looked through the logs and found no obvious indication of errors that might explain the issue. Searching through online forums and this board, I found some people with the same issue, but either had no resolution or their problem was slightly different. Anybody else having this same problem as I just described. This is blocking completion of the CDH5.4.2 upgrade for us. I'll be happy to share more info of our setup if I knew where else to look other than the logs and the CM Service page. Thanks, -Terry
... View more
Labels:
- Labels:
-
Apache Impala
-
Cloudera Manager