Created on 09-18-2014 08:54 PM - edited 09-16-2022 02:07 AM
I installed cdh5.0 follow 'Installation Path B - Manual Installation Using Cloudera Manager Packages'
When i intalled oracle-j2sdk1.7-1.7.0 cloudera-manager-daemons-5.1.2 cloudera-manager-server-5.1.2 and cloudera-manager-server-db-2-5.1.2 in my linux6.4(64bit),on Database Setup page,i got an error like this:
Created 10-14-2014 01:09 AM
I sucessfully reinstalled it by 'Installation Path A - Automated Installation by Cloudera Manager' after increase memory to 4GB.
thank you very much!
Created 09-18-2014 09:02 PM
in test connection web,get error:Unexpected error. Unable to verify database connection
Created 09-21-2014 06:29 PM
who can help me?
Created 09-21-2014 06:32 PM
Created 09-21-2014 07:27 PM
[root@cdh1 ~]# rpm -qa | grep oracle
oracle-j2sdk1.7-1.7.0+update55-2.x86_64
[root@cdh1 ~]# ls -l /usr/java/
total 4
drwxr-xr-x. 8 root root 4096 Sep 19 18:05 jdk1.7.0_55-cloudera
[root@cdh1 ~]#
Oracle Java was installed.
Created 09-21-2014 10:38 PM
how to set JAVA_HOME?
Created 09-21-2014 10:45 PM
Created 09-21-2014 11:13 PM
here is my cloudera manager host show:
[root@cdh1 ~]# java -version
java version "1.7.0_65"
OpenJDK Runtime Environment (rhel-2.5.1.2.el6_5-x86_64 u65-b17)
OpenJDK 64-Bit Server VM (build 24.65-b04, mixed mode)
[root@cdh1 ~]# /usr/bin/java -version
java version "1.7.0_65"
OpenJDK Runtime Environment (rhel-2.5.1.2.el6_5-x86_64 u65-b17)
OpenJDK 64-Bit Server VM (build 24.65-b04, mixed mode)
[root@cdh1 ~]# /usr/java/jdk1.7.0_55-cloudera/bin/java -version
java version "1.7.0_55"
Java(TM) SE Runtime Environment (build 1.7.0_55-b13)
Java HotSpot(TM) 64-Bit Server VM (build 24.55-b03, mixed mode)
[root@cdh1 ~]# echo $JAVA_HOME
/usr/java/jdk1.7.0_55-cloudera
[root@cdh1 ~]# ps -ef | grep cmf-server
root 1207 1 0 21:49 ? 00:00:00 su cloudera-scm -s /bin/bash -c nohup /usr/sbin/cmf-server
root 1495 1322 0 22:12 pts/1 00:00:00 grep cmf-server
Created 09-21-2014 11:33 PM
JAVA_HOME seted in /etc/profile. and centos installed on VMware.
Created 09-21-2014 11:54 PM
[root@cdh1 ~]# whereis java
java: /usr/bin/java /etc/java /usr/lib/java /usr/share/java /usr/share/man/man1/java.1.gz
But in /usr/share/java directory have no file
Created 09-26-2014 03:12 AM
how to set java_home ?
who can help me ?
Created 09-26-2014 02:05 PM
you can set "JAVA_HOME" in /etc/defaults/cloudera-scm-server
add to the end of the file
export JAVA_HOME=/usr/java/jdk1.7.0_55
Created 09-27-2014 07:05 PM
Thank you for your help
I set the java_home in /etc/default/cloudera-scm-server with 'export JAVA_HOME=/usr/java/jdk1.7.0_55-cloudera',but when click 'test connection' in Add Cloudera ManagementService with browser,i got the same error 'Unexpected error. Unable to verify database connection.', and the /var/log/cloudera-scm-server/cloudera-scm-server.log file show like this:
INFO [JvmPauseMonitor:debug.JvmPauseMonitor@236] Detected pause in JVM or host machine (e.g. a stop the world GC, or JVM not scheduled): paused approximately 1024ms: no GCs detected.
+======================================================================+
| Error: JAVA_HOME is not set and Java could not be found |
+----------------------------------------------------------------------+
| Please download the latest Oracle JDK from the Oracle Java web site |
| > http://www.oracle.com/technetwork/java/javase/index.html < |
| |
| Cloudera Manager requires Java 1.6 or later. |
| NOTE: This script will find Oracle Java whether you install using |
| the binary or the RPM based installer. |
+======================================================================+
+ exit 1
Here is the java_home configure show:
[root@cdh1 ~]# tail /etc/default/cloudera-scm-server
# Java Options.
#
# Default value sets Java maximum heap size to 2GB, and Java maximum permanent
# generation size to 256MB.
#
export CMF_JAVA_OPTS="-Xmx2G -XX:MaxPermSize=256m -XX:+HeapDumpOnOutOfMemoryError -XX:HeapDumpPath=/tmp"
export JAVA_HOME=/usr/java/jdk1.7.0_55-cloudera
export CLASSPATH=.:$JAVA_HOME/jre/lib/rt.jar:$JAVA_HOME/lib/dt.jar:$JAVA_HOME/lib/tools.jar
export PATH=$PATH:$JAVA_HOME/bin
[root@cdh1 ~]#
[root@cdh1 ~]#
[root@cdh1 ~]# echo $JAVA_HOME
/usr/java/jdk1.7.0_55-cloudera/
[root@cdh1 ~]# ls /usr/java/jdk1.7.0_55-cloudera/
bin db jre LICENSE README.html src.zip THIRDPARTYLICENSEREADME.txt
COPYRIGHT include lib man release THIRDPARTYLICENSEREADME-JAVAFX.txt
[root@cdh1 ~]#
Is there something wrong? any how can i do?
Created 09-28-2014 09:05 AM
OK so realize NONE of this should be necessary, and this is not normal to need to configure things this way. It is not necessary to have to set JAVA_HOME.
I think we need to focus on this part of the message, rather than the JAVA_HOME message which appears to be a false-positive error.
INFO [JvmPauseMonitor:debug.JvmPauseMonitor@236] Detected pause in JVM or host machine (e.g. a stop the world GC, or JVM not scheduled): paused approximately 1024ms: no GCs detected.
How much memory is configured for your VM you are attempting to run things on? How much physical memory does the system you are running the VM on have?
It appears the 1.7 openJDK has been installed as well, which is alongside of the oracle JDK on the system.
What do you get for the following commands on the system:
# ls -l /usr/java
# yum list installed "*jdk*"
Thanks
Todd
Created 09-28-2014 06:18 PM
Thank you for your reply!
The memory is configured for my VM i'm attempting to run things on is 512MB, and physical memory the system i'm running the VM on is 8GB.
The following commands on the system get like this:
# ls -l /usr/java
total 4
drwxr-xr-x. 8 root root 4096 Sep 19 18:05 jdk1.7.0_55-cloudera
# yum list installed "*jdk*"
Loaded plugins: fastestmirror
Loading mirror speeds from cached hostfile
* base: mirrors.cug.edu.cn
* extras: mirrors.cug.edu.cn
* updates: mirrors.btte.net
base | 3.7 kB 00:00
extras | 3.3 kB 00:00
updates | 3.4 kB 00:00
updates/primary_db | 5.3 MB 00:01
Installed Packages
java-1.7.0-openjdk.x86_64 1:1.7.0.65-2.5.1.2.el6_5 @updates
Created 09-29-2014 12:58 AM
Thank you for your help!
Memory configured for VM running things on is 512MB,and the physical memory the VM running on is 8GB.
The following commands get show:
[root@cdh1 ~]# ls -l /usr/java
total 4
drwxr-xr-x. 8 root root 4096 Sep 19 18:05 jdk1.7.0_55-cloudera
[root@cdh1 ~]# yum list installed "*jdk*"
Loaded plugins: fastestmirror
Determining fastest mirrors
* base: mirrors.yun-idc.com
* extras: mirrors.yun-idc.com
* updates: mirrors.btte.net
base | 3.7 kB 00:00
extras | 3.3 kB 00:00
updates | 3.4 kB 00:00
Installed Packages
java-1.7.0-openjdk.x86_64 1:1.7.0.65-2.5.1.2.el6_5 @updates
Created 09-29-2014 10:01 AM
Ok at this point I would suggest reviewing the "requirements" section, here.
Also realize you need memory for CDH, so running the VM at a minimum of 4GB memory is necessary.
The issue you are seeing is because there is not enough memory, Cloudera Manager and CDH are memory intensive applicaitons. The JAVA_HOME error message you are seeing is due to this (the message is a false indication of the problem, as I stated in my previous note.
Created 09-29-2014 07:37 PM
Thank you very much!
I set the memory of VM to 4GB,but i got the same error.
Created 09-29-2014 07:39 PM
Need i reinstall the centos system?
Created 09-30-2014 04:06 AM
Created 10-07-2014 06:38 PM
Thank you for your help.We just had 7-day holiday on National Day.Now the logs on show:
WARN [main:ehcache.AbstractEhcacheRegionFactory@180] HHH020003: Could not find a specific ehcache configuration for cache named [com.cloudera.cmf.model.DbCluster.activatedReleases]; using defaults.
ERROR [CommandPusher:inspector.InspectorMerge@153] Unexpected error gathering inspector results.
java.lang.NullPointerException
at com.cloudera.cmf.inspector.HuePythonVersionInspection.gather(HuePythonVersionInspection.java:84)
at com.cloudera.cmf.inspector.InspectorMerge.gather(InspectorMerge.java:150)
at com.cloudera.cmf.command.inspector.InspectorCommand.postGather(InspectorCommand.java:158)
at com.cloudera.cmf.command.inspector.InspectorCommand.update(InspectorCommand.java:126)
at com.cloudera.server.cmf.CommandPusherThread.handleCommandInternal(CommandPusherThread.java:388)
at com.cloudera.server.cmf.CommandPusherThread.handleCommandBatched(CommandPusherThread.java:220)
at com.cloudera.server.cmf.CommandPusherThread.innerLoop(CommandPusherThread.java:139)
at com.cloudera.server.cmf.CommandPusherThread.run(CommandPusherThread.java:112)
INFO [CommandPusher:datacollection.GlobalCollectHostStatisticsCommand@199] Setting command substage state. DATA_GATHERING=>FAILED
ERROR [DataArchiver-19:datacollection.HealthArchiver@76] Was unable to retrieve service and role health reports.
com.cloudera.cmf.command.datacollection.BulkHealthRequestException: MgmtServiceLocatorException while making a HOST_MONITORING health request.
at com.cloudera.cmf.command.datacollection.BulkHealthRequest.makeRequest(BulkHealthRequest.java:122)
at com.cloudera.cmf.command.datacollection.BulkHealthRequest.makeHostRequest(BulkHealthRequest.java:106)
at com.cloudera.cmf.command.datacollection.HealthArchiver.archive(HealthArchiver.java:83)
at com.cloudera.cmf.command.datacollection.DataArchiver.call(DataArchiver.java:66)
at com.cloudera.cmf.command.datacollection.DataArchiver.call(DataArchiver.java:28)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
Caused by: com.cloudera.cmon.MgmtServiceLocatorException: Could not find a HOST_MONITORING nozzle from SCM.
at com.cloudera.cmon.MgmtServiceLocator.getNozzleIPC(MgmtServiceLocator.java:141)
at com.cloudera.cmon.MgmtServiceLocator.getNozzleIPC(MgmtServiceLocator.java:118)
at com.cloudera.cmon.MgmtServiceLocator.getNozzleIPCWrapper(MgmtServiceLocator.java:188)
at com.cloudera.cmf.command.datacollection.BulkHealthRequest.makeRequest(BulkHealthRequest.java:117)
... 8 more
408 ERROR [CommandPusher:datacollection.GlobalCollectHostStatisticsCommand@1119] Exception in future java.util.concurrent.FutureTask@2fde373d
java.util.concurrent.ExecutionException: com.cloudera.cmon.MgmtServiceLocatorException: There is no configured event store
at java.util.concurrent.FutureTask.report(FutureTask.java:122)
at java.util.concurrent.FutureTask.get(FutureTask.java:202)
at com.cloudera.cmf.command.datacollection.GlobalCollectHostStatisticsCommand.getErrorFromFuture(GlobalCollectHostStatisticsCommand.java:1110)
at com.cloudera.cmf.command.datacollection.GlobalCollectHostStatisticsCommand.updateArchiverStage(GlobalCollectHostStatisticsCommand.java:1080)
at com.cloudera.cmf.command.datacollection.GlobalCollectHostStatisticsCommand.handleDataArchivers(GlobalCollectHostStatisticsCommand.java:875)
at com.cloudera.cmf.command.datacollection.GlobalCollectHostStatisticsCommand.update(GlobalCollectHostStatisticsCommand.java:571)
at com.cloudera.server.cmf.CommandPusherThread.handleCommandInternal(CommandPusherThread.java:388)
at com.cloudera.server.cmf.CommandPusherThread.handleCommandBatched(CommandPusherThread.java:220)
at com.cloudera.server.cmf.CommandPusherThread.innerLoop(CommandPusherThread.java:139)
at com.cloudera.server.cmf.CommandPusherThread.run(CommandPusherThread.java:112)
Caused by: com.cloudera.cmon.MgmtServiceLocatorException: There is no configured event store
at com.cloudera.cmon.MgmtServiceLocator.getEventStoreQueryProxy(MgmtServiceLocator.java:312)
at com.cloudera.cmf.command.datacollection.EventsArchiver.archive(EventsArchiver.java:68)
at com.cloudera.cmf.command.datacollection.DataArchiver.call(DataArchiver.java:66)
at com.cloudera.cmf.command.datacollection.DataArchiver.call(DataArchiver.java:28)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
2014-10-08 17:04:59,464 ERROR [DataArchiver-20:datacollection.MetricsArchiver@111] Unable to make metrics request. Skipping.
com.cloudera.cmf.command.datacollection.MetricsRequestException: MgmtServiceLocatorException while making a metrics request.
at com.cloudera.cmf.command.datacollection.MetricsRequest.makeRequest(MetricsRequest.java:159)
at com.cloudera.cmf.command.datacollection.MetricsArchiver.archive(MetricsArchiver.java:92)
at com.cloudera.cmf.command.datacollection.DataArchiver.call(DataArchiver.java:66)
at com.cloudera.cmf.command.datacollection.DataArchiver.call(DataArchiver.java:28)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
Caused by: com.cloudera.cmon.MgmtServiceLocatorException: Could not find a HOST_MONITORING nozzle from SCM.
at com.cloudera.cmon.MgmtServiceLocator.getNozzleIPC(MgmtServiceLocator.java:141)
at com.cloudera.cmon.MgmtServiceLocator.getNozzleIPC(MgmtServiceLocator.java:118)
at com.cloudera.cmon.MgmtServiceLocator.getNozzleIPCWrapper(MgmtServiceLocator.java:188)
at com.cloudera.cmf.command.datacollection.MetricsRequest.makeRequest(MetricsRequest.java:151)
... 7 more
ERROR [CommandPusher:datacollection.GlobalCollectHostStatisticsCommand@1119] Exception in future java.util.concurrent.FutureTask@2fde373d
java.util.concurrent.ExecutionException: com.cloudera.cmon.MgmtServiceLocatorException: There is no configured event store
at java.util.concurrent.FutureTask.report(FutureTask.java:122)
at java.util.concurrent.FutureTask.get(FutureTask.java:202)
at com.cloudera.cmf.command.datacollection.GlobalCollectHostStatisticsCommand.getErrorFromFuture(GlobalCollectHostStatisticsCommand.java:1110)
at com.cloudera.cmf.command.datacollection.GlobalCollectHostStatisticsCommand.updateArchiverStage(GlobalCollectHostStatisticsCommand.java:1080)
at com.cloudera.cmf.command.datacollection.GlobalCollectHostStatisticsCommand.handleDataArchivers(GlobalCollectHostStatisticsCommand.java:875)
at com.cloudera.cmf.command.datacollection.GlobalCollectHostStatisticsCommand.update(GlobalCollectHostStatisticsCommand.java:571)
at com.cloudera.server.cmf.CommandPusherThread.handleCommandInternal(CommandPusherThread.java:388)
at com.cloudera.server.cmf.CommandPusherThread.handleCommandBatched(CommandPusherThread.java:220)
at com.cloudera.server.cmf.CommandPusherThread.innerLoop(CommandPusherThread.java:139)
at com.cloudera.server.cmf.CommandPusherThread.run(CommandPusherThread.java:112)
Caused by: com.cloudera.cmon.MgmtServiceLocatorException: There is no configured event store
at com.cloudera.cmon.MgmtServiceLocator.getEventStoreQueryProxy(MgmtServiceLocator.java:312)
at com.cloudera.cmf.command.datacollection.EventsArchiver.archive(EventsArchiver.java:68)
at com.cloudera.cmf.command.datacollection.DataArchiver.call(DataArchiver.java:66)
at com.cloudera.cmf.command.datacollection.DataArchiver.call(DataArchiver.java:28)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
ERROR [CommandPusher:datacollection.GlobalCollectHostStatisticsCommand@894] Data archiver failed.
java.util.concurrent.ExecutionException: com.cloudera.cmon.MgmtServiceLocatorException: There is no configured event store
at java.util.concurrent.FutureTask.report(FutureTask.java:122)
at java.util.concurrent.FutureTask.get(FutureTask.java:188)
at com.cloudera.cmf.command.datacollection.GlobalCollectHostStatisticsCommand.handleDataArchivers(GlobalCollectHostStatisticsCommand.java:891)
at com.cloudera.cmf.command.datacollection.GlobalCollectHostStatisticsCommand.update(GlobalCollectHostStatisticsCommand.java:571)
at com.cloudera.server.cmf.CommandPusherThread.handleCommandInternal(CommandPusherThread.java:388)
at com.cloudera.server.cmf.CommandPusherThread.handleCommandBatched(CommandPusherThread.java:220)
at com.cloudera.server.cmf.CommandPusherThread.innerLoop(CommandPusherThread.java:139)
at com.cloudera.server.cmf.CommandPusherThread.run(CommandPusherThread.java:112)
Caused by: com.cloudera.cmon.MgmtServiceLocatorException: There is no configured event store
at com.cloudera.cmon.MgmtServiceLocator.getEventStoreQueryProxy(MgmtServiceLocator.java:312)
at com.cloudera.cmf.command.datacollection.EventsArchiver.archive(EventsArchiver.java:68)
at com.cloudera.cmf.command.datacollection.DataArchiver.call(DataArchiver.java:66)
at com.cloudera.cmf.command.datacollection.DataArchiver.call(DataArchiver.java:28)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
INFO [CommandPusher:datacollection.GlobalCollectHostStatisticsCommand@898] Data archivers complete.
WARN [PhoneHomeCallable-0:datacollection.PhoneHomeCallable@105] IOException while close ssh/sftp client.
net.schmizz.sshj.connection.ConnectionException: Disconnected
INFO [StaleEntityEviction:model.HeartbeatStore@107] Reaped 0 process heartbeats and 0 host heartbeats.