Created on 03-23-2017 07:09 PM - edited 09-16-2022 04:19 AM
Dear all,
please help me solve this problem:
When i tried to install cloudera manager (Path A) on Centos 7.3, I faced to alot of issue. Bellow, I will describe all step I did. Please tell me the wrong step if I have.
1. Install centos 7.3 on a computer with core i7 6700, ram 16gb, and hdd 2tb
2. Change hostname to cloudera1.abc.com.vn
3. change hosts file with information : 192.168.0.1 cloudera-1.abc.com.vn cloudera-1
4. In /etc/sysconfig/network file fill host name : cloudera-1
4. disable SELinux: SELINUX=disabled ( when i choise permissive, Cloudera alway alert Disable SELinux before install)
5. Setup proxy for yum.config
6. Some additional step
disable IPv6
Add the following to /etc/sysconfig/network:
NETWORKING_IPV6=no
IPV6INIT=no
disable firewall, do the following
systemctl status firewalld.service
systemctl stop firewalld.service
systemctl disable firewalld.service
some performance setting
echo "vm.swappiness = 1" >> /etc/sysctl.conf
echo 1 > /proc/sys/vm/swappiness
set ulimits
$ echo hdfs - nofile 32768 >> /etc/security/limits.conf
$ echo mapred - nofile 32768 >> /etc/security/limits.conf
$ echo hbase - nofile 32768 >> /etc/security/limits.conf
$ echo hdfs - nproc 32768 >> /etc/security/limits.conf
$ echo mapred - nproc 32768 >> /etc/security/limits.conf
$ echo hbase - nproc 32768 >> /etc/security/limits.conf
Disable transparent huge page
echo never > /sys/kernel/mm/transparent_hugepage/defrag
echo never > /sys/kernel/mm/transparent_hugepage/enabled
It all thing I did before setup. Now I will tried to setup with the cloudera guideline, and go to link http://your.server.com:7180
1. At page Parcel, => No Parcels found. I must choise a pack
Versions of CDH that are too new for this version of Cloudera Manager (5.10.0) will not be shown.
2. At step 5
Cluster Installation
No CDH version detected. Check Again
Ensure that all hosts have the same CDH version and then click Check Again to proceed.
No CDH version detected. Check AgainEnsure that all hosts have the same CDH version and then click Check Again to proceed.
What should I do now?
Created 03-23-2017 11:37 PM
Created 03-24-2017 01:25 PM
This link has the parcels present in it. http://archive.cloudera.com/cdh5/parcels/
You can enter this link in the parcel location, distribute your parcels and then you will be able to go further.
Created 03-24-2017 06:19 PM
It's defaut link. and it always appears.
I think problem is proxy, after setup proxy, we must wait?
Created 03-24-2017 07:45 PM
After parcel downloaded. It did not run any more ?
Cluster Installation Installing Selected Parcels The selected parcels are being downloaded and installed on all the hosts in the cluster.
CDH 5.10.0-1.cdh5.10.0.p0.41
Downloaded: 100%
Distributed: 0/1
Unpacked: 0/1
Activated: 0/1
Do you have any suggestion
Created on
03-24-2017
07:55 PM
- last edited on
03-27-2017
08:03 AM
by
cjervis
The log detail
Host Log Level Time Source Message
CM server guid: 077ca499-756a-49cc-bdd6-df043dc0e6feView Log File |
Using parcels directory from server provided value: /opt/cloudera/parcelsView Log File |
Agent does create users/groups and apply file permissionsView Log File |
Using /opt/cloudera/parcel-cache for parcel cacheView Log File |
Caught unexpected exception in main loop. Traceback (most recent call last): File "/usr/lib64/cmf/agent/build/env/lib/python2.7/site-packages/cmf-5.10.0-py2.7.egg/cmf/agent.py", line 710, in __issue_heartbeat self._init_after_first_heartbeat_response(resp_data) File "/usr/lib64/cmf/agent/build/env/lib/python2.7/site-packages/cmf-5.10.0-py2.7.egg/cmf/agent.py", line 947, in _init_after_first_heartbeat_response self.client_configs.load() File "/usr/lib64/cmf/agent/build/env/lib/python2.7/site-packages/cmf-5.10.0-py2.7.egg/cmf/client_configs.py", line 682, in load new_deployed.update(self._lookup_alternatives(fname)) File "/usr/lib64/cmf/agent/build/env/lib/python2.7/site-packages/cmf-5.10.0-py2.7.egg/cmf/client_configs.py", line 432, in _lookup_alternatives return self._parse_alternatives(alt_name, out) File "/usr/lib64/cmf/agent/build/env/lib/python2.7/site-packages/cmf-5.10.0-py2.7.egg/cmf/client_configs.py", line 444, in _parse_alternatives path, _, _, priority_str = line.rstrip().split(" ") ValueError: too many values to unpackView Log File |
Created 03-28-2017 06:48 AM
Created 03-28-2017 07:54 AM
for heart beat issue remove guid file from client it will work fine .
/var/lib/cloudera-scm-agent/cm_guid on each node
Created 03-24-2017 10:30 PM
facing similar issue spend countless hours . I have tried on RHEL 7.3 as well same issue .
Created 03-26-2017 06:16 PM
Created 03-28-2017 07:55 AM
Created on 03-28-2017 09:49 AM - edited 03-28-2017 09:50 AM
What if the screen freezes and no progress though the Download shows 100% but distribute 0/4 , Unpack 0/4 and Activate 0/4?
Created 03-28-2017 11:40 AM
i tried it atleast 15-20 time from stratch and then found its an openjdk issue that was root cause of this issue remove
1. yum remove javaopen*
2. Stop the server and the agent
3.download and install the correct version JDK1.8_31
for your convinience find the link below
http://www.ubuntumag.com/install-java-8-jdk-8u31-on-centos-rhel-765-fedora/
4. Start the server and the agent .
feel free to contact me for any further support on this freeze distribution issue CDH 5.10
Created 03-28-2017 11:55 AM
At this moment, I have skipped the Cloudera Manager JDK installation since I have downloaded and installed JDK 1.8 on all the hosts and set the $JAVA_HOME as well. But still java -version points to open JDK.
[root@namenode1 ~]# rpm -aq | grep -i jdk
java-1.8.0-openjdk-headless-1.8.0.121-0.b13.el7_3.x86_64
java-1.8.0-openjdk-1.8.0.121-0.b13.el7_3.x86_64
jdk-1.6.0_31-fcs.x86_64
copy-jdk-configs-1.2-1.el7.noarch
[root@namenode1 ~]# java -version
openjdk version "1.8.0_121"
OpenJDK Runtime Environment (build 1.8.0_121-b13)
OpenJDK 64-Bit Server VM (build 25.121-b13, mixed mode)
[root@namenode1 ~]# echo $JAVA_HOME
/usr/java/jdk1.8.0_121
[root@namenode1 ~]#
Let me try to remove openJDk
Created 03-28-2017 01:07 PM
u have installed open jdk again it is supporting orcale jdk in my case find the installation instructions below .
http://www.ubuntumag.com/install-java-8-jdk-8u31-on-centos-rhel-765-fedora/
remove open jdk by
$ yum remove java-o*
or
$ yum remove javao*
Created 03-28-2017 12:01 PM
This will be fixed in the next maintenance release 5.10.1, 5.9.2.
Created 03-28-2017 01:00 PM
any idea when this release will be offically available
Created 05-31-2017 01:34 AM
Hi,
Is this issue resolved ? were you able to bypass that "no cdh version detected" issue ?
I am facing this issue and have tried reinstall multiple times. But it gets stuck at same point every time
Created 05-31-2017 01:39 AM
Created 06-09-2017 03:52 AM
Thanks alot @adminzeeshan, yes it was due to open JDK.
Issue is resolved and installation is successful.
Regards,
Shrilesh