Failed to install jdk package

[#1]

Hello,

I am trying to set up one node hadoop cluster using cloudera manager. i am not able to get past the jdk installion step. This is the error I am getting.

Installing jdk package...

BEGIN yum list installed jdk
Loaded plugins: fastestmirror
Installed Packages
jdk.x86_64 2000:1.6.0_31-fcs @Cloudera-manager
END (0)
BEGIN echo jdk cloudera-manager-agent cloudera-manager-daemons | grep jdk
jdk cloudera-manager-agent cloudera-manager-daemons
END (0)
BEGIN yum info jdk
Loaded plugins: fastestmirror
Determining fastest mirrors
* base: centos.mirror.serversaustralia.com.au
* epel: mirror.as24220.net
* extras: centos.mirror.serversaustralia.com.au
* updates: centos.mirror.serversaustralia.com.au
http://beta.cloudera.com/search/redhat/6/x86_64/search/0/repodata/repomd.xml: [Errno 14] PYCURL ERROR 22 - "The requested URL returned error: 404"
Trying other mirror.
Error: Cannot retrieve repository metadata (repomd.xml) for repository: cdh-solr. Please verify its path and try again
END (1)
remote package jdk is not available, giving up
waiting for rollback request

I tried many things to make it work. I installed the jdk package manually. I removed both files cdh-solr.repo and cloudera-search.repo and then clicked on install. I am getting the same error as before. Moreover the file cdh-solr.repo is created everytime I click on install. And it contains that beta.cloudera.com' url. I am not understanding where it is getting reference from. None of the files in yum.repos.d have that url.

Can anyone help me fix this issue?

Thanks,
Ashwin

[#2]

Hi Ashwin,

You've been caught by an issue wherein we moved from beta.cloudera.com to a full, GA release of search.

The installer that you're using is going to continue looking for the search bits at the beta site, unfortunately.

I'd suggest that you please download the latest binary from:

http://archive.cloudera.com/cm4/installer/latest/

And it should correctly look for the Search bits at the new location.

Apologies for the issue.

Best,

Adam

[#3 · Accepted solution]

Thank you Adam for the reply. Anyways i fixed the issue by upgrading my manger to 4.7.1 throught the VM.

[#4]

Hello Adam I get the same issue , But with different error message .
/tmp/scm_prepare_node.Xfp4BWAd
using SSH_CLIENT to get the SCM hostname: 127.0.0.1 52441 22
opening logging file descriptor
Starting installation script...
Acquiring installation lock...
BEGIN flock 4
END (0)
Detecting root privileges...
effective UID is 0
Detecting distribution...
BEGIN grep Tikanga /etc/redhat-release
END (1)
BEGIN grep 'CentOS release 5' /etc/redhat-release
END (1)
BEGIN grep 'Scientific Linux release 5' /etc/redhat-release
END (1)
BEGIN grep Santiago /etc/redhat-release
END (1)
BEGIN grep 'CentOS Linux release 6' /etc/redhat-release
END (1)
BEGIN grep 'CentOS release 6' /etc/redhat-release
CentOS release 6.4 (Final)
END (0)
/etc/redhat-release ==> CentOS 6
Detecting Cloudera Manager Server...
BEGIN host -t PTR 127.0.0.1
1.0.0.127.in-addr.arpa domain name pointer localhost.
END (0)
using localhost as scm server hostname
BEGIN which python
/usr/bin/python
END (0)
BEGIN python -c 'import socket; import sys; s = socket.socket(socket.AF_INET); s.settimeout(5.0); s.connect((sys.argv[1], int(sys.argv[2]))); s.close();' localhost 7182
END (0)
BEGIN which wget
/usr/bin/wget
END (0)
BEGIN wget -qO- -T 1 -t 1 http://169.254.169.254/latest/meta-data/public-hostname && /bin/echo
END (4)
Installing package repositories...
validating format of repository file /tmp/scm_prepare_node.Xfp4BWAd/repos/rhel6/cloudera-manager.repo
installing repository file /tmp/scm_prepare_node.Xfp4BWAd/repos/rhel6/cloudera-manager.repo
repository file /tmp/scm_prepare_node.Xfp4BWAd/repos/rhel6/cloudera-manager.repo installed
Refreshing package metadata...
BEGIN yum clean all
Loaded plugins: fastestmirror, refresh-packagekit, security
Repository cloudera-manager is listed more than once in the configuration
Cleaning repos: cloudera-manager
Cleaning up Everything
END (0)
BEGIN rm -Rf /var/cache/yum/x86_64
END (0)
BEGIN yum makecache
Loaded plugins: fastestmirror, refresh-packagekit, security
Repository cloudera-manager is listed more than once in the configuration
http://archive.cloudera.com/cm4/redhat/6/x86_64/cm/4/repodata/repomd.xml: [Errno 12] Timeout on http://archive.cloudera.com/cm4/redhat/6/x86_64/cm/4/repodata/repomd.xml: (28, 'connect() timed out!')
Trying other mirror.
Error: Cannot retrieve repository metadata (repomd.xml) for repository: cloudera-manager. Please verify its path and try again
END (1)
Installing jdk package...
BEGIN yum list installed jdk
Loaded plugins: fastestmirror, refresh-packagekit, security
Installed Packages
jdk.x86_64 2000:1.7.0_55-fcs installed
END (0)
BEGIN echo jdk oracle-j2sdk1.7 cloudera-manager-agent cloudera-manager-daemons | grep jdk
jdk oracle-j2sdk1.7 cloudera-manager-agent cloudera-manager-daemons
END (0)
BEGIN yum info jdk
Loaded plugins: fastestmirror, refresh-packagekit, security
Determining fastest mirrors
http://archive.cloudera.com/cm4/redhat/6/x86_64/cm/4/repodata/repomd.xml: [Errno 12] Timeout on http://archive.cloudera.com/cm4/redhat/6/x86_64/cm/4/repodata/repomd.xml: (28, 'connect() timed out!')
Trying other mirror.
Error: Cannot retrieve repository metadata (repomd.xml) for repository: cloudera-manager. Please verify its path and try again
END (1)
remote package jdk is not available, giving up
waiting for rollback request

Please help

Thanks
Bala

[#5]

Hi Bala,

It appears to me that everything is proceeding fine in your installation until it gets to this point:

[Errno 12] Timeout on http://archive.cloudera.com/cm4/redhat/6/x86_64/cm/4/repodata/repomd.xml       (28, 'connect() timed out!')

I tried to access that link, and I can get there. Can you click on the above and validate that you can resolve that URL?

The issue appears to be that the server on which you are trying to install Cloudera Manager does not have access to this URL.

Can you try the following: 

> ping archive.cloudera.com

I will bet that you have some issue there. You may need to resolve networking on your host. Some suggestions:

* Check that DNS servers set up (or use /etc/hosts)

* DNS look up for hostnames

• dig @<dnsserver> hostname

* Reverse DNS lookup for IPs

• host <ip address>

* If /etc/hosts is being used instead of DNS (which is not recommended but sometimes necessary) make sure the /etc/hosts has the fully qualified domain name listed first.

• <ip address> <fqdn> <alias>
• i.e. 10.10.10.1 hadoop1.example.com hadoop1

If you are using /etc/hosts, please paste the contents of that file here

[#6]

Hello Adam ,

1. I am able to access the link

2. ping archive.cloudera.com.

   > PING d2ykvu8cr6x76c.cloudfront.net (54.230.172.68) 56(84) bytes of data.

3. This is my hosts file

127.0.0.1 localhost localhost.localdomain localhost4 localhost4.localdomain4 INCHCMPCCHE01
::1 localhost localhost.localdomain localhost6 localhost6.localdomain6
172.18.42.119 INCHCMPCCHE01

4. for host 172.18.42.119 i get abcd00958.mycompany.ad

Please help . I am pretty confused what to do

Thanks

Bala

[#7]

Hello ,

I made some changes to the etc/hosts .

127.0.0.1 localhost localhost.localdomain localhost4 localhost4.localdomain4
::1 localhost localhost.localdomain localhost6 localhost6.localdomain6
172.18.42.119 inbasdlp00958.mycompany.ad INCHCMPCCHE01

Now while adding cluster its stuck at distributing the Cluster . Its staying in 0% .
What should i do , this is the log file data

2014-06-23 02:42:59,559 INFO [StaleEntityEviction:model.HeartbeatStore@107] Reaped 0 process heartbeats and 0 host heartbeats.
2014-06-23 02:42:59,564 INFO [StaleEntityEviction:cmf.StaleEntityEvictionThread@238] Found no commands older than 2012-06-22T21:12:59.563Z to reap.
2014-06-23 02:42:59,565 INFO [StaleEntityEviction:node.NodeScannerService@335] Reaped 0 requests.
2014-06-23 02:42:59,565 INFO [StaleEntityEviction:node.NodeConfiguratorService@358] Reaped 0 requests.
2014-06-23 02:43:25,969 INFO [ParcelUpdateService:components.LocalParcelManagerImpl@97] Found files CDH-5.0.2-1.cdh5.0.2.p0.13-el6.parcel under /opt/cloudera/parcel-repo
2014-06-23 02:44:39,756 INFO [ParcelUpdateService:components.LocalParcelManagerImpl@97] Found files CDH-5.0.2-1.cdh5.0.2.p0.13-el6.parcel under /opt/cloudera/parcel-repo
2014-06-23 02:45:57,719 INFO [ParcelUpdateService:components.LocalParcelManagerImpl@97] Found files CDH-5.0.2-1.cdh5.0.2.p0.13-el6.parcel under /opt/cloudera/parcel-repo
2014-06-23 02:47:11,853 INFO [ParcelUpdateService:components.LocalParcelManagerImpl@97] Found files CDH-5.0.2-1.cdh5.0.2.p0.13-el6.parcel under /opt/cloudera/parcel-repo
2014-06-23 02:48:28,955 INFO [ParcelUpdateService:components.LocalParcelManagerImpl@97] Found files CDH-5.0.2-1.cdh5.0.2.p0.13-el6.parcel under /opt/cloudera/parcel-repo
2014-06-23 02:49:46,071 INFO [ParcelUpdateService:components.LocalParcelManagerImpl@97] Found files CDH-5.0.2-1.cdh5.0.2.p0.13-el6.parcel under /opt/cloudera/parcel-repo
2014-06-23 02:50:59,881 INFO [ParcelUpdateService:components.LocalParcelManagerImpl@97] Found files CDH-5.0.2-1.cdh5.0.2.p0.13-el6.parcel under /opt/cloudera/parcel-repo

Thanks

[#8]

Hello Adam ,
I checked the agent log ,
i see like this
Exception: Invalid parcel directory: manifest.json
[23/Jun/2014 03:19:31 +0000] 2597 MainThread agent INFO Using parcels directory from server provided value: /opt/cloudera/parcel-repo
[23/Jun/2014 03:19:31 +0000] 2597 MainThread agent WARNING Expected user root for /opt/cloudera/parcel-repo but was cloudera-scm
[23/Jun/2014 03:19:31 +0000] 2597 MainThread agent WARNING Expected group root for /opt/cloudera/parcel-repo but was cloudera-scm
[23/Jun/2014 03:19:31 +0000] 2597 MainThread parcel INFO Agent does create users/groups and apply file permissions
[23/Jun/2014 03:19:31 +0000] 2597 MainThread parcel INFO Loading parcel manifest for: CDH-5.0.2-1.cdh5.0.2.p0.13-el6.parcel.sha
[23/Jun/2014 03:19:31 +0000] 2597 MainThread parcel ERROR Exception while reading parcel: CDH-5.0.2-1.cdh5.0.2.p0.13-el6.parcel.sha
Traceback (most recent call last):
File "/usr/lib64/cmf/agent/src/cmf/parcel.py", line 104, in refresh
fd = open(manifest)
IOError: [Errno 20] Not a directory: u'/opt/cloudera/parcel-repo/CDH-5.0.2-1.cdh5.0.2.p0.13-el6.parcel.sha/meta/parcel.json'
[23/Jun/2014 03:19:31 +0000] 2597 MainThread parcel INFO Loading parcel manifest for: manifest.json
[23/Jun/2014 03:19:31 +0000] 2597 MainThread parcel ERROR Exception while reading parcel: manifest.json
Traceback (most recent call last):
File "/usr/lib64/cmf/agent/src/cmf/parcel.py", line 104, in refresh
fd = open(manifest)
IOError: [Errno 20] Not a directory: u'/opt/cloudera/parcel-repo/manifest.json/meta/parcel.json'
[23/Jun/2014 03:19:31 +0000] 2597 MainThread agent ERROR Caught unexpected exception in main loop.
Traceback (most recent call last):
File "/usr/lib64/cmf/agent/src/cmf/agent.py", line 454, in start
self._init_after_first_heartbeat_response(heartbeat_response["data"])
File "/usr/lib64/cmf/agent/src/cmf/agent.py", line 529, in _init_after_first_heartbeat_response
self.repo.refresh()
File "/usr/lib64/cmf/agent/src/cmf/parcel.py", line 136, in refresh
pid = ParcelId.dir(child)
File "/usr/lib64/cmf/agent/src/cmf/parcel_id.py", line 74, in dir
raise Exception("Invalid parcel directory: %s" % (dir))

[#9]

Hi Balakumar

The error message that you pasted most recently seems to indicate that there is a problem on the client machine with /opt/cloudera/parcel-repo

I see a WARNING message indicating that it is owned by cloudera-scm/cloudera-scm

Looks like it expects to be owned by root/root

Can you do the following:

sudo chown root:root /opt/cloudera/parcel-repo

Then try this process?

Further, in order to help understand the environment:

How many hosts do you have for this cluster? 

[#10]

Hello Adam ,

Thanks for your reply .
I have installed Cloudera Manager 5 Enterprise edition . It was strange that i didnt get any issues like the one i mentioned above .

Right now i stuck with this issue . Can you suggest a solution for this
http://community.cloudera.com/t5/Cloudera-Manager-Installation/Cloudera-manager-admin-console-Issues...

Thanks
Bala