Member since
05-31-2016
13
Posts
1
Kudos Received
0
Solutions
06-06-2016
08:14 AM
Hi,
Does this memory allocation referres to the physical memory allocated to the node? What's the best way to go about resolving this error?
Thanks
cluster : Configuration Issues
hadoop5.vm : Memory Overcommit Validation Threshold
Memory on host hadoop5.vm is overcommitted. The total memory allocation is 10.5 GiB bytes but there are only 11.5 GiB bytes of RAM (11.5 GiB bytes of which are reserved for the system). Visit the Resources tab on the Host page for allocation details. Reconfigure the roles on the host to lower the overall memory allocation. Note: Java maximum heap sizes are multiplied by 1.3 to approximate JVM overhead.
... View more
Labels:
06-01-2016
10:43 AM
I solved that parcel.torrent time-out problem. Found out the 4 agent nodes didn't have the hostname of the server in their host file. Now I just have to take care of those bits and pieces: There are mismatched versions across the system, which will cause failures. See below for details on which hosts are running what versions of components. Cloudera supports versions 1.6.0_31 and 1.7.0_55 of Oracle JVM and later. OpenJDK is not supported, and gcj is known to not work. Check the component version table below to identify hosts with unsupported versions of Java. Cloudera supports versions 1.6.0_31 and 1.7.0_55 of Oracle JVM and later. OpenJDK is not supported, and gcj is known to not work. Check the component version table below to identify hosts with unsupported versions of Java. Java version 6 not supported for CDH 5. You must use Java version 7. Cloudera recommends setting /proc/sys/vm/swappiness to a maximum of 10. Current setting is 60. Use the sysctl command to change this setting at run time and edit/etc/sysctl.conf for this setting to be saved after a reboot. You can continue with installation, but Cloudera Manager might report that your hosts are unhealthy because they are swapping.
... View more
05-31-2016
05:30 PM
Hi, When I login into Cloudera Manger it goes to the Cluster Installation wizard, where it says it is installing parcels, but just hangs and nothing happens. I checked the log on the nodes and it gives those errors: Anyone knows what this parcel.torrent file is suppose to do what, and how to resolve this python errors? thank you, cluster package installation screenshot [31/May/2016 11:14:35 +0000] 4374 Thread-13 https ERROR Failed to retrieve/stroe URL: http://hadoop5.vm:7180/cmf/parcel/download/CDH-5.7.0-1.cdh5.7.0.p0.45-el6.parcel.torrent -> /opt/cloudera/parcel-cache/CDH-5.7.0-1.cdh5.7.0.p0.45-el6.parcel.torrent <urlopen error timed out>
Traceback (most recent call last):
File "/usr/lib64/cmf/agent/build/env/lib/python2.6/site-packages/cmf-5.7.0-py2.6.egg/cmf/https.py", line 176, in fetch_to_file
resp = self.open(req_url)
File "/usr/lib64/cmf/agent/build/env/lib/python2.6/site-packages/cmf-5.7.0-py2.6.egg/cmf/https.py", line 171, in open
return self.opener(*pargs, **kwargs)
File "/usr/lib64/python2.6/urllib2.py", line 126, in urlopen
return _opener.open(url, data, timeout)
File "/usr/lib64/python2.6/urllib2.py", line 391, in open
response = self._open(req, data)
File "/usr/lib64/python2.6/urllib2.py", line 409, in _open
'_open', req)
File "/usr/lib64/python2.6/urllib2.py", line 369, in _call_chain
result = func(*args)
File "/usr/lib64/python2.6/urllib2.py", line 1161, in http_open
return self.do_open(httplib.HTTPConnection, req)
File "/usr/lib64/python2.6/urllib2.py", line 1136, in do_open
raise URLError(err)
URLError: <urlopen error timed out>
... View more
05-31-2016
12:29 PM
Hi, When I login into Cloudera Manger it goes to the Cluster Installation wizard, where it says it is installing parcels, but just hangs and nothing happens. I checked the log on the nodes and it gives those errors: Anyone knows what this parcel.torrent file is suppose to do what, and how to resolve this python errors? thank you, cluster package installation screenshot Version: Cloudera Enterprise Data Hub Edition Trial 5.7.0 (#76 built by jenkins on 20160401-1334 git: ec0e7e69444280aa311511998bd83e8e6572f61c) Java VM Name: Java HotSpot(TM) 64-Bit Server VM Java VM Vendor: Oracle Corporation Java Version: 1.7.0_67 http://10.3.1.46:7180/api/v12/clusters/Cluster%201/parcels { "items" : [ { "product" : "CDH", "version" : "4.7.1-1.cdh4.7.1.p0.47", "stage" : "AVAILABLE_REMOTELY", "clusterRef" : { "clusterName" : "cluster" } }, { "product" : "SOLR", "version" : "1.3.0-1.cdh4.5.0.p0.9", "stage" : "AVAILABLE_REMOTELY", "clusterRef" : { "clusterName" : "cluster" } }, { "product" : "CDH", "version" : "5.7.0-1.cdh5.7.0.p0.45", "stage" : "ACTIVATED", "clusterRef" : { "clusterName" : "cluster" } }, { "product" : "IMPALA", "version" : "2.1.0-1.impala2.0.0.p0.1995", "stage" : "AVAILABLE_REMOTELY", "clusterRef" : { "clusterName" : "cluster" } } ] } http://10.3.1.46:7180/api/v12/clusters/Cluster%202/parcels { "items" : [ { "product" : "CDH", "version" : "4.7.1-1.cdh4.7.1.p0.47", "stage" : "AVAILABLE_REMOTELY", "clusterRef" : { "clusterName" : "cluster2" } }, { "product" : "SOLR", "version" : "1.3.0-1.cdh4.5.0.p0.9", "stage" : "AVAILABLE_REMOTELY", "clusterRef" : { "clusterName" : "cluster2" } }, { "product" : "CDH", "version" : "5.7.0-1.cdh5.7.0.p0.45", "stage" : "DISTRIBUTING", "clusterRef" : { "clusterName" : "cluster2" } }, { "product" : "IMPALA", "version" : "2.1.0-1.impala2.0.0.p0.1995", "stage" : "AVAILABLE_REMOTELY", "clusterRef" : { "clusterName" : "cluster2" } } ]} http://10.3.1.46:7180/api/v12/cm/config { "items" : [ { "name" : "CLUSTER_STATS_START", "value" : "10/25/2012 22:40" } ]} File "/usr/lib64/cmf/agent/build/env/lib/python2.6/site-packages/cmf-5.7.0-py2.6.egg/cmf/downloader.py", line 263, in download cmf.https.ssl_url_opener.fetch_to_file(torrent_url, torrent_file) File "/usr/lib64/cmf/agent/build/env/lib/python2.6/site-packages/cmf-5.7.0-py2.6.egg/cmf/https.py", line 176, in fetch_to_file resp = self.open(req_url) File "/usr/lib64/cmf/agent/build/env/lib/python2.6/site-packages/cmf-5.7.0-py2.6.egg/cmf/https.py", line 171, in open return self.opener(*pargs, **kwargs) File "/usr/lib64/python2.6/urllib2.py", line 126, in urlopen return _opener.open(url, data, timeout) File "/usr/lib64/python2.6/urllib2.py", line 391, in open response = self._open(req, data) File "/usr/lib64/python2.6/urllib2.py", line 409, in _open '_open', req) File "/usr/lib64/python2.6/urllib2.py", line 369, in _call_chain result = func(*args) File "/usr/lib64/python2.6/urllib2.py", line 1190, in http_open return self.do_open(httplib.HTTPConnection, req) File "/usr/lib64/python2.6/urllib2.py", line 1165, in do_open raise URLError(err) URLError: <urlopen error timed out> [31/May/2016 15:18:55 +0000] 4793 Thread-13 downloader INFO Fetching torrent: http://hadoop5.vm:7180/cmf/parcel/download/CDH-5.7.0-1.cdh5.7.0.p0.45-el6.parcel.torrent
... View more
05-01-2016
12:52 PM
In the hosts file, there's only two entries [root@centos7 ~]# vi /etc/hosts 127.0.0.1 localhost localhost.localdomain localhost4 localhost4.localdomain4
::1 localhost localhost.localdomain localhost6 localhost6.localdomain6 No entries in: just says created by anaconda "/etc/sysconfig/network" For the current session, I typed # hostname ambarivm Noting happened
... View more
05-01-2016
04:25 AM
Hi Predrag, I have the three ambari Users ("%", "localhost", and the FQDN (hostname)) use ambari; show tables outputs: ERROR 1049 (42000): Unknown database 'ambari' hostname -f outputs: hostname: Name or service not known And now when I start ambari-server, this is what I get: [root@centos7 /]# ambari-server start
Using python /usr/bin/python2.7
Starting ambari-server
WARNING: The hostname was not found in the reverse DNS lookup. This may result in incorrect behavior. Please check the DNS setup and fix the issue.
Ambari Server running with administrator privileges.
Organizing resource files at /var/lib/ambari-server/resources...
Server PID at: /var/run/ambari-server/ambari-server.pid
Server out at: /var/log/ambari-server/ambari-server.out
Server log at: /var/log/ambari-server/ambari-server.log
Waiting for server start.........sh: /var/run/ambari-server/ambari-server.exitcode: Permission denied
...........
ERROR: Exiting with exit code -1.
REASON: Ambari Server java process died with exitcode -1. Check /var/log/ambari-server/ambari-server.out for more information.
[root@centos7 /]#
... View more
05-01-2016
04:09 AM
I also have an issue to the ambari upgrade: [root@centos7 /]# ambari-server upgrade
Using python /usr/bin/python2.7
Upgrading ambari-server
Updating properties in ambari.properties ...
WARNING: Can not find ambari.properties.rpmsave file from previous version, skipping import of settings
Fixing database objects owner
Upgrading database schema
ERROR: Error executing schema upgrade, please check the server logs.
ERROR: Ambari server upgrade failed. Please look at /var/log/ambari-server/ambari-server.log, for more details.
ERROR: Exiting with exit code 11.
REASON: Schema upgrade failed.
... View more
04-29-2016
01:04 AM
eth0 inet addr:10.3.1.45 Bcast:10.3.1.255 Mask:255.255.255.0 lo inet: addr:127.0.0.1 Mask:255.0.0.0
... View more
04-29-2016
12:28 AM
I checked the ambari.properties file and saw this line. What's that IP address associates with? server.fqdn.service.url=http://169.254.169.254/latest/meta-data/public-hostname
... View more
04-29-2016
12:09 AM
That command outputs: # ifconfig http://10.3.1.45:8080 "http://10.3.1.4: error fetching interface information: device not found" # ifconfig http://IP:8080 "http://IP:8080: error fetching interface information: device not found"
... View more
04-28-2016
08:52 PM
Hi Kuldeep, On the ambari-server host
netstat -tulpn|grep 8080 returns back to the command line When I try to telnet to the ambari-server from my desktop machine, it comes back "connecting to 10.3.1.45 ... could not open connection to the host, on port 8080: connection failed" I stopped service iptables chkconfig iptables off takes me back to the command line any other suggestions?
... View more
04-28-2016
08:09 PM
1 Kudo
I recently installed ambari-server on Oracle linux 6.7 within a proxmox VM. I did a custom installation with a mysql local database. All installations completed successfully, but when I enter the ambari install wizard URL "http://10.3.1.45:8080" I get an unable to connect page. I checked the ambari-server log and it shows the following: [root@proxmox-node2 ambari-server]# tail -f 100 ambari-server.log
tail: cannot open `100' for reading: No such file or directory
==> ambari-server.log <==
28 Apr 2016 15:12:50,046 INFO [main] Configuration:1084 - Hosts Mapping File null
28 Apr 2016 15:12:50,080 INFO [main] HostsMap:60 - Using hostsmap file null
28 Apr 2016 15:14:13,848 INFO [main] AmbariServer:173 - Found org/apache/ambari/server/controller/AmbariServer.class class in file:/usr/lib/ambari-server/ambari-server-2.2.1.1.70.jar!/org/apache/ambari/server/controller/AmbariServer.class
28 Apr 2016 15:14:14,603 INFO [main] ControllerModule:194 - Detected MYSQL as the database type from the JDBC URL
28 Apr 2016 15:14:17,513 INFO [main] ControllerModule:236 - Using c3p0 ComboPooledDataSource as the EclipsLink DataSource
28 Apr 2016 15:14:20,378 INFO [main] Configuration:754 - Reading password from existing file
28 Apr 2016 15:14:21,913 INFO [main] MLog:80 - MLog clients using log4j logging.
28 Apr 2016 15:14:21,965 INFO [main] Configuration:1084 - Hosts Mapping File null
28 Apr 2016 15:14:21,996 INFO [main] HostsMap:60 - Using hostsmap file null
28 Apr 2016 15:14:48,131 INFO [main] C3P0Registry:204 - Initializing c3p0-0.9.1.1 [built 15-March-2007 01:32:31; debug? true; trace: 10]
28 Apr 2016 15:15:22,650 INFO [main] ControllerModule:194 - Detected MYSQL as the database type from the JDBC URL
28 Apr 2016 15:15:23,660 INFO [main] ControllerModule:236 - Using c3p0 ComboPooledDataSource as the EclipsLink DataSource
28 Apr 2016 15:15:27,789 INFO [main] MLog:80 - MLog clients using log4j logging.
28 Apr 2016 15:15:41,175 INFO [main] C3P0Registry:204 - Initializing c3p0-0.9.1.1 [built 15-March-2007 01:32:31; debug? true; trace: 10]
q
^C
[root@proxmox-node2 ambari-server]# ambari-server --version
2.2.1.1
Does any know why the apache ambari wizard doesn't load via the ip address of vm node? Thank you
... View more
Labels: