Member since
03-14-2016
4721
Posts
1111
Kudos Received
874
Solutions
My Accepted Solutions
| Title | Views | Posted |
|---|---|---|
| 2726 | 04-27-2020 03:48 AM | |
| 5285 | 04-26-2020 06:18 PM | |
| 4452 | 04-26-2020 06:05 PM | |
| 3576 | 04-13-2020 08:53 PM | |
| 5380 | 03-31-2020 02:10 AM |
08-29-2017
07:03 AM
@pooja shrivastava Looks like 8888 port is not accessible outside sandbox which should not happen. So we can do the following testing to check few things: 0. Are you able to access the Web Terminal? http://localhost:4200 1. Login to Sandbox and check if the port 8888 is actually opened. # ssh root@127.0.0.1 -p 2222
Enter password: hadoop
# netstat -tnlpa | grep 8888 2. Also please check the default "/etc/hosts" inside the sandbox which usually looks like something as following if you have not modified it. "below is output from my HDP 2.6" sandbox. [root@sandbox ~]# cat /etc/hosts
127.0.0.1 localhost
::1 localhost ip6-localhost ip6-loopback
fe00::0 ip6-localnet
ff00::0 ip6-mcastprefix
ff02::1 ip6-allnodes
ff02::2 ip6-allrouters
172.17.0.2 sandbox.hortonworks.com sandbox 3. If we see that the port is opened then we will need to check if by default Firewall is not causing any issue: # service iptables status
# service iptables stop 4. Next we will check if the Port forwarding is correct and the 8888 port is unblocked and allows port forwarding. Please see the below link for port forwarding configuration and validation: https://community.hortonworks.com/articles/65914/how-to-add-ports-to-the-hdp-25-virtualbox-sandbox.html 5. Still if you face any issue then try restarting the HDP Sandbox and then try again. 6. If the issue still occurs then try re importing the HDP sandbox images and then try again. Reference: For step by step Sandbox installation the following link is useful: https://hortonworks.com/hadoop-tutorial/learning-the-ropes-of-the-hortonworks-sandbox/ .
... View more
08-29-2017
05:43 AM
@uri ben-ari I am not sure at this point regarding your last query. However it will be good to first see what error are we getting to understand why the services are not starting. Looking at the service/components logs or the Ambari UI operation history will give us fare idea on why the service start failed.
... View more
08-29-2017
05:29 AM
@uri ben-ari To list all the requests use the following API and see what is the maximum request ID (which will be the recent one, Higher the requestID more recent one it is): # curl -sH "X-Requested-By: ambari" -u admin:admin -i http://localhost:8080/api/v1/clusters/Sandbox/requests?fields=Requests/request_status | grep -A 1 id | awk '{print $NF}' > /tmp/requests_details.txt; sed -e '1,2d' -e s'/--//g' -e 's/\n//g' -e 's/"//g' -e '/^$/d' /tmp/requests_details.txt | awk 'NR%2{printf "%s ",$0;next;}1' Example Output: 185, COMPLETED
186, COMPLETED
187, COMPLETED
188, FAILED
189, COMPLETED
190, COMPLETED
191, COMPLETED
193, COMPLETED
195, COMPLETED
196, COMPLETED
197, COMPLETED
198, COMPLETED
199, COMPLETED
200, COMPLETED
201, COMPLETED
202, COMPLETED
203, COMPLETED
204, COMPLETED
206, ABORTED . . Then if you want to see only the IN_PROGRESS requests then you can make the following API call. # curl -sH "X-Requested-By: ambari" -u admin:admin -i http://localhost:8080/api/v1/clusters/Sandbox/requests?fields=Requests/request_status | grep -A 1 id | awk '{print $NF}' > /tmp/requests_details.txt; sed -e '1,2d' -e s'/--//g' -e 's/\n//g' -e 's/"//g' -e '/^$/d' /tmp/requests_details.txt | awk 'NR%2{printf "%s ",$0;next;}1' | grep -i 'IN_PROGRESS' Example Output: # curl -sH "X-Requested-By: ambari" -u admin:admin -i http://localhost:8080/api/v1/clusters/Sandbox/requests?fields=Requests/request_status | grep -A 1 id | awk '{print $NF}' > /tmp/requests_details.txt; sed -e '1,2d' -e s'/--//g' -e 's/\n//g' -e 's/"//g' -e '/^$/d' /tmp/requests_details.txt | awk 'NR%2{printf "%s ",$0;next;}1' | grep -i 'IN_PROGRESS'
207, IN_PROGRESS
.
... View more
08-29-2017
05:18 AM
@uri ben-ari After setting those parameters , you mentioned that "some of the services/components cannot started". So can you please check the logs of those services and let us know if you see any error? As we see that the above mentioned parameters are somewhere related to tuning like Heap and other memory related parameters that differ from environment to environment. So the other clusters values might not be exactly same and applicable for this cluster nodes as well.
... View more
08-29-2017
01:19 AM
@John Koop From your attached screenshot looks like 8888 port is not accessible outside sandbox which should not happen. So we can do the following testing to check few things: 1. Login to Sandbox and check if the port 8888 is actually opened. # ssh root@127.0.0.1 -p 2222
# netstat -tnlpa | grep 8888 . 2. Also please check the default "/etc/hosts" inside the sandbox which usually looks like something as following if you have not modified it. "below is output from my HDP 2.6" sandbox. [root@sandbox ~]# cat /etc/hosts
127.0.0.1 localhost
::1 localhost ip6-localhost ip6-loopback
fe00::0 ip6-localnet
ff00::0 ip6-mcastprefix
ff02::1 ip6-allnodes
ff02::2 ip6-allrouters
172.17.0.2 sandbox.hortonworks.com sandbox 3. If we see that the port is opened then we will need to check if by default Firewall is not causing any issue: # service iptables status
# service iptables stop . 4. Next we will check if the Port forwarding is correct and the 8888 port is unblocked and allows port forwarding. Please see the below link for port forwarding configuration and validation: https://community.hortonworks.com/articles/65914/how-to-add-ports-to-the-hdp-25-virtualbox-sandbox.html 5. Still if you face any issue then try restarting the HDP Sandbox and then try again. 6. If the issue still occurs then try re importing the HDP sandbox images and then try again. . Reference: For step by step Sandbox installation the following link is useful: https://hortonworks.com/hadoop-tutorial/learning-the-ropes-of-the-hortonworks-sandbox/
... View more
08-28-2017
12:22 PM
@pooja shrivastava The following error indicates the OS kernel level failure: failed to start crash recovery kernel arming So for further troubleshooting you might want to enable the kdump service to capture the cause of failure. systemctl status kdump.service . However it will be best to check the following : 1. Please check the Sandbox Image MD5sum result to be sure that the Sandbox image is not corrupt and downloaded correctly. https://hortonworks.com/downloads/#sandbox 2. Try reimporting the HDP sandbox image to your virtual box freshly. .
... View more
08-28-2017
11:22 AM
@ANSARI FAHEEM AHMED You will need to run the "ambari-server setup" command again and then you need to choose the "Customize user account for ambari-server daemon" prompt, to proceed as root. If you want to create a different user to run the Ambari Server, or to assign a previously created user, select y at the Customize user account for ambari-server daemon prompt, then provide a user name. https://docs.hortonworks.com/HDPDocuments/Ambari-2.5.1.0/bk_ambari-installation/content/set_up_the_ambari_server.html Example: # sudo ambari-server setup
.
Customize user account for ambari-server daemon [y/n] (n)? y
Enter user account for ambari-server daemon (root): ambari
. . If you are using views then you will need to also change the proxy user setting to the new user name: Server: https://docs.hortonworks.com/HDPDocuments/Ambari-2.5.1.0/bk_ambari-security/content/how_to_configure_ambari_server_for_non-root.html Agent: https://docs.hortonworks.com/HDPDocuments/Ambari-2.5.1.0/bk_ambari-security/content/how_to_configure_an_ambari_agent_for_non-root.html . Also if there are some directories that has the root:root permissions then you will need to change them accordingly. Example: # ls -l /var/run/ambari-server
sudo chown -R ambari root /var/run/ambari-server
# ls -l /var/run/ambari-agent
sudo chown -R ambari root /var/run/ambari-agent .
... View more
08-28-2017
09:19 AM
@Ashnee Sharma Is that file also available inside the "/etc/hive/conf" as well as inside "/etc/hive/conf/conf.server" ? Also as we see that it is a WARNING message so we can suppress it as well. Or else can you please share the complete stackTrace so that we can see the complete trace to find out the APIs involved in this WARN.
... View more
08-28-2017
08:09 AM
@Ashnee Sharma Please check if you have the "parquet-logging.properties" file present inside the "/etc/hive/conf/" directory or not? If not then please copy that file "parquet-logging.properties" from hive2 conf directory to "/etc/hive/conf/" directory and then try again. That file might be missing there due to : https://issues.apache.org/jira/browse/AMBARI-21265
... View more
08-28-2017
08:04 AM
@pooja shrivastava As mentioned in my previous comment that in order to run HDP sandbox minimum 8 GB of RAM is needed to be allocated to the Sandbox Instance. (Where as you have total 8 GB of RAM on your machine). NOTE from our doc: https://hortonworks.com/hadoop-tutorial/learning-the-ropes-of-the-hortonworks-sandbox/ - When we try to run the Sandbox with less than 8GB RAM then sometimes (due to other processes on the Windows machine might be consuming some of the RAM) the Sandbox services liek Network service / mount services are not initialized properly and causes a Hung scenario. So some times it might come up after a long time of reboot. and some times it might not even come up, Thats why the Minimum requirement for the HDP Sandbox to have at least 8GB RAM alloted to the Sandbox instance. Which means your Machine/Laptop should have around12-16 GB of RAM so that it can allocate 8GB RAM dedicatedly to the Sandbox.
... View more