Member since
01-16-2017
16
Posts
1
Kudos Received
0
Solutions
06-23-2017
01:31 PM
SELECT truckid, avg(mpg) avgmpg FROM truck_mileage GROUP BY trucked;
... View more
Labels:
06-23-2017
12:36 PM
@Benjamin Wiese Have you solved this problem? I ran into exactly the same thing on HDP Sandbox 2.6
... View more
06-01-2017
06:48 PM
@Jay SenSharma I finally got it to work, but it seems that the script or container have problems. Please help me sort it out. Per instructions I added script start-sandbox-hdp.sh to /etc/rc.local However it does not look like the script automatically runs upon instance start. I know that because there is no ssh access to port 2222. When I try to run this script manually it complains that docker container named sandbox-hdp is already running. When I remove this container using: #docker rm <container_name>, the script runs fine except for warning about ambari-agent. Then I ssh to root@localhost -p 2222 and restart the agent: ambari-agent restart Then everything works fine.
... View more
05-31-2017
02:22 AM
@Jay SenSharma No, i am unable to connect to either port 8888 or 8080 with localhost
... View more
05-31-2017
01:12 AM
@Jay SenSharma Turns out that there was something wrong with the docker. When i removed the container and reran: start_sandbox-hdp.sh, i was able to ssh into port 2222. Both ambari-server and ambari-agent commands are now working: [root@sandbox ~]# ambari-server status
Using python /usr/bin/python
Ambari-server status
Ambari Server running Found Ambari Server PID: 483 at: /var/run/ambari-server/ambari-server.pid [root@sandbox ~]# netstat -tnlpa | grep 8080
tcp 0 0 :::8080 :::* LISTEN 483/java [root@sandbox ~]# ambari-agent status Found ambari-agent PID: 4569
ambari-agent running. Agent PID at: /var/run/ambari-agent/ambari-agent.pid Agent out at: /var/log/ambari-agent/ambari-agent.out
Agent log at: /var/log/ambari-agent/ambari-agent.log [root@sandbox ~]# ps -ef | grep main.py root 4569 4561 34 01:01 ? 00:02:49 /usr/bin/python /usr/lib/python2.6/site-packages/ambari_agent/main.py start root 5568 5226 0 01:09 pts/0 00:00:00 grep main.py I still cannot connect to http://ElasticIP:8888
... View more
05-31-2017
12:50 AM
@Jay SenSharma when i try to ssh to port 2222 i get "connection refused" message from both Putty and Linux. What is missing?
... View more
05-30-2017
01:22 AM
@Jay SenSharma ambari-agent or ambari-server commands are not available in my instance of Amazon Linux. Are they somehow hidden in the docker?
... View more
05-29-2017
08:44 PM
@Jay SenSharma Well, it turns out that docker indeed got messed up running with lack of disk space. After rebuilding the instance the script worked. However when running start_sandbox-hdp.sh i got a message that ambari agent started with warning. Probably that's why I cannot login to ambari web interface. Hopefully it is a last hurdle. Could you please help? Unfortunately the logs mentioned in documentation: /var/log/ambari-agent do not exits on my instance.
... View more
05-29-2017
01:50 PM
@Jay SenSharma I think you were correct - there was not enough disk space on the instance. However when I resized the volume to 100gb, I got a different error: [ec2-user@ip-172-31-17-10 2.6]$ docker load -i HDP_2.6_docker_05_05_2017_15_01_40.tar.gz
devicemapper: Error running deviceCreate (createSnapDevice) dm_task_run failed
... View more
05-29-2017
01:45 AM
I did follow instructions very carefully, but received the following error: -rw-rw-r-- 1 ec2-user ec2-user 9617928269 May 29 01:23 HDP_2.6_docker_05_05_2017_15_01_40.tar.gz
-rw-rw-r-- 1 ec2-user ec2-user 2245 May 29 01:23 start_sandbox-hdp.sh
[root@ip-172-31-17-10 hdp]# docker load -i /home/ec2-user/hdp/2.6/HDP_2.6_docker_05_05_2017_15_01_40.tar.gz
b1b065555b8a: Loading layer [==================================================>] 202.2 MB/202.2 MB
bcedae1b8073: Loading layer [================================> ] 8.254 GB/12.68 GB
ApplyLayer exit status 1 stdout: stderr: unexpected EOF
[root@ip-172-31-17-10 hdp]# md5sum /home/ec2-user/hdp/2.6/HDP_2.6_docker_05_05_2017_15_01_40.tar.gz
886845a5e2fc28f773c59dace548e516 /home/ec2-user/hdp/2.6/HDP_2.6_docker_05_05_2017_15_01_40.tar.gz
... View more
Labels:
05-26-2017
05:54 PM
@pdarvasi Many thanks for helping me out. However the very first command in the instructions:
sudo yum update -y fails. I did look it up and it and most likely the problem with yum is related to configuration of Amazon Linux instance. Are there specific steps that i need to do in order to get yum working?
... View more
05-24-2017
07:10 PM
The very first command fails: sudo yum update -y Most references suggest that outbound interfaces are not properly set-up on the instance. How one should set them up in order to get this script to work?
... View more
05-24-2017
01:39 PM
Thank you, pdarvasi. I would like to finish with sandbox because my goal is to quickly complete all their tutorials. Please help me further: 1. Where do i download the image to? to my windows computer? to s3 bucket on AWS? 2. Where should i run the startup script and using what account? Sorry if my questions are really stupid, i just started to learn.
... View more
05-22-2017
02:51 PM
I am trying to deploy HDP 2.6 Sandbox image for VM on AWS. I used the same instructions as for HDP 2.5, but got inconsistent kernel version error,.
... View more
Labels: