Support Questions

Find answers, ask questions, and share your expertise

HDP2.3-Pig & Hive Rev6 VM for Self Paced Learning

avatar
Contributor

Hi:

I am subscribed to the Self Paced Learning by Hortonworks.

One of the modules there is HDP Developer: Apache Pig and Hive Rev 6. For that I downloaded the relevant VM from this link: https://s3.amazonaws.com/vm-us-east/data_analyst/HDP2.3-Pig-Hive-Rev6.zip

I could successfully start the VM using VMware Workstation 12 Player. But I can't see the Hadoop cluster starting. See the screenshot below:

9222-ss.png

Waited for a long time with no luck.

On the other hand, I could successfully use the Hortonworks Sandbox HDP v2.4 without any trouble.

Any help will be much appreciated.

Thanks and regards,

Anindya

1 ACCEPTED SOLUTION

avatar

For this Training VM, there is a hidden folder named .sys in the directory you are in above which contains a recreate_sandbox.sh script that can be used to recreate the Docker instance needed and get everything operational again. You can run it as shown below.

root@ubuntu:~# cd .sys
root@ubuntu:~/.sys# pwd
/root/.sys
root@ubuntu:~/.sys# ./recreate_sandbox.sh
creating sandbox....
docker stop/waiting
docker start/running, process 5857
          inet addr:172.17.0.1  Bcast:0.0.0.0  Mask:255.255.0.0
sandbox started at 172.17.0.2
root@ubuntu:~/.sys# date
Tue Sep 20 22:15:10 EDT 2016
root@ubuntu:~/.sys# date
Tue Sep 20 22:19:51 EDT 2016
root@ubuntu:~/.sys# ssh sandbox
The authenticity of host 'sandbox (172.17.0.2)' can't be established.
RSA key fingerprint is 2e:0c:53:b1:d4:06:7d:ab:bd:79:f9:17:08:f2:8a:4b.
Are you sure you want to continue connecting (yes/no)? yes
Warning: Permanently added 'sandbox,172.17.0.2' (RSA) to the list of known hosts.
Last login: Sun Dec 20 14:06:45 2015 from ip-172-17-0-1.ec2.internal
[root@sandbox ~]# hdfs dfs -ls /
Found 7 items
drwxrwxrwx   - yarn   hadoop          0 2015-10-15 09:45 /app-logs
drwxr-xr-x   - hdfs   hdfs            0 2015-10-15 09:45 /apps
drwxr-xr-x   - hdfs   hdfs            0 2015-10-15 09:44 /hdp
drwxr-xr-x   - mapred hdfs            0 2015-10-15 09:44 /mapred
drwxrwxrwx   - mapred hadoop          0 2015-10-15 09:44 /mr-history
drwxrwxrwx   - hdfs   hdfs            0 2015-10-15 09:46 /tmp
drwxr-xr-x   - hdfs   hdfs            0 2015-10-20 14:31 /user
[root@sandbox ~]#

NOTE: If it fails again in the future, instead of recreating everything, try the restart_sandbox.sh script instead.

View solution in original post

11 REPLIES 11

avatar
New Contributor

Hello all,

I would like to access the lab data for the HDP2.3 Pig and Hive course. I am trying to do the practicals for the lab but do not have the lab data. For ex: lab2.1,lab2.2...lab10.1 all these folders are needed for me to practice. Could someone please help me get those folders or data. Best possible way?Your reply is much appreciated.Thank you!

avatar