Archives of Support Questions (Read Only)

This is an archived board for historical reference. Information and links may no longer be available or relevant
Announcements
This board is archived and read-only for historical reference. To ask a new question, please post a new topic on the appropriate active board.

HDP2.3-Pig & Hive Rev6 VM for Self Paced Learning

avatar

Hi:

I am subscribed to the Self Paced Learning by Hortonworks.

One of the modules there is HDP Developer: Apache Pig and Hive Rev 6. For that I downloaded the relevant VM from this link: https://s3.amazonaws.com/vm-us-east/data_analyst/HDP2.3-Pig-Hive-Rev6.zip

I could successfully start the VM using VMware Workstation 12 Player. But I can't see the Hadoop cluster starting. See the screenshot below:

9222-ss.png

Waited for a long time with no luck.

On the other hand, I could successfully use the Hortonworks Sandbox HDP v2.4 without any trouble.

Any help will be much appreciated.

Thanks and regards,

Anindya

1 ACCEPTED SOLUTION

avatar

For this Training VM, there is a hidden folder named .sys in the directory you are in above which contains a recreate_sandbox.sh script that can be used to recreate the Docker instance needed and get everything operational again. You can run it as shown below.

root@ubuntu:~# cd .sys
root@ubuntu:~/.sys# pwd
/root/.sys
root@ubuntu:~/.sys# ./recreate_sandbox.sh
creating sandbox....
docker stop/waiting
docker start/running, process 5857
          inet addr:172.17.0.1  Bcast:0.0.0.0  Mask:255.255.0.0
sandbox started at 172.17.0.2
root@ubuntu:~/.sys# date
Tue Sep 20 22:15:10 EDT 2016
root@ubuntu:~/.sys# date
Tue Sep 20 22:19:51 EDT 2016
root@ubuntu:~/.sys# ssh sandbox
The authenticity of host 'sandbox (172.17.0.2)' can't be established.
RSA key fingerprint is 2e:0c:53:b1:d4:06:7d:ab:bd:79:f9:17:08:f2:8a:4b.
Are you sure you want to continue connecting (yes/no)? yes
Warning: Permanently added 'sandbox,172.17.0.2' (RSA) to the list of known hosts.
Last login: Sun Dec 20 14:06:45 2015 from ip-172-17-0-1.ec2.internal
[root@sandbox ~]# hdfs dfs -ls /
Found 7 items
drwxrwxrwx   - yarn   hadoop          0 2015-10-15 09:45 /app-logs
drwxr-xr-x   - hdfs   hdfs            0 2015-10-15 09:45 /apps
drwxr-xr-x   - hdfs   hdfs            0 2015-10-15 09:44 /hdp
drwxr-xr-x   - mapred hdfs            0 2015-10-15 09:44 /mapred
drwxrwxrwx   - mapred hadoop          0 2015-10-15 09:44 /mr-history
drwxrwxrwx   - hdfs   hdfs            0 2015-10-15 09:46 /tmp
drwxr-xr-x   - hdfs   hdfs            0 2015-10-20 14:31 /user
[root@sandbox ~]#

NOTE: If it fails again in the future, instead of recreating everything, try the restart_sandbox.sh script instead.

View solution in original post

11 REPLIES 11

avatar
New Member

Hello all,

I would like to access the lab data for the HDP2.3 Pig and Hive course. I am trying to do the practicals for the lab but do not have the lab data. For ex: lab2.1,lab2.2...lab10.1 all these folders are needed for me to practice. Could someone please help me get those folders or data. Best possible way?Your reply is much appreciated.Thank you!

avatar