Once you recreate the hive table try to rerun your Pig script. Inside the pig script don't forget to add the argument -useHCatalog..... ... View more

Great to hear that you got things working @Prasanna G ... View more

@Prasanna G You'll have to first sudo su as (or just use sudo docker ps). See screen shot ... View more

@Adedayo Adekeye Ambari is the web ui that is used to administer, monitor, and provision out a hadoop cluster. It also has the concept of VIEWs which allow for browsing the Hadoop Distributed filesystem (HDFS) as well as querying data through Hive, writing pig scripts amongst other things (even extensible to do something custom). Regardless within Ambari (example link - http:// TO AZURE PUBLIC IP>:8080/#/main/views/FILES/1.0.0/AUTO_FILES_INSTANCE ) You can log in as raj_ops (with password as raj_ops) in order to get to the files view. Don't just click the link but you'll have to change the above link to match your Azure sandbox Public IP address. This also assumes you have port 8080 open in Azures Network Security Group setting. You may want to follow the instructions on how to reset the ambari admin password - https://hortonworks.com/hadoop-tutorial/learning-the-ropes-of-the-hortonworks-sandbox/#setup-ambari-admin-password Hope this helps ... View more

Hi @Prasanna G You'll have to first copy the file from the local filesystem into the docker container like below. First I created a directory on my docker container like so docker exec sandbox mkdir /dan/ (can then run a docker exec sandbox ls to see that your mkdir worked) then I copied the file to the directory I just created docker cp /home/drice/test2.txt sandbox:dan/test2.txt (where sandbox is the name of the docker container running HDP....you can get a list of containers by running docker ps) once the file is in the docker container you can then copy to hadoop docker exec sandbox hadoop fs -put /dan/test2.txt /test2.txt [root@sandbox drice]# docker exec sandbox hadoop fs -ls / Found 13 items drwxrwxrwx - yarn hadoop 0 2016-10-25 08:10 /app-logs drwxr-xr-x - hdfs hdfs 0 2016-10-25 07:54 /apps drwxr-xr-x - yarn hadoop 0 2016-10-25 07:48 /ats drwxr-xr-x - hdfs hdfs 0 2016-10-25 08:01 /demo drwxr-xr-x - hdfs hdfs 0 2016-10-25 07:48 /hdp drwxr-xr-x - mapred hdfs 0 2016-10-25 07:48 /mapred drwxrwxrwx - mapred hadoop 0 2016-10-25 07:48 /mr-history drwxr-xr-x - hdfs hdfs 0 2016-10-25 07:47 /ranger drwxrwxrwx - spark hadoop 0 2017-02-28 15:05 /spark-history drwxrwxrwx - spark hadoop 0 2016-10-25 08:14 /spark2-history -rw-r--r-- 1 root hdfs 15 2017-02-28 15:04 /test.txt drwxrwxrwx - hdfs hdfs 0 2016-10-25 08:11 /tmp drwxr-xr-x - hdfs hdfs 0 2016-10-25 08:11 /user NOTE: Another way to do this is to just use the ambari file browser view to copy files graphically. ... View more