Archives of Support Questions (Read Only)

This is an archived board for historical reference. Information and links may no longer be available or relevant
Announcements
This board is archived and read-only for historical reference. To ask a new question, please post a new topic on the appropriate active board.

Like Example.jar is there any sample pig scripts available with HDP?

avatar
Rising Star

Like Example.jar is there any sample pig scripts available with HDP?

1 ACCEPTED SOLUTION

avatar
Super Collaborator

@Yukti Agrawal , the answer is no. But if you have HUE installed in your cluster, you should see some scripts. Check under this folder /usr/lib/hue/apps/oozie/examples.

Or do simply run locate command to search it.

I would recommend to create a simple script if you just want to test pig. Store a sample csv in HDFS and load that file in Pig:

A = LOAD '/the/path/in/HDFS/sample.csv' USING PigStorage(',') AS (driverId:int, truckId:int, driverName:chararray);

some_columns = FOREACH A GENERATE driverId,driverName;

STORE some_columns into 'output/some_columns' using PigStorage(',');

View solution in original post

3 REPLIES 3

avatar
Super Collaborator

@Yukti Agrawal , the answer is no. But if you have HUE installed in your cluster, you should see some scripts. Check under this folder /usr/lib/hue/apps/oozie/examples.

Or do simply run locate command to search it.

I would recommend to create a simple script if you just want to test pig. Store a sample csv in HDFS and load that file in Pig:

A = LOAD '/the/path/in/HDFS/sample.csv' USING PigStorage(',') AS (driverId:int, truckId:int, driverName:chararray);

some_columns = FOREACH A GENERATE driverId,driverName;

STORE some_columns into 'output/some_columns' using PigStorage(',');

avatar
Rising Star

Unfortunately we dont have HUE in our cluster. Also locate command is not working in my client's env. I will try this script, hoping it will help.

avatar
Master Guru

HWX has pig tuturial with come with data and script. I recommend you try this

http://hortonworks.com/hadoop-tutorial/how-to-process-data-with-apache-pig/