UDF + local file

[#1]

Hi,

I created UDF that reads local file, which is passed into UDF as a parameter. Im running everything in local mode.

cd pig-test;
touch input_file;
pig -x local
xx = my.udf('input_file')

When i run pig in mapreduce mode,, who/how will copy that input_file to appropriate nodes?

Thank you!

[#2]

@John Smith

You will be copying the file in hdfs and read the file from hdfs. Please see this tutorial

[#3]

@John Smith you will need to specify the full path to hdfs i.e. hdfs://namenode:8020/user/username as your hdfs path. For actual copy commands refer to the docs.

[#4]

@John Smith do you have enough information? Can you choose one of the answers to close out the thread?

[#5]

You can check out following tutorials

[#6]

<a href ="http://www.bisptrainings.com">Go through the tutorial</a>