Support Questions

Find answers, ask questions, and share your expertise
Announcements
Celebrating as our community reaches 100,000 members! Thank you!

PIG UDF ERROR

avatar
Explorer

I managed to create a UDF, successfully compiled it and packaged it in a customudf.jar file that is located here on a HDP 2.4 sandbox: /user/maria_dev/customudf.jar. I start my PIG script with

REGISTER customudf.jar

...and I created a entry the web interface for UDF as follows:

UDFs

Name: customudf

Path: /user/maria_dev/customudf.jar

Owner : maria_dev

Yet, when I run my PIG script the line customudf.xformation(f1) generates a non descript error:

ERROR org.apache.pig.tools.grunt.Grunt - ERROR 101: file 'customudf.jar' does not exist.

What am I missing?

1 ACCEPTED SOLUTION

avatar
Explorer

I finally got it to work by changing two things (not sure which of the two really helped or to what extent):

1) Changed the UDF name from customudf to customudf.jar

2) Change the REGISTER line to the following:

REGISTER 'hdfs:///user/maria_dev/customudf.jar

HTH

MT

View solution in original post

2 REPLIES 2

avatar
Explorer

I finally got it to work by changing two things (not sure which of the two really helped or to what extent):

1) Changed the UDF name from customudf to customudf.jar

2) Change the REGISTER line to the following:

REGISTER 'hdfs:///user/maria_dev/customudf.jar

HTH

MT

avatar
Contributor

this works for me just by adding hdfs:/// in the path without changing file to .jar

Thanks