Created 05-11-2016 05:37 PM
I managed to create a UDF, successfully compiled it and packaged it in a customudf.jar file that is located here on a HDP 2.4 sandbox: /user/maria_dev/customudf.jar. I start my PIG script with
REGISTER customudf.jar
...and I created a entry the web interface for UDF as follows:
Name: customudf
Path: /user/maria_dev/customudf.jar
Owner : maria_dev
Yet, when I run my PIG script the line customudf.xformation(f1) generates a non descript error:
ERROR org.apache.pig.tools.grunt.Grunt - ERROR 101: file 'customudf.jar' does not exist.
What am I missing?
Created 05-12-2016 12:48 PM
I finally got it to work by changing two things (not sure which of the two really helped or to what extent):
1) Changed the UDF name from customudf to customudf.jar
2) Change the REGISTER line to the following:
REGISTER 'hdfs:///user/maria_dev/customudf.jar
HTH
MT
Created 05-12-2016 12:48 PM
I finally got it to work by changing two things (not sure which of the two really helped or to what extent):
1) Changed the UDF name from customudf to customudf.jar
2) Change the REGISTER line to the following:
REGISTER 'hdfs:///user/maria_dev/customudf.jar
HTH
MT
Created 03-14-2017 10:38 PM
this works for me just by adding hdfs:/// in the path without changing file to .jar
Thanks