question Re: Permanently added UDF doesn't work with ODBC connection in Archives of Support Questions (Read Only)

Permanently added UDF doesn't work with ODBC connection

kvasko — Sat, 27 Feb 2016 02:17:23 GMT

I'm using the Hortonworks Hive ODBC driver in my application.

I did: CREATE FUNCTION MyFunc as 'com.my.udf.class' USING JAR 'hdfs:///user/location/to/my.jar';

That worked. Ehen I close my HiveCLI session and open it back up, I can immediately run SELECT myfunc(data) FROM tbl; and it loads the class and functions correctly. However it doesn't work inside of HUE or in my ODBC connection within my app.

Re: Permanently added UDF doesn't work with ODBC connection

gates — Sat, 27 Feb 2016 02:38:27 GMT

Can you give details of how it doesn't work? Does it not find the function, or find the function and fail to execute it properly?

Re: Permanently added UDF doesn't work with ODBC connection

jdere — Sat, 27 Feb 2016 02:38:31 GMT

Both Hue /ODBC make use of HiveServer2. You might want to check the HiveServer2 logs to see if there are any errors when running these queries. Is the HDFS location of your JAR accessible to the "hive" user (or whatever user is running HiveServer2)?

Re: Permanently added UDF doesn't work with ODBC connection

kvasko — Sat, 27 Feb 2016 06:51:38 GMT

Sorry, yeah using HUE or through my ODBC application it says it can't find the function. I'm logging into the application in HUE with the same username I am with through the HiveCLI.

To be specific:

Error occurred executing hive query: Error while compiling statement: FAILED: SemanticException [Error 10011]: Line 1:155 Invalid function

Re: Permanently added UDF doesn't work with ODBC connection

kvasko — Sat, 27 Feb 2016 06:56:03 GMT

Logging in with the same username with Hue as I am with HiveCLI. Getting this error

Error occurred executing hive query: Error while compiling statement: FAILED: SemanticException [Error 10011]: Line 1:155 Invalid function

Re: Permanently added UDF doesn't work with ODBC connection

shishir_saxena4 — Tue, 01 Mar 2016 11:46:11 GMT

@Kevin Vasko @jdere Can you check if hive.server2.enable.doAs is set to True ?

Also, check this JIRA

https://issues.apache.org/jira/browse/HIVE-5160

Which version of Hive you are using ?

Re: Permanently added UDF doesn't work with ODBC connection

kvasko — Tue, 01 Mar 2016 11:55:24 GMT

I'll check this.

I am using HDP 2.3.2 (sandbox) which I believe comes with Hive 1.2.1 so that defect *shouldn't* be the problem.

Re: Permanently added UDF doesn't work with ODBC connection

jdere — Wed, 02 Mar 2016 02:30:08 GMT

What database was the function created under (permanent functions are qualified with a database name). If you did not specify the DB name when you created it, it would have automatically used the current DB. Do you see the fully qualified function name when you run SHOW FUNCTIONS?

Re: Permanently added UDF doesn't work with ODBC connection

kvasko — Fri, 04 Mar 2016 23:19:29 GMT

I don't even see hive.server2.enable.doAs. Would it be under the Hive configuration settings?

Re: Permanently added UDF doesn't work with ODBC connection

kvasko — Fri, 04 Mar 2016 23:21:29 GMT

It was not created with a specific database. If I run SHOW FUNCTION within the HiveCLI it shows up as default.<myfunction>. If I run SHOW FUNCTION in Hue, the function does NOT show up even though I'm using the "default" database. Is there a way I can make it not be under "default." and just "<function>"? Hue/App using ODBC has no problem using those functions (e.g. count()).

If I add the jar file in Hue (one the left sidebar) and the function/class information it all works.

Re: Permanently added UDF doesn't work with ODBC connection

shishir_saxena4 — Sat, 05 Mar 2016 06:44:13 GMT

@Kevin Vasko It is in Summary section. Run as End User instead of Hive user.

Re: Permanently added UDF doesn't work with ODBC connection

jdere — Sat, 05 Mar 2016 08:03:58 GMT

There was supposed to be a RELOAD FUNCTIONS command to refresh the function list if the function was created in a different environment from the current one like what you have done here. However it looks like this command was not working properly in HDP 2.3. It was fixed in HIVE-13043.

The workaround for HDP 2.3 would be to restart HiveServer2, or to create the function in Hue/ODBC rather than in a separate HiveCLI.

Re: Permanently added UDF doesn't work with ODBC connection

kvasko — Sat, 05 Mar 2016 10:45:08 GMT

Thanks, found it and it was already set to true and that still wasn't the issue.

I went into hue and ran the create function command (same command as I did in HiveCLI ) and the command worked and I was able to run the function within hue. this to me looks like some type of context issue where the persistent function that is added in the CLI doesn't work in the other contexts (ODBC and Hue). I have no idea how to solve that.

Re: Permanently added UDF doesn't work with ODBC connection

kvasko — Sat, 05 Mar 2016 10:46:23 GMT

I can't seem to reply to your last comment but that was exactly the problem.