I have created a couple of UDF in Hive and when I was deploying the jar i didn't write that the functions are temporary, so when they were created they remained permanently which is what I want, now I want to use these functions to write a stored procedure in HPL/SQL but when I try to use the function that I created I get an error while it's not the case en I use the built in UDF of Hive. Can anyone tell me what I'm doing wrong ? ... View more

In a spark shell I did the following: spark-shell --jars /home/spark/esri/esri-geometry-api.jar,/home/spark/esri/spatial-sdk-hive-1.1.1-SNAPSHOT.jar val sqlContext = new org.apache.spark.sql.hive.HiveContext(sc); sqlContext.sql("""create function ST_Point as ‘com.esri.hadoop.hive.ST_Point‘ using jar ‘hdfs:///user/esri/spatial-sdk-hive-1.1.1-SNAPSHOT.jar’""") To my understanding the last command able me to create a UDF using ESRI jar, and I didn't use a temporary before function so does this UDF remains permanently. If so how can I list all my permanent function in a spark shell ? ... View more

When I do Select ST_Point(25,45) in PostgresQL I get the following : " 010100000000000000000039400000000000804640 " , whoever when I do the same thing in Hive I get this : (see the picture). If that was the only problem I wouldn't mind but when I do Select ST_Azimuth(ST_Point(25,45) , ST_Point(75,100)) I get this error : FAILED: SemanticException [Error 10014]: Line 1:7 Wrong arguments '100': No matching method for class ST_Azimuth with (binary, binary). ... View more

I would like to know how HaLoop replace the recursive call of a function. I really need to implement a function in a big data environment and that function is recursive and after some research i found out that recursive call does not work well with hadoop. Any help will be very apreciated. ... View more