Support Questions

Find answers, ask questions, and share your expertise

Add libraries to impala direrctory on all nodes

New Contributor

I have a product that I need to register its jars APIs as udfs to use it in impala, and it needs me to copy manually jars to /var/lib/impala directory on all nodes of the cluster...

so I will have to login for each node to copy those files.

Don't we have automated way to deploy such libraries to the cluster. Our version is: (CDH 6.1.1, Parcels). 

1 REPLY 1

With Java UDFs, you generally put the jars in the shared filesystem (HDFS, S3, etc) and reference them in the "location" clause of "CREATE FUNCTION". Then Impala will copy the jars from the shared filesystem to a local cache.

 

This means that the jars should contain all of the dependencies for the UDFs.