Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Add libraries to impala direrctory on all nodes

Add libraries to impala direrctory on all nodes

New Contributor

I have a product that I need to register its jars APIs as udfs to use it in impala, and it needs me to copy manually jars to /var/lib/impala directory on all nodes of the cluster...

so I will have to login for each node to copy those files.

Don't we have automated way to deploy such libraries to the cluster. Our version is: (CDH 6.1.1, Parcels). 

1 REPLY 1
Highlighted

Re: Add libraries to impala direrctory on all nodes

Master Collaborator

With Java UDFs, you generally put the jars in the shared filesystem (HDFS, S3, etc) and reference them in the "location" clause of "CREATE FUNCTION". Then Impala will copy the jars from the shared filesystem to a local cache.

 

This means that the jars should contain all of the dependencies for the UDFs.

Don't have an account?
Coming from Hortonworks? Activate your account here