Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

NiFi snappy UnsatisfiedLinkError

Highlighted

NiFi snappy UnsatisfiedLinkError

New Contributor

We tried to use the CreateSequenceFile processor in NiFi using the Snappy compression coded, we ran to the following error:

java.lang.UnsatisfiedLinkError: org.apache.hadoop.util.NativeCodeLoader.buildSupportsSnappy()Z: java.lang.UnsatisfiedLinkError

After some research it seems that the problem is that java is missing the snappy native files

We moved the snappy native files (under the lib/hadoop/lib/native) from our hadoop server to the nifi server and tried everything we can find. we exported the LD_LIBRARY_PATH and the JAVA_LIBRARY_PATH the this directory, added the line java.arg.16=-Djava.library.path=/path/to/snappy/native/directory and even put the native files under the $JAVA_HOME/lib/native directory. nothing helped

We used lsof on out java (NiFi) process and found out that there is no reference the those files, but there is a reference to the /tmp/snappy-1.0.5-libsnappyjava.so, which might be relevant.

Don't have an account?
Coming from Hortonworks? Activate your account here