Support Questions
Find answers, ask questions, and share your expertise

Issue with Snappy while using hive Interpreter from Zeppelin

Issue with Snappy while using hive Interpreter from Zeppelin

We are using CDP 7.1.1 with Zeppelin 0.8.2 and Cloudera Manager

When running aggregation on parquet file select count(*) from ... we are getting 

 

 

java.sql.SQLException: Error while compiling statement: FAILED: Execution Error, return code -101 from org.apache.hadoop.hive.ql.exec.tez.TezTask. /tmp/snappy-1.0.4.1-....-libsnappyjava.so: /tmp/snappy-1.0.4.1-...-libsnappyjava.so: failed to map segment from shared object: Operation not permitted

 

 

I tried to add -Dorg.xerial.snappy.tempdir="<other folder>" as HIVE_OPTS as well as org.xerial.snappy.tempdir=<other folder>in the hive-site.xml in Cloudera Manager however it doesn't seem to have an effect. Was wondering what would be a fix for this issue. I understand that issue is caused by limitations on the execution inside of /tmp folder but I am not sure where should we provide alternate location for Snappy libs

Thanks

 

Don't have an account?