Created on 07-19-2020 03:58 PM - edited 07-19-2020 04:03 PM
We are using CDP 7.1.1 with Zeppelin 0.8.2 and Cloudera Manager
When running aggregation on parquet file select count(*) from ... we are getting
java.sql.SQLException: Error while compiling statement: FAILED: Execution Error, return code -101 from org.apache.hadoop.hive.ql.exec.tez.TezTask. /tmp/snappy-1.0.4.1-....-libsnappyjava.so: /tmp/snappy-1.0.4.1-...-libsnappyjava.so: failed to map segment from shared object: Operation not permitted
I tried to add -Dorg.xerial.snappy.tempdir="<other folder>" as HIVE_OPTS as well as org.xerial.snappy.tempdir=<other folder>in the hive-site.xml in Cloudera Manager however it doesn't seem to have an effect. Was wondering what would be a fix for this issue. I understand that issue is caused by limitations on the execution inside of /tmp folder but I am not sure where should we provide alternate location for Snappy libs
Thanks