01-30-2017 12:45 AM - edited 01-30-2017 06:21 AM
Is there is any way to read config file from C++ impala UDF ?
It will be better if we can read the property configured in conf.impala/core-site.xml or conf.impala/hdfs-site.xml from impala UDF.
01-30-2017 10:31 AM
01-30-2017 11:12 AM
I want to get the value of fs.defaultFS property from hdfs-site.xml , Impala already have it's value stored somewhere I guess. Is there is any way to get this property value?
01-31-2017 04:04 AM
How can I use this piece of code in my impala UDF? what are the libraries and headers I need to include to use this?
const char* default_fs = ExecEnv::GetInstance()->default_fs().c_str();
I found this in Impala-cdh5-trunk/be/src/util/hdfs-util.cc , Impala-cdh5-trunk/be/src/runtime/exec-env.cc
Or is there is any alternate method to get the value of default_fs ?
01-31-2017 05:25 PM
We don't support UDFs messing around with Impala's runtime data structures. We don't expose this to UDFs since UDFs aren't really meant to do things like I/O.