question Re: Oozie shell action - sqoop cant find hive-site.xml from shell script in Archives of Support Questions (Read Only)

Oozie shell action - sqoop cant find hive-site.xml from shell script

stevesak — Fri, 16 Sep 2022 09:25:55 GMT

Sqoop called a script invoked by a shell action keeps defaulting to derby metastore even though mysql is configured in hive-site-xml. I've tried a number of ways to specify the location of hive-site.xml but am missing the secret sauce. Hive-site.xml is in the workflow directory on hdfs co-located with the script.

Thanks

Re: Oozie shell action - sqoop cant find hive-site.xml from shell script

cconner — Mon, 06 Apr 2015 13:05:41 GMT

There are 2 options here:

1. If using CM, put a Hive gateway on every NodeManager/TaskTracker in the cluster, if not using CM, put the hive-site.xml in /etc/hive/conf on every NodeManager/TaskTracker.
2. Add "export HIVE_CONF_DIR=`pwd`" to the top of your shell script and then sqoop shoudl check the local directory for the hive-site.xml.

Re: Oozie shell action - sqoop cant find hive-site.xml from shell script

stevesak — Mon, 06 Apr 2015 17:28:44 GMT

I ended up going with option 2 which solved the immediate problem. Thanks.