Reply
Explorer
Posts: 6
Registered: ‎12-30-2014
Accepted Solution

Oozie shell action - sqoop cant find hive-site.xml from shell script

 

Sqoop called a script invoked by a shell action keeps defaulting to derby metastore even though mysql is configured in hive-site-xml.  I've tried a number of ways to specify the location of hive-site.xml but am missing the secret sauce.   Hive-site.xml is in the workflow directory on hdfs co-located with the script.

 

Thanks

Cloudera Employee
Posts: 85
Registered: ‎07-31-2013

Re: Oozie shell action - sqoop cant find hive-site.xml from shell script

There are 2 options here:

1. If using CM, put a Hive gateway on every NodeManager/TaskTracker in the cluster, if not using CM, put the hive-site.xml in /etc/hive/conf on every NodeManager/TaskTracker.
2. Add "export HIVE_CONF_DIR=`pwd`" to the top of your shell script and then sqoop shoudl check the local directory for the hive-site.xml.
Highlighted
Explorer
Posts: 6
Registered: ‎12-30-2014

Re: Oozie shell action - sqoop cant find hive-site.xml from shell script

 

I ended up going with option 2 which solved the immediate problem.  Thanks.

Announcements