Created on 02-16-2016 01:49 AM - edited 09-16-2022 03:04 AM
Hi,
I have recently encountered an error whilst trying to execute a simple sqoop action through oozie. When running I get the error "sqoop-site.xml (permission denied)".
I have searched the internet for the same error but have found nothing.
The sqoop command works when run independently from oozie.
I am running the job with all the permissions I should need for the oozie job.
Here is my code (with generic names)
Property file
nameNode=hdfs://server.domain.local:8020 jobTracker=server.domain.local:8032 applicationDir=${nameNode}/user/username/sqoop/ oozie.wf.application.path=${applicationDir} oozie.use.system.libpath=true
workflow.xml file
-<workflow-app name="sqoop-workflow" xmlns="uri:oozie:workflow:0.4"> -<parameters> -<property> <name>jobTracker</name> </property> -<property> <name>nameNode</name> </property> -<property> <name>applicationDir</name> </property> </parameters> <start to="sqoop-action"/> -<action name="sqoop-action"> -<sqoop xmlns="uri:oozie:sqoop-action:0.2"> <job-tracker>${jobTracker}</job-tracker> <name-node>${nameNode}</name-node> <command>import --m 1 --connect "jdbc:sqlserver://ServerName:1433;database=Database;username=Username;password=Password" --table MyTable--target-dir /user/hive/warehouse/sqoop/MyTable-- --schema dbo</command> </sqoop> <ok to="success"/> <error to="fail"/> </action> -<kill name="fail"> <message>The Identity Map-Reduce job failed!</message> </kill> <end name="success"/> </workflow-app>
Possible causes I can think of is the sqoop element is running with different permissions or running on an instance without sqoop installed.
I need help in both diagnosing the problem and advise on how to overcome it.
Thanks
Created 02-24-2016 02:14 AM
Created on 02-18-2016 02:12 AM - edited 02-18-2016 02:13 AM
Update to this:
I've seen that the sqoop-site.xml (permission denied) failure is actually complaining that it cant find the file with a FileNotFoundException
Does anyone know why this would be the case?
Created 02-24-2016 02:14 AM
Created 02-24-2016 05:11 AM
Thank you for sharing how you fixed it dom99. Feel free to mark your last comment as the solution so others in a similar situation can find it easier.