Support Questions
Find answers, ask questions, and share your expertise

Hue sqoop job problems

Hue sqoop job problems

New Contributor

Hi,

I created a sqoop job in the JobDesign, but when I submit this job, I have an error like this:

FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.DDLTask. InvalidObjectException(message:There is no database named pedido)

But this database exist, I can do select in the database with Hive, and, I can run the same sooq scritp in the shell with success.

Aparently sqoop can't access the database when running by the oozie workflow.

 

 

Thanks.

 

4 REPLIES 4

Re: Hue sqoop job problems

New Contributor

I'm having the same problem. Any luck on finding a solution?

Re: Hue sqoop job problems

Expert Contributor
Yep, try adding your hive-site.xml to your Sqoop action as a "File". Sqoop needs to know which metastore to communicate with.

Re: Hue sqoop job problems

New Contributor

Thanks Abe!

 

For anyone else that may run into a similar issue, this ultimately resolved the issue after I created the job as part of a workflow (Workflows -> Editor -> New). Initially the sqoop job was created in job designer (Query Editors -> Job Designer -> New Action) . There is an option when created as a workflow to select the credentials needed for the job.

 

Is this something that can be configured in CM so that the hive-site.xml file does not have to be added to every sqoop job that is created?

Re: Hue sqoop job problems

You could try to add it to the Oozie sharelib but this is not super
recommended (as everyone will have access to it).

We will see if we can improve that on the Hue side in
https://issues.cloudera.org/browse/HUE-2180

Romain