Welcome to the Cloudera Community

Announcements
Celebrating as our community reaches 100,000 members! Thank you!

Who agreed with this topic

Configure oozie with sqoop

avatar
Rising Star

Hi all,

 

I encount a problem with our new cluster on Cloudera 5.7.1.

 

All installation is done, all service are up and running. 

HA is enable for namdenode.

 

We try some job, and it works fine as:

- sqoop import

- oozie workflows with hive job

 

But this one won't to work:

- oozie worflow with sqoop import.

 

My sqoop-metastore is runing on "node1", and oozie server on "node2".

The sqoop-metastore run with init.d from the installation.

 

If I'm on the node2, and do :

sudo -u oozie sqoop job --list

we can seel all stored job in the sqoop-metastore.

 

But we start an simple oozie worflo, which only start a sqoop import, it dosen't work. I get this error:

>>> Invoking Sqoop command line now >>>

3603 [uber-SubtaskRunner] WARN  org.apache.sqoop.tool.SqoopTool  - $SQOOP_CONF_DIR has not been set in the environment. Cannot check for additional configuration.
3624 [uber-SubtaskRunner] INFO  org.apache.sqoop.Sqoop  - Running Sqoop version: 1.4.6-cdh5.7.1
3873 [uber-SubtaskRunner] ERROR org.apache.sqoop.metastore.hsqldb.HsqldbJobStorage  - Cannot restore job: sqoop_job_name
3873 [uber-SubtaskRunner] ERROR org.apache.sqoop.metastore.hsqldb.HsqldbJobStorage  - (No such job)
3873 [uber-SubtaskRunner] ERROR org.apache.sqoop.tool.JobTool  - I/O error performing job operation: java.io.IOException: Cannot restore missing job sqoop_job_name

But I don't know hy, cause it works with the command line as oozie user...

 

I try top copy the sqoop-site.xml in the /etc/oozie/conf dir, but it doesn't work.

Only one value is set in the sqoop-site,xml

<property>
    <name>sqoop.metastore.client.autoconnect.url</name>
    <value>jdbc:hsqldb:hsql://host.domain.ltd:16000/sqoop</value>
    <description>Port that this metastore should listen on.</description>
 </property>

 Do I forget something?

Do I have something more to do to allow oozie start sqoop job ?

 

Thanks for you help !

 

Regards,

Who agreed with this topic