Reply
Explorer
Posts: 12
Registered: ‎06-15-2018

Execute Sqoop job in hue oozie workflow to import hive table - Sqoop 2

[ Edited ]

Hi All,

 

I was going through cloudera documentation for executing sqoop job in hue oozie workflow to do hive import, came across below blog.

 

https://www.cloudera.com/documentation/enterprise/5-6-x/topics/cdh_ig_sqoop_vs_sqoop2.html 

 

Did any of you tried the two step approached for Sqoop 2, if so pls provide some detailed steps? I'm new to Cloudera Hadoop. Thanks!

 

Data transfer from RDBMS to Hive or HBase (from above blog)

Sqoop 1 - Supported.

Sqoop 2 - Not supported.

Workaround: Follow this two-step approach.
  1. Import data from RDBMS into HDFS
  2. Load data into Hive or HBase manually using appropriate tools and commands such as the LOAD DATA statement in Hive
Cloudera Employee
Posts: 428
Registered: ‎03-23-2015

Re: Execute Sqoop job in hue oozie workflow to import hive table - Sqoop 2

Sqoop2 has been deprecated and removed in CDH6, suggestion is to use Sqoop1 instead.

Sqoop1 can import data into Hive directly with --hive-import option, details can be found here:

http://sqoop.apache.org/docs/1.4.6/SqoopUserGuide.html#_importing_data_into_hive_2

Hope helps.
Highlighted
New Contributor
Posts: 1
Registered: ‎09-11-2018

Re: Execute Sqoop job in hue oozie workflow to import hive table - Sqoop 2

I want to have solution on this.
I have to import data from Netsuite to hive table.
Have to do it incrementally preferably with a sqoop job
Have to do it with oozie or hue/oozie?
How sqoop job can be referred in oozie.
Any help please.
Announcements
New solutions