question Re: sqoop import from RDBMS to Hive, HBase in Archives of Support Questions (Read Only)

sqoop import from RDBMS to Hive, HBase

AndresUrrego — Tue, 16 May 2017 08:58:11 GMT

Hi everyone, I'm getting data from MySQL and a couple of csv from HDFS to my Hive and HBase services in hadoop. When i perform the script based in the information coming from the official sqoop tool https://sqoop.apache.org/docs/1.4.1-incubating/SqoopUserGuide.html i can't see anything about a parameter to specify the name of a DB in Hive or Hbase to complete the import, all my imports are in default db but i need to specify the name of DB.

Thanks so much for your help guys.

Re: sqoop import from RDBMS to Hive, HBase

egarelnabi — Tue, 16 May 2017 09:06:37 GMT

@Andres Urrego

Take a look at the below link for the different ways to Sqoop data into Hive.

https://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.4.3/bk_dataintegration/content/using_sqoop_to_move_data_into_hive.html

And below for HBase.

http://www.dummies.com/programming/big-data/hadoop/importing-data-into-hbase-with-sqoop/

Re: sqoop import from RDBMS to Hive, HBase

AndresUrrego — Tue, 16 May 2017 09:12:14 GMT

Hi buddy thanks for answer. I went there before came here lol but i couldnt find the answer. thanks

Re: sqoop import from RDBMS to Hive, HBase

egarelnabi — Tue, 16 May 2017 09:15:22 GMT

In the table at the bottom of the page for the first link:

--hive-table <table_name> Specifies the table name to use when importing data into Hive.

So your command would look like

sqoop import --connect jdbc:mysql://db.foo.com/corp --table EMPLOYEES --hive-import --hive-table MYTABLE

Re: sqoop import from RDBMS to Hive, HBase

AndresUrrego — Wed, 17 May 2017 01:44:20 GMT

Oh yeah buddy by i want to specify the DB in hive for the destination i mean something like --hive-database you get me , cause as default all impoted tables in Hive go to default DB . My requirement is set a different DB to put the data. thanks

Re: sqoop import from RDBMS to Hive, HBase

egarelnabi — Wed, 17 May 2017 02:05:37 GMT

I see. I misread your question. This request was addressed in the below jira:

https://issues.apache.org/jira/browse/SQOOP-912

The flag to specify the database is "--hive-database".

Your command would look like

sqoop import --connect jdbc:mysql://db.foo.com/corp --table EMPLOYEES --hive-import --hive-database MYDATABASE

OR

sqoop import --connect jdbc:mysql://db.foo.com/corp --table EMPLOYEES --hive-import --hive-table MYDATABASE.MYTABLE

Re: sqoop import from RDBMS to Hive, HBase

AndresUrrego — Thu, 18 May 2017 02:15:18 GMT

Great @Eyad Garelnabi thanks so much that was what I was looking for!!! i will close the question i appreciate.