mswamy
New Contributor

Sqoop import remaining tables into HDFS

by New Contributor in Support Questions
‎09-21-2018 02:53 PM
‎09-21-2018 02:53 PM
I have a database that contains about 830 tables. I tried doing a sqoop import-all-tables and it imported about 150 tables and failed on one table. 1. Is there a way for me to specify exclusions in the sqoop command? 2. How do I sqoop import the remaining 680 tables? When i use the same sqoop command, it fails as it specifies that some tables are already exisiting? Here is the sqoop command used: sqoop import-all-tables --connect "jdbc:sqlserver://192.169.108.64;database=axios; username=sqoop;password=hadoop" --warehouse-dir=/user/Axios -m 1 ... View more
Labels:

Re: Sqooping data from SQL Server table to Hive

by New Contributor in Support Questions
‎09-18-2018 07:16 PM
‎09-18-2018 07:16 PM
When I sqooped the data into the hdfs, I am getting the following error: 18/09/18 19:14:01 ERROR tool.ImportAllTablesTool: Encountered IOException running import job: java.io.IOException: Generating splits for a textual index column allowed only in case of "-Dorg.apache.sqoop.splitte r.allow_text_splitter=true" property passed as a parameter How do I set this property to true in the following sqoop command? sqoop import-all-tables --connect "jdbc:sqlserver://192.168.109.69;database=DRE; username=sqoop;password=hadoop" --warehouse-dir "/user/DRE" ... View more

Sqooping data from SQL Server table to Hive

by New Contributor in Support Questions
‎09-18-2018 05:47 PM
‎09-18-2018 05:47 PM
I am having some issues with sqooping data from sql server database to Hive. I am using Hive in Ambari (HortonWorks) and when I sqooped the data from SQL server table to Hive, the data doesn't look pretty. Here is the sqoop command used: sqoop import --connect "jdbc:sqlserver://{server_name};database=DRE; username=sqoop;password=hadoop" --table NCentralAlerts --hive-import I have attached screenshots of the data from SQL Server and that of Hive. The data doesn't look pretty in Hive. Can anybody provide an insight as to what i am doing wrong here? Why is there a big difference between the data in sql server table and hive table? Thanks in advance. ... View more
Labels:
Contact Me
Online
Offline
Last Visited
‎09-25-2018 01:22 PM
Public Statistics
Date Registered ‎08-20-2018 03:36 PM
Last Visited ‎09-25-2018 01:22 PM
Total Messages Posted 4
; ;