Member since
08-20-2018
4
Posts
0
Kudos Received
0
Solutions
09-21-2018
02:53 PM
I have a database that contains about 830 tables. I tried doing a sqoop import-all-tables and it imported about 150 tables and failed on one table. 1. Is there a way for me to specify exclusions in the sqoop command? 2. How do I sqoop import the remaining 680 tables? When i use the same sqoop command, it fails as it specifies that some tables are already exisiting? Here is the sqoop command used: sqoop import-all-tables --connect "jdbc:sqlserver://192.169.108.64;database=axios; username=sqoop;password=hadoop" --warehouse-dir=/user/Axios -m 1
... View more
Labels:
- Labels:
-
Apache Hadoop
-
Apache Sqoop
09-18-2018
07:16 PM
When I sqooped the data into the hdfs, I am getting the following error: 18/09/18 19:14:01 ERROR tool.ImportAllTablesTool: Encountered IOException running import job: java.io.IOException: Generating splits for a textual index column allowed only in case of "-Dorg.apache.sqoop.splitte
r.allow_text_splitter=true" property passed as a parameter
How do I set this property to true in the following sqoop command?
sqoop import-all-tables --connect "jdbc:sqlserver://192.168.109.69;database=DRE; username=sqoop;password=hadoop" --warehouse-dir "/user/DRE"
... View more
09-18-2018
05:47 PM
I am having some issues with sqooping data from sql server database to Hive. I am using Hive in Ambari (HortonWorks) and when I sqooped the data from SQL server table to Hive, the data doesn't look pretty. Here is the sqoop command used: sqoop import --connect "jdbc:sqlserver://{server_name};database=DRE; username=sqoop;password=hadoop" --table NCentralAlerts --hive-import I have attached screenshots of the data from SQL Server and that of Hive. The data doesn't look pretty in Hive. Can anybody provide an insight as to what i am doing wrong here? Why is there a big difference between the data in sql server table and hive table? Thanks in advance.
... View more
Labels:
- Labels:
-
Apache Hive
-
Apache Sqoop