Created 02-19-2019 12:09 PM
Can we import data with sqoop into hdfs and hive?
I have try it with two different user (root and admin)
Below the command between root and admin
[Root]
sqoop import --connect jdbc:mysql://10.6.162.58/test_alpha --username pbd -P --table posts --hive-import --hive-database test_root --hive-table posts1 --hive-drop-import-delims --null-string '\\N' --null-non-string '\\N' --target-dir test_hive_root/2
[Admin]
sqoop import --connect jdbc:mysql://10.6.162.58/test_alpha --username pbd -P --table posts --hive-import --hive-database test_admin --hive-table posts1 --hive-drop-import-delims --null-string '\\N' --null-non-string '\\N' --target-dir test_hive_admin/2
It returns
Both ways successful import data to hive but both fail import to HDFS.
For root, it don't create directory that I've defined "test_hive_root/2"
For admin, it's just create directory "test_hive_admin/2" but only "success" file that have been created not the data (usually when I import it to HDFS, it will create "success" file and 4 more file)
How I can solve this problem?
Can sqoop import to HDFS and Hive?
Created 02-20-2019 07:35 PM
I have never used it to do both at the same time and https://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.6.5/bk_data-access/content/using_sqoop_to_move_... says "HDFS or Hive". Good luck and happy Hadooping!
Created 02-20-2019 09:51 PM
I think your --target-dir test_hive_admin/2 should be --target-dir /test_hive_admin/2 note the slash assuming you have a hdfs directory /test_hive_admin/2 with the correct permissions and ownership.
Please revert
Created 02-24-2019 02:04 AM
Any updates?