Member since
01-29-2016
1
Post
0
Kudos Received
1
Solution
My Accepted Solutions
Title | Views | Posted |
---|---|---|
96233 | 01-28-2017 01:09 AM |
01-28-2017
01:09 AM
Typically in this type of problem,the approach for solution will be as follows: 1)Check the data node log where sqoop is running after executing your sqoop command.If you are not finding log after sqoop command execution you can redirect your log to a file as follows: # sqoop import --connect jdbc:mysql://localhost:3306/test --username root --password root --table t1 --hive-import --direct --hive-table t1 2>&1| tee -a log 2)Control the parallelism in your sqoop command as per your need.Better to use one reducer only. 3)Finally, you can check your hive config file and disable move task parallelism by setting "hive.mv.files.thread=0" Thanks, Surjya Sahoo
... View more