Support Questions

Find answers, ask questions, and share your expertise

Urgent !! SQOOP Hive Import Issue

New Contributor

I am firing the following statement

sqoop import --connect jdbc:oracle:thin:@xxx.xxxx.com:1519/xxx.xxxxxxx.com --username temp_hadoop --password temp_hadoop --table xxxx.TBPO_POL_BUDGETS --hive-import

The command copies data from Oracle table into HDFS. But It is not able to load the same into Hive. The process is stuck at below

18/09/19 14:10:39 INFO mapreduce.ImportJobBase: Transferred 204.5375 MB in 30.4028 seconds (6.7276 MB/sec)

18/09/19 14:10:39 INFO mapreduce.ImportJobBase: Retrieved 1120917 records.

18/09/19 14:10:39 INFO mapreduce.ImportJobBase: Publishing Hive/Hcat import job data to Listeners for table ORABUP0.TBPO_POL_BUDGETS

18/09/19 14:10:39 INFO manager.OracleManager: Time zone has been set to GMT

18/09/19 14:10:39 INFO manager.SqlManager: Executing SQL statement: SELECT t.* FROM ORABUP0.TBPO_POL_BUDGETS t WHERE 1=0

18/09/19 14:10:39 WARN hive.TableDefWriter: Column BUPIY_ID had to be cast to a less precise type in Hive

18/09/19 14:10:39 WARN hive.TableDefWriter: Column EFFECT_FROM_DAT had to be cast to a less precise type in Hive

18/09/19 14:10:39 WARN hive.TableDefWriter: Column EXP_TURNOVER_DOM_PCT had to be cast to a less precise type in Hive

18/09/19 14:10:39 WARN hive.TableDefWriter: Column ORSUS_ID had to be cast to a less precise type in Hive

18/09/19 14:10:39 WARN hive.TableDefWriter: Column LAST_UPDATE_DAT had to be cast to a less precise type in Hive

18/09/19 14:10:39 WARN hive.TableDefWriter: Column EFFECT_TO_DAT had to be cast to a less precise type in Hive

18/09/19 14:10:39 WARN hive.TableDefWriter: Column EXP_TURNOVER_DOM_AMT had to be cast to a less precise type in Hive

18/09/19 14:10:39 WARN hive.TableDefWriter: Column EXP_TURNOVER_EXPORT_AMT had to be cast to a less precise type in Hive

18/09/19 14:10:39 WARN hive.TableDefWriter: Column EXP_TURNOVER_DAT had to be cast to a less precise type in Hive

18/09/19 14:10:39 WARN hive.TableDefWriter: Column EXP_PREMIUM_EXPORT_AMT had to be cast to a less precise type in Hive

18/09/19 14:10:39 WARN hive.TableDefWriter: Column EXP_PREMIUM_DOM_AMT had to be cast to a less precise type in Hive

18/09/19 14:10:39 WARN hive.TableDefWriter: Column EXP_BROKER_FEE_AMT had to be cast to a less precise type in Hive

18/09/19 14:10:39 WARN hive.TableDefWriter: Column CHANGE_DAT had to be cast to a less precise type in Hive

18/09/19 14:10:39 WARN hive.TableDefWriter: Column D_EUR_EXCH_RATE had to be cast to a less precise type in Hive

18/09/19 14:10:39 WARN hive.TableDefWriter: Column D_GBP_EXCH_RATE had to be cast to a less precise type in Hive

18/09/19 14:10:39 WARN hive.TableDefWriter: Column EXP_ADD_TURNOVER_EXP_AMT had to be cast to a less precise type in Hive

18/09/19 14:10:39 WARN hive.TableDefWriter: Column EXP_ADD_PREMIUM_EXP_AMT had to be cast to a less precise type in Hive

18/09/19 14:10:39 WARN hive.TableDefWriter: Column EXP_ADD_TURNOVER_DOM_AMT had to be cast to a less precise type in Hive

18/09/19 14:10:39 WARN hive.TableDefWriter: Column EXP_ADD_PREMIUM_DOM_AMT had to be cast to a less precise type in Hive

18/09/19 14:10:39 INFO hive.HiveImport: Loading uploaded data into Hive

18/09/19 14:10:40 INFO hive.HiveImport: SLF4J: Class path contains multiple SLF4J bindings.

18/09/19 14:10:40 INFO hive.HiveImport: SLF4J: Found binding in [jar:file:/usr/hdp/3.0.0.0-1634/hive/lib/log4j-slf4j-impl-2.10.0.jar!/org/slf4j/impl/StaticLoggerBinder.class]

18/09/19 14:10:40 INFO hive.HiveImport: SLF4J: Found binding in [jar:file:/usr/hdp/3.0.0.0-1634/hadoop/lib/slf4j-log4j12-1.7.25.jar!/org/slf4j/impl/StaticLoggerBinder.class]

18/09/19 14:10:40 INFO hive.HiveImport: SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.

18/09/19 14:10:40 INFO hive.HiveImport: SLF4J: Actual binding is of type [org.apache.logging.slf4j.Log4jLoggerFactory]

18/09/19 14:10:42 INFO hive.HiveImport: Connecting to jdbc:hive2://lthdp001.atradiusnet.com:2181,lthdp002.atradiusnet.com:2181,lthdp003.atradiusnet.com:2181/default;serviceDiscoveryMode=zooKeeper;zooKeeperNamespace=hiveserver2

2 REPLIES 2

New Contributor

Did you find a solution for this issue?

New Contributor

use --map-column-hive for casting and why dont you use oracle direct connector....

Take a Tour of the Community
Don't have an account?
Your experience may be limited. Sign in to explore more.