Created 09-19-2018 05:49 PM
I am firing the following statement
sqoop import --connect jdbc:oracle:thin:@xxx.xxxx.com:1519/xxx.xxxxxxx.com --username temp_hadoop --password temp_hadoop --table xxxx.TBPO_POL_BUDGETS --hive-import
The command copies data from Oracle table into HDFS. But It is not able to load the same into Hive. The process is stuck at below
18/09/19 14:10:39 INFO mapreduce.ImportJobBase: Transferred 204.5375 MB in 30.4028 seconds (6.7276 MB/sec)
18/09/19 14:10:39 INFO mapreduce.ImportJobBase: Retrieved 1120917 records.
18/09/19 14:10:39 INFO mapreduce.ImportJobBase: Publishing Hive/Hcat import job data to Listeners for table ORABUP0.TBPO_POL_BUDGETS
18/09/19 14:10:39 INFO manager.OracleManager: Time zone has been set to GMT
18/09/19 14:10:39 INFO manager.SqlManager: Executing SQL statement: SELECT t.* FROM ORABUP0.TBPO_POL_BUDGETS t WHERE 1=0
18/09/19 14:10:39 WARN hive.TableDefWriter: Column BUPIY_ID had to be cast to a less precise type in Hive
18/09/19 14:10:39 WARN hive.TableDefWriter: Column EFFECT_FROM_DAT had to be cast to a less precise type in Hive
18/09/19 14:10:39 WARN hive.TableDefWriter: Column EXP_TURNOVER_DOM_PCT had to be cast to a less precise type in Hive
18/09/19 14:10:39 WARN hive.TableDefWriter: Column ORSUS_ID had to be cast to a less precise type in Hive
18/09/19 14:10:39 WARN hive.TableDefWriter: Column LAST_UPDATE_DAT had to be cast to a less precise type in Hive
18/09/19 14:10:39 WARN hive.TableDefWriter: Column EFFECT_TO_DAT had to be cast to a less precise type in Hive
18/09/19 14:10:39 WARN hive.TableDefWriter: Column EXP_TURNOVER_DOM_AMT had to be cast to a less precise type in Hive
18/09/19 14:10:39 WARN hive.TableDefWriter: Column EXP_TURNOVER_EXPORT_AMT had to be cast to a less precise type in Hive
18/09/19 14:10:39 WARN hive.TableDefWriter: Column EXP_TURNOVER_DAT had to be cast to a less precise type in Hive
18/09/19 14:10:39 WARN hive.TableDefWriter: Column EXP_PREMIUM_EXPORT_AMT had to be cast to a less precise type in Hive
18/09/19 14:10:39 WARN hive.TableDefWriter: Column EXP_PREMIUM_DOM_AMT had to be cast to a less precise type in Hive
18/09/19 14:10:39 WARN hive.TableDefWriter: Column EXP_BROKER_FEE_AMT had to be cast to a less precise type in Hive
18/09/19 14:10:39 WARN hive.TableDefWriter: Column CHANGE_DAT had to be cast to a less precise type in Hive
18/09/19 14:10:39 WARN hive.TableDefWriter: Column D_EUR_EXCH_RATE had to be cast to a less precise type in Hive
18/09/19 14:10:39 WARN hive.TableDefWriter: Column D_GBP_EXCH_RATE had to be cast to a less precise type in Hive
18/09/19 14:10:39 WARN hive.TableDefWriter: Column EXP_ADD_TURNOVER_EXP_AMT had to be cast to a less precise type in Hive
18/09/19 14:10:39 WARN hive.TableDefWriter: Column EXP_ADD_PREMIUM_EXP_AMT had to be cast to a less precise type in Hive
18/09/19 14:10:39 WARN hive.TableDefWriter: Column EXP_ADD_TURNOVER_DOM_AMT had to be cast to a less precise type in Hive
18/09/19 14:10:39 WARN hive.TableDefWriter: Column EXP_ADD_PREMIUM_DOM_AMT had to be cast to a less precise type in Hive
18/09/19 14:10:39 INFO hive.HiveImport: Loading uploaded data into Hive
18/09/19 14:10:40 INFO hive.HiveImport: SLF4J: Class path contains multiple SLF4J bindings.
18/09/19 14:10:40 INFO hive.HiveImport: SLF4J: Found binding in [jar:file:/usr/hdp/3.0.0.0-1634/hive/lib/log4j-slf4j-impl-2.10.0.jar!/org/slf4j/impl/StaticLoggerBinder.class]
18/09/19 14:10:40 INFO hive.HiveImport: SLF4J: Found binding in [jar:file:/usr/hdp/3.0.0.0-1634/hadoop/lib/slf4j-log4j12-1.7.25.jar!/org/slf4j/impl/StaticLoggerBinder.class]
18/09/19 14:10:40 INFO hive.HiveImport: SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
18/09/19 14:10:40 INFO hive.HiveImport: SLF4J: Actual binding is of type [org.apache.logging.slf4j.Log4jLoggerFactory]
18/09/19 14:10:42 INFO hive.HiveImport: Connecting to jdbc:hive2://lthdp001.atradiusnet.com:2181,lthdp002.atradiusnet.com:2181,lthdp003.atradiusnet.com:2181/default;serviceDiscoveryMode=zooKeeper;zooKeeperNamespace=hiveserver2
Created 03-25-2019 01:53 PM
Did you find a solution for this issue?
Created 03-26-2019 11:20 PM
use --map-column-hive for casting and why dont you use oracle direct connector....