Support Questions
Find answers, ask questions, and share your expertise
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Loading hive data to oracle database using oracle loader for hadoop

Loading hive data to oracle database using oracle loader for hadoop


Hi  ,


I have installed cloudera CDH4.7.1 A 3 cluster.I am trying to load data from hive to oracle database using Oracle loader for hadoop.I have integrated hadoop with Oracle Data Integrater ODI .For trigering OLH from ODI we have knowledge module File-Hive to Oracle (OLH-OSCH).


I am getting following error:

5/01/08 00:20:47 INFO loader.OraLoader: Oracle Loader for Hadoop Release 3.0.0 - Production
Copyright (c) 2011, 2014, Oracle and/or its affiliates. All rights reserved.
15/01/08 00:20:47 INFO loader.OraLoader: Built-Against: hadoop-2.2.0-cdh5.0.0-beta-2 hive-0.12.0-cdh5.0.0-beta-2 avro-1.7.3 jackson-1.8.8
15/01/08 00:20:48 INFO utils.OraLoaderConf: property "oracle.hadoop.loader.loaderMapFile" is deprecated; use "oracle.hadoop.loader.loaderMap.*" instead
15/01/08 00:21:03 INFO loader.OraLoader: oracle.hadoop.loader.loadByPartition is disabled because table: I_SAMPLE_TRG is not partitioned
15/01/08 00:21:03 INFO loader.OraLoader: oracle.hadoop.loader.enableSorting disabled, no sorting key provided
15/01/08 00:21:03 INFO loader.OraLoader: Reduce tasks set to 0 because of no partitioning or sorting. Loading will be done in the map phase.
15/01/08 00:21:04 INFO output.DBOutputFormat: Setting map tasks speculative execution to false for : oracle.hadoop.loader.lib.output.JDBCOutputFormat
15/01/08 00:21:08 WARN loader.OraLoader: Sampler error: the number of reduce tasks must be greater than one; the configured value is 0 . Job will continue without sampled information.
15/01/08 00:21:08 INFO loader.OraLoader: Sampling time=0D:0h:0m:0s:79ms (79 ms)
15/01/08 00:21:08 INFO loader.OraLoader: Submitting OraLoader job OraLoader
15/01/08 00:21:15 WARN mapred.JobClient: Use GenericOptionsParser for parsing the arguments. Applications should implement Tool for the same.
15/01/08 00:21:16 WARN conf.HiveConf: hive-site.xml not found on CLASSPATH
15/01/08 00:21:18 WARN conf.HiveConf: DEPRECATED: Configuration property hive.metastore.local no longer has any effect. Make sure to provide a valid value for hive.metastore.uris if you are connecting to a remote metastore.
15/01/08 00:21:18 INFO hive.metastore: Trying to connect to metastore with URI thrift://
15/01/08 00:21:18 INFO hive.metastore: Connected to metastore.
15/01/08 00:21:38 INFO mapred.JobClient: Cleaning up the staging area hdfs://
15/01/08 00:21:38 ERROR security.UserGroupInformation: PriviledgedActionException as:oracle (auth:SIMPLE) org.apache.thrift.transport.TTransportException: Read timed out org.apache.thrift.transport.TTransportException: Read timed out
at oracle.hadoop.loader.lib.input.HiveToAvroInputFormat.getSplits(
at org.apache.hadoop.mapred.JobClient.writeNewSplits(
at org.apache.hadoop.mapred.JobClient.writeSplits(
at org.apache.hadoop.mapred.JobClient.access$600(
at org.apache.hadoop.mapred.JobClient$
at org.apache.hadoop.mapred.JobClient$
at Method)
at org.apache.hadoop.mapred.JobClient.submitJobInternal(
at org.apache.hadoop.mapreduce.Job.submit(
at oracle.hadoop.loader.OraLoader.monitorAndPrintJob(
at oracle.hadoop.loader.OraLoader.main(
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(
at sun.reflect.DelegatingMethodAccessorImpl.invoke(
at java.lang.reflect.Method.invoke(
at org.apache.hadoop.util.RunJar.main(
Caused by: org.apache.thrift.transport.TTransportException: Read timed out
at org.apache.thrift.transport.TTransport.readAll(
at org.apache.thrift.protocol.TBinaryProtocol.readAll(
at org.apache.thrift.protocol.TBinaryProtocol.readI32(
at org.apache.thrift.protocol.TBinaryProtocol.readMessageBegin(
at org.apache.thrift.TServiceClient.receiveBase(
at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Client.recv_get_table(
at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Client.get_table(
at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.getTable(
at oracle.hadoop.loader.lib.input.HiveToAvroInputFormat.getSplits(
... 21 more
Caused by: Read timed out
at Method)
please reply as I have client demo 14 jan 2015.


Don't have an account?
Coming from Hortonworks? Activate your account here