Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Loading hive data to oracle database using oracle loader for hadoop

Loading hive data to oracle database using oracle loader for hadoop

Explorer

Hi  ,

 

I have installed cloudera CDH4.7.1 A 3 cluster.I am trying to load data from hive to oracle database using Oracle loader for hadoop.I have integrated hadoop with Oracle Data Integrater ODI .For trigering OLH from ODI we have knowledge module File-Hive to Oracle (OLH-OSCH).

 

I am getting following error:

5/01/08 00:20:47 INFO loader.OraLoader: Oracle Loader for Hadoop Release 3.0.0 - Production
 
Copyright (c) 2011, 2014, Oracle and/or its affiliates. All rights reserved.
 
 
15/01/08 00:20:47 INFO loader.OraLoader: Built-Against: hadoop-2.2.0-cdh5.0.0-beta-2 hive-0.12.0-cdh5.0.0-beta-2 avro-1.7.3 jackson-1.8.8
15/01/08 00:20:48 INFO utils.OraLoaderConf: property "oracle.hadoop.loader.loaderMapFile" is deprecated; use "oracle.hadoop.loader.loaderMap.*" instead
15/01/08 00:21:03 INFO loader.OraLoader: oracle.hadoop.loader.loadByPartition is disabled because table: I_SAMPLE_TRG is not partitioned
15/01/08 00:21:03 INFO loader.OraLoader: oracle.hadoop.loader.enableSorting disabled, no sorting key provided
15/01/08 00:21:03 INFO loader.OraLoader: Reduce tasks set to 0 because of no partitioning or sorting. Loading will be done in the map phase.
15/01/08 00:21:04 INFO output.DBOutputFormat: Setting map tasks speculative execution to false for : oracle.hadoop.loader.lib.output.JDBCOutputFormat
15/01/08 00:21:08 WARN loader.OraLoader: Sampler error: the number of reduce tasks must be greater than one; the configured value is 0 . Job will continue without sampled information.
15/01/08 00:21:08 INFO loader.OraLoader: Sampling time=0D:0h:0m:0s:79ms (79 ms)
15/01/08 00:21:08 INFO loader.OraLoader: Submitting OraLoader job OraLoader
15/01/08 00:21:15 WARN mapred.JobClient: Use GenericOptionsParser for parsing the arguments. Applications should implement Tool for the same.
15/01/08 00:21:16 WARN conf.HiveConf: hive-site.xml not found on CLASSPATH
15/01/08 00:21:18 WARN conf.HiveConf: DEPRECATED: Configuration property hive.metastore.local no longer has any effect. Make sure to provide a valid value for hive.metastore.uris if you are connecting to a remote metastore.
15/01/08 00:21:18 INFO hive.metastore: Trying to connect to metastore with URI thrift://172.16.12.217:10000
15/01/08 00:21:18 INFO hive.metastore: Connected to metastore.
15/01/08 00:21:38 INFO mapred.JobClient: Cleaning up the staging area hdfs://n1.bias.com:8020/user/oracle/.staging/job_201501072220_0005
15/01/08 00:21:38 ERROR security.UserGroupInformation: PriviledgedActionException as:oracle (auth:SIMPLE) cause:java.io.IOException: org.apache.thrift.transport.TTransportException: java.net.SocketTimeoutException: Read timed out
java.io.IOException: org.apache.thrift.transport.TTransportException: java.net.SocketTimeoutException: Read timed out
at oracle.hadoop.loader.lib.input.HiveToAvroInputFormat.getSplits(HiveToAvroInputFormat.java:451)
at org.apache.hadoop.mapred.JobClient.writeNewSplits(JobClient.java:1107)
at org.apache.hadoop.mapred.JobClient.writeSplits(JobClient.java:1124)
at org.apache.hadoop.mapred.JobClient.access$600(JobClient.java:178)
at org.apache.hadoop.mapred.JobClient$2.run(JobClient.java:1023)
at org.apache.hadoop.mapred.JobClient$2.run(JobClient.java:976)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:415)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1438)
at org.apache.hadoop.mapred.JobClient.submitJobInternal(JobClient.java:976)
at org.apache.hadoop.mapreduce.Job.submit(Job.java:582)
at oracle.hadoop.loader.OraLoader.monitorAndPrintJob(OraLoader.java:652)
at oracle.hadoop.loader.OraLoader.run(OraLoader.java:580)
at oracle.hadoop.loader.OraLoader.run(OraLoader.java:412)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:84)
at oracle.hadoop.loader.OraLoader.main(OraLoader.java:940)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at org.apache.hadoop.util.RunJar.main(RunJar.java:208)
Caused by: org.apache.thrift.transport.TTransportException: java.net.SocketTimeoutException: Read timed out
at org.apache.thrift.transport.TIOStreamTransport.read(TIOStreamTransport.java:129)
at org.apache.thrift.transport.TTransport.readAll(TTransport.java:84)
at org.apache.thrift.protocol.TBinaryProtocol.readAll(TBinaryProtocol.java:378)
at org.apache.thrift.protocol.TBinaryProtocol.readI32(TBinaryProtocol.java:297)
at org.apache.thrift.protocol.TBinaryProtocol.readMessageBegin(TBinaryProtocol.java:204)
at org.apache.thrift.TServiceClient.receiveBase(TServiceClient.java:69)
at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Client.recv_get_table(ThriftHiveMetastore.java:879)
at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Client.get_table(ThriftHiveMetastore.java:865)
at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.getTable(HiveMetaStoreClient.java:788)
at oracle.hadoop.loader.lib.input.HiveToAvroInputFormat.getSplits(HiveToAvroInputFormat.java:259)
... 21 more
Caused by: java.net.SocketTimeoutException: Read timed out
at java.net.SocketInputStream.socketRead0(Native Method)
at java.net.SocketInputStream.read(SocketInputStream.java:152)
at java.net.SocketInputStream.read(SocketInputStream.java:122)
at java.io.BufferedInputStream.fill(BufferedInputStream.java:235)
at java.io.BufferedInputStream.read1(BufferedInputStream.java:275)
at java.io.BufferedInputStream.read(BufferedInputStream.java:334)
at org.apache.thrift.transport.TIOStreamTransport.read(TIOStreamTransport.java:127)
 
please reply as I have client demo 14 jan 2015.
Thanks&Regards
Vishal

 

Don't have an account?
Coming from Hortonworks? Activate your account here