Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Oracle BigDataLite - 4.2.1 Sqoop Error

Highlighted

Oracle BigDataLite - 4.2.1 Sqoop Error

New Contributor

Hello experts,

 

I'm using Oracle Big Data Lite Virtual Machine with CDH 5.4.0 and I'm getting this error when I try to run a Sqoop process in ODI:

 

com.sunopsis.dwg.function.SnpsFunctionBaseException: ODI-30038: OS command returned 1. Error details are [15/09/28 11:14:11 INFO sqoop.Sqoop: Running Sqoop version: 1.4.5-cdh5.4.0

15/09/28 11:14:11 WARN tool.BaseSqoopTool: Setting your password on the command-line is insecure. Consider using -P instead.

15/09/28 11:14:11 INFO tool.BaseSqoopTool: Using Hive-specific delimiters for output. You can override

15/09/28 11:14:11 INFO tool.BaseSqoopTool: delimiters with --fields-terminated-by, etc.

15/09/28 11:14:11 INFO oracle.OraOopManagerFactory: Data Connector for Oracle and Hadoop is disabled.

15/09/28 11:14:11 INFO manager.SqlManager: Using default fetchSize of 1000

15/09/28 11:14:11 INFO tool.CodeGenTool: Beginning code generation

15/09/28 11:14:13 INFO manager.OracleManager: Time zone has been set to GMT

15/09/28 11:14:13 INFO manager.SqlManager: Executing SQL statement: SELECT * FROM ( SELECT  MOVIE_2.MOVIE_ID  MOVIE_ID , MOVIE_2.TITLE  TITLE , MOVIE_2.YEAR  YEAR , MOVIE_2.BUDGET  BUDGET , MOVIE_2.GROSS  GROSS , MOVIE_2.PLOT_SUMMARY  PLOT_SUMMARY , 'I'  OP , SYSDATE  TS    FROM  MOVIEDEMO.MOVIE MOVIE_2    )  ODI_SQOOP_QUERY where  (1 = 0)

15/09/28 11:14:13 INFO manager.SqlManager: Executing SQL statement: SELECT * FROM ( SELECT  MOVIE_2.MOVIE_ID  MOVIE_ID , MOVIE_2.TITLE  TITLE , MOVIE_2.YEAR  YEAR , MOVIE_2.BUDGET  BUDGET , MOVIE_2.GROSS  GROSS , MOVIE_2.PLOT_SUMMARY  PLOT_SUMMARY , 'I'  OP , SYSDATE  TS    FROM  MOVIEDEMO.MOVIE MOVIE_2    )  ODI_SQOOP_QUERY where  (1 = 0)

15/09/28 11:14:13 INFO orm.CompilationManager: HADOOP_MAPRED_HOME is /usr/lib/hadoop-mapreduce

Note: /tmp/sqoop-oracle/compile/3e0a96f9708b84b3a5dfc5e20feddd49/QueryResult.java uses or overrides a deprecated API.

Note: Recompile with -Xlint:deprecation for details.

15/09/28 11:14:16 INFO orm.CompilationManager: Writing jar file: /tmp/sqoop-oracle/compile/3e0a96f9708b84b3a5dfc5e20feddd49/QueryResult.jar

15/09/28 11:14:16 INFO mapreduce.ImportJobBase: Beginning query import.

15/09/28 11:14:16 INFO Configuration.deprecation: mapred.jar is deprecated. Instead, use mapreduce.job.jar

15/09/28 11:14:17 INFO Configuration.deprecation: mapred.map.tasks is deprecated. Instead, use mapreduce.job.maps

15/09/28 11:14:17 INFO client.RMProxy: Connecting to ResourceManager at /0.0.0.0:8032

15/09/28 11:14:21 INFO db.DBInputFormat: Using read commited transaction isolation

15/09/28 11:14:21 INFO mapreduce.JobSubmitter: number of splits:1

15/09/28 11:14:21 INFO mapreduce.JobSubmitter: Submitting tokens for job: job_1443451486321_0002

15/09/28 11:14:21 INFO impl.YarnClientImpl: Submitted application application_1443451486321_0002

15/09/28 11:14:21 INFO mapreduce.Job: The url to track the job: http://bigdatalite.localdomain:8088/proxy/application_1443451486321_0002/

15/09/28 11:14:21 INFO mapreduce.Job: Running job: job_1443451486321_0002

15/09/28 11:14:30 INFO mapreduce.Job: Job job_1443451486321_0002 running in uber mode : false

15/09/28 11:14:30 INFO mapreduce.Job:  map 0% reduce 0%

15/09/28 11:14:36 INFO mapreduce.Job: Task Id : attempt_1443451486321_0002_m_000000_0, Status : FAILED

Error: QueryResult : Unsupported major.minor version 52.0

15/09/28 11:14:42 INFO mapreduce.Job: Task Id : attempt_1443451486321_0002_m_000000_1, Status : FAILED

Error: QueryResult : Unsupported major.minor version 52.0

15/09/28 11:14:49 INFO mapreduce.Job: Task Id : attempt_1443451486321_0002_m_000000_2, Status : FAILED

Error: QueryResult : Unsupported major.minor version 52.0

15/09/28 11:14:57 INFO mapreduce.Job:  map 100% reduce 0%

15/09/28 11:14:59 INFO mapreduce.Job: Job job_1443451486321_0002 failed with state FAILED due to: Task failed task_1443451486321_0002_m_000000

Job failed as tasks failed. failedMaps:1 failedReduces:0

 

15/09/28 11:14:59 INFO mapreduce.Job: Counters: 11

                Job Counters

                                Failed map tasks=4

                                Launched map tasks=4

                                Other local map tasks=4

                                Total time spent by all maps in occupied slots (ms)=18510

                                Total time spent by all reduces in occupied slots (ms)=0

                                Total time spent by all map tasks (ms)=18510

                                Total vcore-seconds taken by all map tasks=18510

                                Total megabyte-seconds taken by all map tasks=4738560

                Map-Reduce Framework

                                CPU time spent (ms)=0

                                Physical memory (bytes) snapshot=0

                                Virtual memory (bytes) snapshot=0

15/09/28 11:14:59 WARN mapreduce.Counters: Group FileSystemCounters is deprecated. Use org.apache.hadoop.mapreduce.FileSystemCounter instead

15/09/28 11:14:59 INFO mapreduce.ImportJobBase: Transferred 0 bytes in 42.4113 seconds (0 bytes/sec)

15/09/28 11:14:59 INFO mapreduce.ImportJobBase: Retrieved 0 records.

15/09/28 11:14:59 ERROR tool.ImportTool: Error during import: Import job failed!

].

                at com.sunopsis.dwg.tools.OSCommand.actionExecute(OSCommand.java:460)

                at com.sunopsis.dwg.function.SnpsFunctionBaseRepositoryConnected.execute(SnpsFunctionBaseRepositoryConnected.java:216)

                at oracle.odi.runtime.agent.execution.SessionTask.execIntegratedFunction(SessionTask.java:892)

                at oracle.odi.runtime.agent.execution.SessionTask.executeOdiCommand(SessionTask.java:573)

                at oracle.odi.runtime.agent.execution.cmd.OdiCommandExecutor.execute(OdiCommandExecutor.java:32)

                at oracle.odi.runtime.agent.execution.cmd.OdiCommandExecutor.execute(OdiCommandExecutor.java:18)

                at oracle.odi.runtime.agent.execution.TaskExecutionHandler.handleTask(TaskExecutionHandler.java:52)

                at oracle.odi.runtime.agent.execution.SessionTask.processTask(SessionTask.java:203)

                at oracle.odi.runtime.agent.execution.SessionTask.doExecuteTask(SessionTask.java:114)

                at oracle.odi.runtime.agent.execution.AbstractSessionTask.execute(AbstractSessionTask.java:886)

                at oracle.odi.runtime.agent.execution.SessionExecutor$SerialTrain.runTasks(SessionExecutor.java:2198)

                at oracle.odi.runtime.agent.execution.SessionExecutor.executeSession(SessionExecutor.java:591)

                at oracle.odi.runtime.agent.processor.TaskExecutorAgentRequestProcessor$1.doAction(TaskExecutorAgentRequestProcessor.java:718)

                at oracle.odi.runtime.agent.processor.TaskExecutorAgentRequestProcessor$1.doAction(TaskExecutorAgentRequestProcessor.java:611)

                at oracle.odi.core.persistence.dwgobject.DwgObjectTemplate.execute(DwgObjectTemplate.java:203)

                at oracle.odi.runtime.agent.processor.TaskExecutorAgentRequestProcessor.doProcessStartAgentTask(TaskExecutorAgentRequestProcessor.java:800)

                at oracle.odi.runtime.agent.processor.impl.StartSessRequestProcessor.access$1400(StartSessRequestProcessor.java:74)

                at oracle.odi.runtime.agent.processor.impl.StartSessRequestProcessor$StartSessTask.doExecute(StartSessRequestProcessor.java:702)

                at oracle.odi.runtime.agent.processor.task.AgentTask.execute(AgentTask.java:180)

                at oracle.odi.runtime.agent.support.DefaultAgentTaskExecutor$2.run(DefaultAgentTaskExecutor.java:108)

                at java.lang.Thread.run(Thread.java:745)

 

Do you have any idea what this is?

 

Thank you in advance,

 

Pedro Santos

4 REPLIES 4

Re: Oracle BigDataLite - 4.2.1 Sqoop Error

Master Guru
> Error: QueryResult : Unsupported major.minor version 52.0

Your program (that invokes Sqoop) seems to run on JDK8 but the cluster runs
on JDK7. This causes the error.

Try switching your program to run with JDK7, or change the cluster to use
JDK8, and the issue should go away.

Re: Oracle BigDataLite - 4.2.1 Sqoop Error

New Contributor

Hello Harsh!

 

I found out that the program actually runs on JDK7 and the cluster on JDK8.

But when I changed cluster to run on JDK7, it gives me this error:

 

15/09/30 06:47:55 ERROR orm.CompilationManager: It seems as though you are running sqoop with a JRE.
15/09/30 06:47:55 ERROR orm.CompilationManager: Sqoop requires a JDK that can compile Java code.
15/09/30 06:47:55 ERROR orm.CompilationManager: Please install a JDK and set $JAVA_HOME to use it.
15/09/30 06:47:55 ERROR tool.ImportTool: Encountered IOException running import job: java.io.IOException: Could not start Java compiler.

 

I'm setting the cluster JAVA_HOME to usr/java/jdk1.7.0_67, so I'm not using JRE.

 

Do you have any idea?

 

Thank you,

 

Pedro Santos

Re: Oracle BigDataLite - 4.2.1 Sqoop Error

Master Guru
> I found out that the program actually runs on JDK7 and the cluster on
JDK8.

If that were so, then we shouldn't have the error - cause newer JDKs can
run older compiled byte-code (but not vice versa).

The compilation is actually not done by the cluster, but by the program
driver (such as the tool you're using, or a Sqoop CLI command program,
etc.). Is that environment/runtime also set to use a JDK vs. JRE?

Re: Oracle BigDataLite - 4.2.1 Sqoop Error

New Contributor

You might want to add the following line to /etc/default/bigtop-utils:
export JAVA_HOME=/usr/java/latest
Then restart the VM.

 

On Big Data Lite VM v4.2.1, by default "bigtop" picks JDK7.  The above change will force it to use JDK8 which should make your issue go away.

 

Cheers,

-dave