Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

could not run my first sqoop2 job

could not run my first sqoop2 job

Contributor

Hello all

 

I tried to configure and run sqoo2 job to import data from Oracle2HDFS.

My configuration details in following lines

sqoop:000> show link
+----+----------+--------------+------------------------+---------+
| Id |   Name   | Connector Id |     Connector Name     | Enabled |
+----+----------+--------------+------------------------+---------+
| 1  | TPLink   | 1            | generic-jdbc-connector | true    |
| 2  | HDFSLink | 2            | kite-connector         | true    |
+----+----------+--------------+------------------------+---------+
sqoop:000> show job --all
1 job(s) to show:
Job with id 1 and name TPJob (Enabled: true, Created by cloudera-scm at 10/6/15 2:48 PM, Updated by cloudera-scm at 10/6/15 2:48 PM)
Using link id 1 and Connector id 1
  From database configuration
    Schema name: #######
    Table name: #########
    Table SQL statement:
    Table column names:
    Partition column name: TIME_STAMP
    Null value allowed for the partition column:
    Boundary query:
  Throttling resources
    Extractors: 2
    Loaders: 2
  To Kite Dataset Configuration
    Dataset URI: dataset:hdfs:/tmp/TPSqoop2
    File format: PARQUET
sqoop:000> show link --all
2 link(s) to show:
link with id 1 and name TPLink (Enabled: true, Created by cloudera-scm at 10/6/15 1:49 PM, Updated by cloudera-scm at 10/6/15 1:49 PM)
Using Connector generic-jdbc-connector with id 1
  Link configuration
    JDBC Driver Class: oracle.jdbc.driver.OracleDriver
    JDBC Connection String: jdbc:oracle:thin:@x.y.z.d:1521:<serviceName>
    Username: #########
    Password:
    JDBC Connection Properties:
link with id 2 and name HDFSLink (Enabled: true, Created by cloudera-scm at 10/6/15 2:40 PM, Updated by cloudera-scm at 10/6/15 2:40 PM)
Using Connector kite-connector with id 2
  Link Configuration
    HDFS host and port: <hdfshost>:50070
sqoop:000>

When I try to run this job I got following error and could not find any recommendation about it maybe I am searching with wrong parameters

 

sqoop:000> start job -j 1
Exception has occurred during processing command
Exception: java.lang.RuntimeException Message: java.lang.ClassNotFoundException: org.kitesdk.data.DatasetIOException
Stack trace:
         at  org.apache.sqoop.utils.ClassUtils (ClassUtils.java:65)
         at  org.apache.sqoop.utils.ClassUtils (ClassUtils.java:84)
         at  org.apache.sqoop.json.ThrowableBean (ThrowableBean.java:123)
         at  org.apache.sqoop.client.request.ResourceRequest (ResourceRequest.java:127)
         at  org.apache.sqoop.client.request.ResourceRequest (ResourceRequest.java:179)
         at  org.apache.sqoop.client.request.JobResourceRequest (JobResourceRequest.java:112)
         at  org.apache.sqoop.client.request.SqoopResourceRequests (SqoopResourceRequests.java:154)
         at  org.apache.sqoop.client.SqoopClient (SqoopClient.java:460)
         at  org.apache.sqoop.shell.StartJobFunction (StartJobFunction.java:80)
         at  org.apache.sqoop.shell.SqoopFunction (SqoopFunction.java:51)
         at  org.apache.sqoop.shell.SqoopCommand (SqoopCommand.java:127)
         at  org.apache.sqoop.shell.SqoopCommand (SqoopCommand.java:103)
         at  org.codehaus.groovy.tools.shell.Command$execute (null:-1)
         at  org.codehaus.groovy.runtime.callsite.CallSiteArray (CallSiteArray.java:42)
         at  org.codehaus.groovy.tools.shell.Command$execute (null:-1)
         at  org.codehaus.groovy.tools.shell.Shell (Shell.groovy:101)
         at  org.codehaus.groovy.tools.shell.Groovysh (Groovysh.groovy:-1)
         at  sun.reflect.NativeMethodAccessorImpl (NativeMethodAccessorImpl.java:-2)
         at  sun.reflect.NativeMethodAccessorImpl (NativeMethodAccessorImpl.java:62)
         at  sun.reflect.DelegatingMethodAccessorImpl (DelegatingMethodAccessorImpl.java:43)
         at  java.lang.reflect.Method (Method.java:497)
         at  org.codehaus.groovy.reflection.CachedMethod (CachedMethod.java:90)
         at  groovy.lang.MetaMethod (MetaMethod.java:233)
         at  groovy.lang.MetaClassImpl (MetaClassImpl.java:1054)
         at  org.codehaus.groovy.runtime.ScriptBytecodeAdapter (ScriptBytecodeAdapter.java:128)
         at  org.codehaus.groovy.tools.shell.Groovysh (Groovysh.groovy:173)
         at  sun.reflect.NativeMethodAccessorImpl (NativeMethodAccessorImpl.java:-2)
         at  sun.reflect.NativeMethodAccessorImpl (NativeMethodAccessorImpl.java:62)
         at  sun.reflect.DelegatingMethodAccessorImpl (DelegatingMethodAccessorImpl.java:43)
         at  java.lang.reflect.Method (Method.java:497)
         at  org.codehaus.groovy.runtime.callsite.PogoMetaMethodSite$PogoCachedMethodSiteNoUnwrapNoCoerce (PogoMetaMethodSite.java:267)
         at  org.codehaus.groovy.runtime.callsite.PogoMetaMethodSite (PogoMetaMethodSite.java:52)
         at  org.codehaus.groovy.runtime.callsite.AbstractCallSite (AbstractCallSite.java:141)
         at  org.codehaus.groovy.tools.shell.Groovysh (Groovysh.groovy:121)
         at  org.codehaus.groovy.tools.shell.Shell (Shell.groovy:114)
         at  org.codehaus.groovy.tools.shell.Shell$leftShift$0 (null:-1)
         at  org.codehaus.groovy.tools.shell.ShellRunner (ShellRunner.groovy:88)
         at  org.codehaus.groovy.tools.shell.InteractiveShellRunner (InteractiveShellRunner.groovy:-1)
         at  sun.reflect.NativeMethodAccessorImpl (NativeMethodAccessorImpl.java:-2)
         at  sun.reflect.NativeMethodAccessorImpl (NativeMethodAccessorImpl.java:62)
         at  sun.reflect.DelegatingMethodAccessorImpl (DelegatingMethodAccessorImpl.java:43)
         at  java.lang.reflect.Method (Method.java:497)
         at  org.codehaus.groovy.reflection.CachedMethod (CachedMethod.java:90)
         at  groovy.lang.MetaMethod (MetaMethod.java:233)
         at  groovy.lang.MetaClassImpl (MetaClassImpl.java:1054)
         at  org.codehaus.groovy.runtime.ScriptBytecodeAdapter (ScriptBytecodeAdapter.java:128)
         at  org.codehaus.groovy.runtime.ScriptBytecodeAdapter (ScriptBytecodeAdapter.java:148)
         at  org.codehaus.groovy.tools.shell.InteractiveShellRunner (InteractiveShellRunner.groovy:100)
         at  sun.reflect.NativeMethodAccessorImpl (NativeMethodAccessorImpl.java:-2)
         at  sun.reflect.NativeMethodAccessorImpl (NativeMethodAccessorImpl.java:62)
         at  sun.reflect.DelegatingMethodAccessorImpl (DelegatingMethodAccessorImpl.java:43)
         at  java.lang.reflect.Method (Method.java:497)
         at  org.codehaus.groovy.runtime.callsite.PogoMetaMethodSite$PogoCachedMethodSiteNoUnwrapNoCoerce (PogoMetaMethodSite.java:267)
         at  org.codehaus.groovy.runtime.callsite.PogoMetaMethodSite (PogoMetaMethodSite.java:52)
         at  org.codehaus.groovy.runtime.callsite.AbstractCallSite (AbstractCallSite.java:137)
         at  org.codehaus.groovy.tools.shell.ShellRunner (ShellRunner.groovy:57)
         at  org.codehaus.groovy.tools.shell.InteractiveShellRunner (InteractiveShellRunner.groovy:-1)
         at  sun.reflect.NativeMethodAccessorImpl (NativeMethodAccessorImpl.java:-2)
         at  sun.reflect.NativeMethodAccessorImpl (NativeMethodAccessorImpl.java:62)
         at  sun.reflect.DelegatingMethodAccessorImpl (DelegatingMethodAccessorImpl.java:43)
         at  java.lang.reflect.Method (Method.java:497)
         at  org.codehaus.groovy.reflection.CachedMethod (CachedMethod.java:90)
         at  groovy.lang.MetaMethod (MetaMethod.java:233)
         at  groovy.lang.MetaClassImpl (MetaClassImpl.java:1054)
         at  org.codehaus.groovy.runtime.ScriptBytecodeAdapter (ScriptBytecodeAdapter.java:128)
         at  org.codehaus.groovy.runtime.ScriptBytecodeAdapter (ScriptBytecodeAdapter.java:148)
         at  org.codehaus.groovy.tools.shell.InteractiveShellRunner (InteractiveShellRunner.groovy:66)
         at  java_lang_Runnable$run (null:-1)
         at  org.codehaus.groovy.runtime.callsite.CallSiteArray (CallSiteArray.java:42)
         at  org.codehaus.groovy.runtime.callsite.AbstractCallSite (AbstractCallSite.java:108)
         at  org.codehaus.groovy.runtime.callsite.AbstractCallSite (AbstractCallSite.java:112)
         at  org.codehaus.groovy.tools.shell.Groovysh (Groovysh.groovy:463)
         at  org.codehaus.groovy.tools.shell.Groovysh (Groovysh.groovy:402)
         at  org.apache.sqoop.shell.SqoopShell (SqoopShell.java:128)
Caused by: Exception: java.lang.ClassNotFoundException Message: org.kitesdk.data.DatasetIOException
Stack trace:
         at  java.net.URLClassLoader (URLClassLoader.java:381)
         at  java.lang.ClassLoader (ClassLoader.java:424)
         at  sun.misc.Launcher$AppClassLoader (Launcher.java:331)
         at  java.lang.ClassLoader (ClassLoader.java:357)
         at  org.apache.sqoop.utils.ClassUtils (ClassUtils.java:61)
         at  org.apache.sqoop.utils.ClassUtils (ClassUtils.java:84)
         at  org.apache.sqoop.json.ThrowableBean (ThrowableBean.java:123)
         at  org.apache.sqoop.client.request.ResourceRequest (ResourceRequest.java:127)
         at  org.apache.sqoop.client.request.ResourceRequest (ResourceRequest.java:179)
         at  org.apache.sqoop.client.request.JobResourceRequest (JobResourceRequest.java:112)
         at  org.apache.sqoop.client.request.SqoopResourceRequests (SqoopResourceRequests.java:154)
         at  org.apache.sqoop.client.SqoopClient (SqoopClient.java:460)
         at  org.apache.sqoop.shell.StartJobFunction (StartJobFunction.java:80)
         at  org.apache.sqoop.shell.SqoopFunction (SqoopFunction.java:51)
         at  org.apache.sqoop.shell.SqoopCommand (SqoopCommand.java:127)
         at  org.apache.sqoop.shell.SqoopCommand (SqoopCommand.java:103)
         at  org.codehaus.groovy.tools.shell.Command$execute (null:-1)
         at  org.codehaus.groovy.runtime.callsite.CallSiteArray (CallSiteArray.java:42)
         at  org.codehaus.groovy.tools.shell.Command$execute (null:-1)
         at  org.codehaus.groovy.tools.shell.Shell (Shell.groovy:101)
         at  org.codehaus.groovy.tools.shell.Groovysh (Groovysh.groovy:-1)
         at  sun.reflect.NativeMethodAccessorImpl (NativeMethodAccessorImpl.java:-2)
         at  sun.reflect.NativeMethodAccessorImpl (NativeMethodAccessorImpl.java:62)
         at  sun.reflect.DelegatingMethodAccessorImpl (DelegatingMethodAccessorImpl.java:43)
         at  java.lang.reflect.Method (Method.java:497)
         at  org.codehaus.groovy.reflection.CachedMethod (CachedMethod.java:90)
         at  groovy.lang.MetaMethod (MetaMethod.java:233)
         at  groovy.lang.MetaClassImpl (MetaClassImpl.java:1054)
         at  org.codehaus.groovy.runtime.ScriptBytecodeAdapter (ScriptBytecodeAdapter.java:128)
         at  org.codehaus.groovy.tools.shell.Groovysh (Groovysh.groovy:173)
         at  sun.reflect.NativeMethodAccessorImpl (NativeMethodAccessorImpl.java:-2)
         at  sun.reflect.NativeMethodAccessorImpl (NativeMethodAccessorImpl.java:62)
         at  sun.reflect.DelegatingMethodAccessorImpl (DelegatingMethodAccessorImpl.java:43)
         at  java.lang.reflect.Method (Method.java:497)
         at  org.codehaus.groovy.runtime.callsite.PogoMetaMethodSite$PogoCachedMethodSiteNoUnwrapNoCoerce (PogoMetaMethodSite.java:267)
         at  org.codehaus.groovy.runtime.callsite.PogoMetaMethodSite (PogoMetaMethodSite.java:52)
         at  org.codehaus.groovy.runtime.callsite.AbstractCallSite (AbstractCallSite.java:141)
         at  org.codehaus.groovy.tools.shell.Groovysh (Groovysh.groovy:121)
         at  org.codehaus.groovy.tools.shell.Shell (Shell.groovy:114)
         at  org.codehaus.groovy.tools.shell.Shell$leftShift$0 (null:-1)
         at  org.codehaus.groovy.tools.shell.ShellRunner (ShellRunner.groovy:88)
         at  org.codehaus.groovy.tools.shell.InteractiveShellRunner (InteractiveShellRunner.groovy:-1)
         at  sun.reflect.NativeMethodAccessorImpl (NativeMethodAccessorImpl.java:-2)
         at  sun.reflect.NativeMethodAccessorImpl (NativeMethodAccessorImpl.java:62)
         at  sun.reflect.DelegatingMethodAccessorImpl (DelegatingMethodAccessorImpl.java:43)
         at  java.lang.reflect.Method (Method.java:497)
         at  org.codehaus.groovy.reflection.CachedMethod (CachedMethod.java:90)
         at  groovy.lang.MetaMethod (MetaMethod.java:233)
         at  groovy.lang.MetaClassImpl (MetaClassImpl.java:1054)
         at  org.codehaus.groovy.runtime.ScriptBytecodeAdapter (ScriptBytecodeAdapter.java:128)
         at  org.codehaus.groovy.runtime.ScriptBytecodeAdapter (ScriptBytecodeAdapter.java:148)
         at  org.codehaus.groovy.tools.shell.InteractiveShellRunner (InteractiveShellRunner.groovy:100)
         at  sun.reflect.NativeMethodAccessorImpl (NativeMethodAccessorImpl.java:-2)
         at  sun.reflect.NativeMethodAccessorImpl (NativeMethodAccessorImpl.java:62)
         at  sun.reflect.DelegatingMethodAccessorImpl (DelegatingMethodAccessorImpl.java:43)
         at  java.lang.reflect.Method (Method.java:497)
         at  org.codehaus.groovy.runtime.callsite.PogoMetaMethodSite$PogoCachedMethodSiteNoUnwrapNoCoerce (PogoMetaMethodSite.java:267)
         at  org.codehaus.groovy.runtime.callsite.PogoMetaMethodSite (PogoMetaMethodSite.java:52)
         at  org.codehaus.groovy.runtime.callsite.AbstractCallSite (AbstractCallSite.java:137)
         at  org.codehaus.groovy.tools.shell.ShellRunner (ShellRunner.groovy:57)
         at  org.codehaus.groovy.tools.shell.InteractiveShellRunner (InteractiveShellRunner.groovy:-1)
         at  sun.reflect.NativeMethodAccessorImpl (NativeMethodAccessorImpl.java:-2)
         at  sun.reflect.NativeMethodAccessorImpl (NativeMethodAccessorImpl.java:62)
         at  sun.reflect.DelegatingMethodAccessorImpl (DelegatingMethodAccessorImpl.java:43)
         at  java.lang.reflect.Method (Method.java:497)
         at  org.codehaus.groovy.reflection.CachedMethod (CachedMethod.java:90)
         at  groovy.lang.MetaMethod (MetaMethod.java:233)
         at  groovy.lang.MetaClassImpl (MetaClassImpl.java:1054)
         at  org.codehaus.groovy.runtime.ScriptBytecodeAdapter (ScriptBytecodeAdapter.java:128)
         at  org.codehaus.groovy.runtime.ScriptBytecodeAdapter (ScriptBytecodeAdapter.java:148)
         at  org.codehaus.groovy.tools.shell.InteractiveShellRunner (InteractiveShellRunner.groovy:66)
         at  java_lang_Runnable$run (null:-1)
         at  org.codehaus.groovy.runtime.callsite.CallSiteArray (CallSiteArray.java:42)
         at  org.codehaus.groovy.runtime.callsite.AbstractCallSite (AbstractCallSite.java:108)
         at  org.codehaus.groovy.runtime.callsite.AbstractCallSite (AbstractCallSite.java:112)
         at  org.codehaus.groovy.tools.shell.Groovysh (Groovysh.groovy:463)
         at  org.codehaus.groovy.tools.shell.Groovysh (Groovysh.groovy:402)
         at  org.apache.sqoop.shell.SqoopShell (SqoopShell.java:128)
sqoop:000>

 

Thanks for your helps

Best regards

msuluhan