Reply
Contributor
Posts: 49
Registered: ‎04-21-2015

could not run my first sqoop2 job

Hello all

 

I tried to configure and run sqoo2 job to import data from Oracle2HDFS.

My configuration details in following lines

sqoop:000> show link
+----+----------+--------------+------------------------+---------+
| Id |   Name   | Connector Id |     Connector Name     | Enabled |
+----+----------+--------------+------------------------+---------+
| 1  | TPLink   | 1            | generic-jdbc-connector | true    |
| 2  | HDFSLink | 2            | kite-connector         | true    |
+----+----------+--------------+------------------------+---------+
sqoop:000> show job --all
1 job(s) to show:
Job with id 1 and name TPJob (Enabled: true, Created by cloudera-scm at 10/6/15 2:48 PM, Updated by cloudera-scm at 10/6/15 2:48 PM)
Using link id 1 and Connector id 1
  From database configuration
    Schema name: #######
    Table name: #########
    Table SQL statement:
    Table column names:
    Partition column name: TIME_STAMP
    Null value allowed for the partition column:
    Boundary query:
  Throttling resources
    Extractors: 2
    Loaders: 2
  To Kite Dataset Configuration
    Dataset URI: dataset:hdfs:/tmp/TPSqoop2
    File format: PARQUET
sqoop:000> show link --all
2 link(s) to show:
link with id 1 and name TPLink (Enabled: true, Created by cloudera-scm at 10/6/15 1:49 PM, Updated by cloudera-scm at 10/6/15 1:49 PM)
Using Connector generic-jdbc-connector with id 1
  Link configuration
    JDBC Driver Class: oracle.jdbc.driver.OracleDriver
    JDBC Connection String: jdbc:oracle:thin:@x.y.z.d:1521:<serviceName>
    Username: #########
    Password:
    JDBC Connection Properties:
link with id 2 and name HDFSLink (Enabled: true, Created by cloudera-scm at 10/6/15 2:40 PM, Updated by cloudera-scm at 10/6/15 2:40 PM)
Using Connector kite-connector with id 2
  Link Configuration
    HDFS host and port: <hdfshost>:50070
sqoop:000>

When I try to run this job I got following error and could not find any recommendation about it maybe I am searching with wrong parameters

 

sqoop:000> start job -j 1
Exception has occurred during processing command
Exception: java.lang.RuntimeException Message: java.lang.ClassNotFoundException: org.kitesdk.data.DatasetIOException
Stack trace:
         at  org.apache.sqoop.utils.ClassUtils (ClassUtils.java:65)
         at  org.apache.sqoop.utils.ClassUtils (ClassUtils.java:84)
         at  org.apache.sqoop.json.ThrowableBean (ThrowableBean.java:123)
         at  org.apache.sqoop.client.request.ResourceRequest (ResourceRequest.java:127)
         at  org.apache.sqoop.client.request.ResourceRequest (ResourceRequest.java:179)
         at  org.apache.sqoop.client.request.JobResourceRequest (JobResourceRequest.java:112)
         at  org.apache.sqoop.client.request.SqoopResourceRequests (SqoopResourceRequests.java:154)
         at  org.apache.sqoop.client.SqoopClient (SqoopClient.java:460)
         at  org.apache.sqoop.shell.StartJobFunction (StartJobFunction.java:80)
         at  org.apache.sqoop.shell.SqoopFunction (SqoopFunction.java:51)
         at  org.apache.sqoop.shell.SqoopCommand (SqoopCommand.java:127)
         at  org.apache.sqoop.shell.SqoopCommand (SqoopCommand.java:103)
         at  org.codehaus.groovy.tools.shell.Command$execute (null:-1)
         at  org.codehaus.groovy.runtime.callsite.CallSiteArray (CallSiteArray.java:42)
         at  org.codehaus.groovy.tools.shell.Command$execute (null:-1)
         at  org.codehaus.groovy.tools.shell.Shell (Shell.groovy:101)
         at  org.codehaus.groovy.tools.shell.Groovysh (Groovysh.groovy:-1)
         at  sun.reflect.NativeMethodAccessorImpl (NativeMethodAccessorImpl.java:-2)
         at  sun.reflect.NativeMethodAccessorImpl (NativeMethodAccessorImpl.java:62)
         at  sun.reflect.DelegatingMethodAccessorImpl (DelegatingMethodAccessorImpl.java:43)
         at  java.lang.reflect.Method (Method.java:497)
         at  org.codehaus.groovy.reflection.CachedMethod (CachedMethod.java:90)
         at  groovy.lang.MetaMethod (MetaMethod.java:233)
         at  groovy.lang.MetaClassImpl (MetaClassImpl.java:1054)
         at  org.codehaus.groovy.runtime.ScriptBytecodeAdapter (ScriptBytecodeAdapter.java:128)
         at  org.codehaus.groovy.tools.shell.Groovysh (Groovysh.groovy:173)
         at  sun.reflect.NativeMethodAccessorImpl (NativeMethodAccessorImpl.java:-2)
         at  sun.reflect.NativeMethodAccessorImpl (NativeMethodAccessorImpl.java:62)
         at  sun.reflect.DelegatingMethodAccessorImpl (DelegatingMethodAccessorImpl.java:43)
         at  java.lang.reflect.Method (Method.java:497)
         at  org.codehaus.groovy.runtime.callsite.PogoMetaMethodSite$PogoCachedMethodSiteNoUnwrapNoCoerce (PogoMetaMethodSite.java:267)
         at  org.codehaus.groovy.runtime.callsite.PogoMetaMethodSite (PogoMetaMethodSite.java:52)
         at  org.codehaus.groovy.runtime.callsite.AbstractCallSite (AbstractCallSite.java:141)
         at  org.codehaus.groovy.tools.shell.Groovysh (Groovysh.groovy:121)
         at  org.codehaus.groovy.tools.shell.Shell (Shell.groovy:114)
         at  org.codehaus.groovy.tools.shell.Shell$leftShift$0 (null:-1)
         at  org.codehaus.groovy.tools.shell.ShellRunner (ShellRunner.groovy:88)
         at  org.codehaus.groovy.tools.shell.InteractiveShellRunner (InteractiveShellRunner.groovy:-1)
         at  sun.reflect.NativeMethodAccessorImpl (NativeMethodAccessorImpl.java:-2)
         at  sun.reflect.NativeMethodAccessorImpl (NativeMethodAccessorImpl.java:62)
         at  sun.reflect.DelegatingMethodAccessorImpl (DelegatingMethodAccessorImpl.java:43)
         at  java.lang.reflect.Method (Method.java:497)
         at  org.codehaus.groovy.reflection.CachedMethod (CachedMethod.java:90)
         at  groovy.lang.MetaMethod (MetaMethod.java:233)
         at  groovy.lang.MetaClassImpl (MetaClassImpl.java:1054)
         at  org.codehaus.groovy.runtime.ScriptBytecodeAdapter (ScriptBytecodeAdapter.java:128)
         at  org.codehaus.groovy.runtime.ScriptBytecodeAdapter (ScriptBytecodeAdapter.java:148)
         at  org.codehaus.groovy.tools.shell.InteractiveShellRunner (InteractiveShellRunner.groovy:100)
         at  sun.reflect.NativeMethodAccessorImpl (NativeMethodAccessorImpl.java:-2)
         at  sun.reflect.NativeMethodAccessorImpl (NativeMethodAccessorImpl.java:62)
         at  sun.reflect.DelegatingMethodAccessorImpl (DelegatingMethodAccessorImpl.java:43)
         at  java.lang.reflect.Method (Method.java:497)
         at  org.codehaus.groovy.runtime.callsite.PogoMetaMethodSite$PogoCachedMethodSiteNoUnwrapNoCoerce (PogoMetaMethodSite.java:267)
         at  org.codehaus.groovy.runtime.callsite.PogoMetaMethodSite (PogoMetaMethodSite.java:52)
         at  org.codehaus.groovy.runtime.callsite.AbstractCallSite (AbstractCallSite.java:137)
         at  org.codehaus.groovy.tools.shell.ShellRunner (ShellRunner.groovy:57)
         at  org.codehaus.groovy.tools.shell.InteractiveShellRunner (InteractiveShellRunner.groovy:-1)
         at  sun.reflect.NativeMethodAccessorImpl (NativeMethodAccessorImpl.java:-2)
         at  sun.reflect.NativeMethodAccessorImpl (NativeMethodAccessorImpl.java:62)
         at  sun.reflect.DelegatingMethodAccessorImpl (DelegatingMethodAccessorImpl.java:43)
         at  java.lang.reflect.Method (Method.java:497)
         at  org.codehaus.groovy.reflection.CachedMethod (CachedMethod.java:90)
         at  groovy.lang.MetaMethod (MetaMethod.java:233)
         at  groovy.lang.MetaClassImpl (MetaClassImpl.java:1054)
         at  org.codehaus.groovy.runtime.ScriptBytecodeAdapter (ScriptBytecodeAdapter.java:128)
         at  org.codehaus.groovy.runtime.ScriptBytecodeAdapter (ScriptBytecodeAdapter.java:148)
         at  org.codehaus.groovy.tools.shell.InteractiveShellRunner (InteractiveShellRunner.groovy:66)
         at  java_lang_Runnable$run (null:-1)
         at  org.codehaus.groovy.runtime.callsite.CallSiteArray (CallSiteArray.java:42)
         at  org.codehaus.groovy.runtime.callsite.AbstractCallSite (AbstractCallSite.java:108)
         at  org.codehaus.groovy.runtime.callsite.AbstractCallSite (AbstractCallSite.java:112)
         at  org.codehaus.groovy.tools.shell.Groovysh (Groovysh.groovy:463)
         at  org.codehaus.groovy.tools.shell.Groovysh (Groovysh.groovy:402)
         at  org.apache.sqoop.shell.SqoopShell (SqoopShell.java:128)
Caused by: Exception: java.lang.ClassNotFoundException Message: org.kitesdk.data.DatasetIOException
Stack trace:
         at  java.net.URLClassLoader (URLClassLoader.java:381)
         at  java.lang.ClassLoader (ClassLoader.java:424)
         at  sun.misc.Launcher$AppClassLoader (Launcher.java:331)
         at  java.lang.ClassLoader (ClassLoader.java:357)
         at  org.apache.sqoop.utils.ClassUtils (ClassUtils.java:61)
         at  org.apache.sqoop.utils.ClassUtils (ClassUtils.java:84)
         at  org.apache.sqoop.json.ThrowableBean (ThrowableBean.java:123)
         at  org.apache.sqoop.client.request.ResourceRequest (ResourceRequest.java:127)
         at  org.apache.sqoop.client.request.ResourceRequest (ResourceRequest.java:179)
         at  org.apache.sqoop.client.request.JobResourceRequest (JobResourceRequest.java:112)
         at  org.apache.sqoop.client.request.SqoopResourceRequests (SqoopResourceRequests.java:154)
         at  org.apache.sqoop.client.SqoopClient (SqoopClient.java:460)
         at  org.apache.sqoop.shell.StartJobFunction (StartJobFunction.java:80)
         at  org.apache.sqoop.shell.SqoopFunction (SqoopFunction.java:51)
         at  org.apache.sqoop.shell.SqoopCommand (SqoopCommand.java:127)
         at  org.apache.sqoop.shell.SqoopCommand (SqoopCommand.java:103)
         at  org.codehaus.groovy.tools.shell.Command$execute (null:-1)
         at  org.codehaus.groovy.runtime.callsite.CallSiteArray (CallSiteArray.java:42)
         at  org.codehaus.groovy.tools.shell.Command$execute (null:-1)
         at  org.codehaus.groovy.tools.shell.Shell (Shell.groovy:101)
         at  org.codehaus.groovy.tools.shell.Groovysh (Groovysh.groovy:-1)
         at  sun.reflect.NativeMethodAccessorImpl (NativeMethodAccessorImpl.java:-2)
         at  sun.reflect.NativeMethodAccessorImpl (NativeMethodAccessorImpl.java:62)
         at  sun.reflect.DelegatingMethodAccessorImpl (DelegatingMethodAccessorImpl.java:43)
         at  java.lang.reflect.Method (Method.java:497)
         at  org.codehaus.groovy.reflection.CachedMethod (CachedMethod.java:90)
         at  groovy.lang.MetaMethod (MetaMethod.java:233)
         at  groovy.lang.MetaClassImpl (MetaClassImpl.java:1054)
         at  org.codehaus.groovy.runtime.ScriptBytecodeAdapter (ScriptBytecodeAdapter.java:128)
         at  org.codehaus.groovy.tools.shell.Groovysh (Groovysh.groovy:173)
         at  sun.reflect.NativeMethodAccessorImpl (NativeMethodAccessorImpl.java:-2)
         at  sun.reflect.NativeMethodAccessorImpl (NativeMethodAccessorImpl.java:62)
         at  sun.reflect.DelegatingMethodAccessorImpl (DelegatingMethodAccessorImpl.java:43)
         at  java.lang.reflect.Method (Method.java:497)
         at  org.codehaus.groovy.runtime.callsite.PogoMetaMethodSite$PogoCachedMethodSiteNoUnwrapNoCoerce (PogoMetaMethodSite.java:267)
         at  org.codehaus.groovy.runtime.callsite.PogoMetaMethodSite (PogoMetaMethodSite.java:52)
         at  org.codehaus.groovy.runtime.callsite.AbstractCallSite (AbstractCallSite.java:141)
         at  org.codehaus.groovy.tools.shell.Groovysh (Groovysh.groovy:121)
         at  org.codehaus.groovy.tools.shell.Shell (Shell.groovy:114)
         at  org.codehaus.groovy.tools.shell.Shell$leftShift$0 (null:-1)
         at  org.codehaus.groovy.tools.shell.ShellRunner (ShellRunner.groovy:88)
         at  org.codehaus.groovy.tools.shell.InteractiveShellRunner (InteractiveShellRunner.groovy:-1)
         at  sun.reflect.NativeMethodAccessorImpl (NativeMethodAccessorImpl.java:-2)
         at  sun.reflect.NativeMethodAccessorImpl (NativeMethodAccessorImpl.java:62)
         at  sun.reflect.DelegatingMethodAccessorImpl (DelegatingMethodAccessorImpl.java:43)
         at  java.lang.reflect.Method (Method.java:497)
         at  org.codehaus.groovy.reflection.CachedMethod (CachedMethod.java:90)
         at  groovy.lang.MetaMethod (MetaMethod.java:233)
         at  groovy.lang.MetaClassImpl (MetaClassImpl.java:1054)
         at  org.codehaus.groovy.runtime.ScriptBytecodeAdapter (ScriptBytecodeAdapter.java:128)
         at  org.codehaus.groovy.runtime.ScriptBytecodeAdapter (ScriptBytecodeAdapter.java:148)
         at  org.codehaus.groovy.tools.shell.InteractiveShellRunner (InteractiveShellRunner.groovy:100)
         at  sun.reflect.NativeMethodAccessorImpl (NativeMethodAccessorImpl.java:-2)
         at  sun.reflect.NativeMethodAccessorImpl (NativeMethodAccessorImpl.java:62)
         at  sun.reflect.DelegatingMethodAccessorImpl (DelegatingMethodAccessorImpl.java:43)
         at  java.lang.reflect.Method (Method.java:497)
         at  org.codehaus.groovy.runtime.callsite.PogoMetaMethodSite$PogoCachedMethodSiteNoUnwrapNoCoerce (PogoMetaMethodSite.java:267)
         at  org.codehaus.groovy.runtime.callsite.PogoMetaMethodSite (PogoMetaMethodSite.java:52)
         at  org.codehaus.groovy.runtime.callsite.AbstractCallSite (AbstractCallSite.java:137)
         at  org.codehaus.groovy.tools.shell.ShellRunner (ShellRunner.groovy:57)
         at  org.codehaus.groovy.tools.shell.InteractiveShellRunner (InteractiveShellRunner.groovy:-1)
         at  sun.reflect.NativeMethodAccessorImpl (NativeMethodAccessorImpl.java:-2)
         at  sun.reflect.NativeMethodAccessorImpl (NativeMethodAccessorImpl.java:62)
         at  sun.reflect.DelegatingMethodAccessorImpl (DelegatingMethodAccessorImpl.java:43)
         at  java.lang.reflect.Method (Method.java:497)
         at  org.codehaus.groovy.reflection.CachedMethod (CachedMethod.java:90)
         at  groovy.lang.MetaMethod (MetaMethod.java:233)
         at  groovy.lang.MetaClassImpl (MetaClassImpl.java:1054)
         at  org.codehaus.groovy.runtime.ScriptBytecodeAdapter (ScriptBytecodeAdapter.java:128)
         at  org.codehaus.groovy.runtime.ScriptBytecodeAdapter (ScriptBytecodeAdapter.java:148)
         at  org.codehaus.groovy.tools.shell.InteractiveShellRunner (InteractiveShellRunner.groovy:66)
         at  java_lang_Runnable$run (null:-1)
         at  org.codehaus.groovy.runtime.callsite.CallSiteArray (CallSiteArray.java:42)
         at  org.codehaus.groovy.runtime.callsite.AbstractCallSite (AbstractCallSite.java:108)
         at  org.codehaus.groovy.runtime.callsite.AbstractCallSite (AbstractCallSite.java:112)
         at  org.codehaus.groovy.tools.shell.Groovysh (Groovysh.groovy:463)
         at  org.codehaus.groovy.tools.shell.Groovysh (Groovysh.groovy:402)
         at  org.apache.sqoop.shell.SqoopShell (SqoopShell.java:128)
sqoop:000>

 

Thanks for your helps

Best regards

msuluhan

Announcements
New solutions