Reply
Highlighted
New Contributor
Posts: 1
Registered: ‎08-21-2017

Sqoop2 job start failed while moving mysql data to hive using generic-jdbc-connector and kite-connec

The links and job informations :

sqoop:000> show link --name hive
1 link(s) to show:
link with name hive (Enabled: true, Created by cluster at 21/8/17 3:32 PM, Updated by cluster at 21/8/17 5:17 PM)
Using Connector kite-connector with name {1}
Global configuration
HDFS host and port: system102.cluster.com:9083
Hadoop conf directory:
sqoop:000> show link --name mysql
1 link(s) to show:
link with name mysql (Enabled: true, Created by cluster at 18/8/17 4:17 PM, Updated by cluster at 21/8/17 3:28 PM)
Using Connector generic-jdbc-connector with name {1}
Database connection
Driver class: com.mysql.jdbc.Driver
Connection String: jdbc:mysql://192.168.1.6/testdb
Username: root
Password:
Fetch Size:
Connection Properties:
protocol = tcp
SQL Dialect
Identifier enclose:

sqoop:000> show job --name mysql_to_hive
1 job(s) to show:
Job with name mysql_to_hive (Enabled: true, Created by cluster at 21/8/17 3:35 PM, Updated by cluster at 21/8/17 5:18 PM)
Throttling resources
Extractors: 1
Loaders: 1
Classpath configuration
Extra mapper jars:
From link: mysql
Database source
Schema name:
Table name: CustomerInvoice
SQL statement:
Column names:
Partition column: AccountNumber
Partition column nullable:
Boundary query:
Incremental read
Check column:
Last value:
To link: hive
Target configuration
Dataset URI: dataset:hive:vinodkumar/ci
File format: PARQUET
sqoop:000> start job --name mysql_to_hive

Exception in thread "main" org.apache.sqoop.common.SqoopException: CLIENT_0001:Server has returned exception
at org.apache.sqoop.client.request.ResourceRequest.doHttpRequest(ResourceRequest.java:137)
at org.apache.sqoop.client.request.ResourceRequest.put(ResourceRequest.java:187)
at org.apache.sqoop.client.request.JobResourceRequest.start(JobResourceRequest.java:113)
at org.apache.sqoop.client.request.SqoopResourceRequests.startJob(SqoopResourceRequests.java:170)
at org.apache.sqoop.client.SqoopClient.startJob(SqoopClient.java:477)
at volumata.library.service.SqoopTest.startJob(SqoopTest.java:133)
at volumata.library.service.SqoopTest.main(SqoopTest.java:159)
Caused by: java.lang.NullPointerException:
at org.apache.sqoop.utils.ClassUtils.jarForClass(ClassUtils.java:217)
at org.apache.sqoop.utils.ClassUtils.jarForClassWithClassLoader(ClassUtils.java:204)
at org.apache.sqoop.utils.ClassUtils.jarForClass(ClassUtils.java:192)
at org.apache.sqoop.connector.kite.KiteToInitializer.getJars(KiteToInitializer.java:85)
at org.apache.sqoop.connector.kite.KiteToInitializer.getJars(KiteToInitializer.java:45)
at org.apache.sqoop.driver.JobManager.addConnectorInitializerJars(JobManager.java:543)
at org.apache.sqoop.driver.JobManager.createJobRequest(JobManager.java:418)
at org.apache.sqoop.driver.JobManager.start(JobManager.java:317)
at org.apache.sqoop.handler.JobRequestHandler.startJob(JobRequestHandler.java:353)
at org.apache.sqoop.handler.JobRequestHandler.handleEvent(JobRequestHandler.java:114)
at org.apache.sqoop.server.v1.JobServlet.handlePutRequest(JobServlet.java:84)
at org.apache.sqoop.server.SqoopProtocolServlet.doPut(SqoopProtocolServlet.java:81)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:710)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:790)
at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:808)
at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1669)
at org.apache.hadoop.security.authentication.server.AuthenticationFilter.doFilter(AuthenticationFilter.java:617)
at org.apache.hadoop.security.token.delegation.web.DelegationTokenAuthenticationFilter.doFilter(DelegationTokenAuthenticationFilter.java:294)
at org.apache.hadoop.security.authentication.server.AuthenticationFilter.doFilter(AuthenticationFilter.java:576)
at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1652)
at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:585)
at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1127)
at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:515)
at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1061)
at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:97)
at org.eclipse.jetty.server.Server.handle(Server.java:499)
at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:310)
at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:257)
at org.eclipse.jetty.io.AbstractConnection$2.run(AbstractConnection.java:540)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)

Cloudera Employee
Posts: 211
Registered: ‎03-23-2015

Re: Sqoop2 job start failed while moving mysql data to hive using generic-jdbc-connector and kite-co

Sqoop2 has been deprecated since 5.9 and will be removed in CDH6. I do not recommend you dig further, but rather to switch back to Sqoop1 to import data.

Please refer to:
https://www.cloudera.com/documentation/enterprise/release-notes/topics/rg_deprecated.html

for details.
Announcements