Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Sqoop2 job start failed while moving mysql data to hive using generic-jdbc-connector and kite-connec

Highlighted

Sqoop2 job start failed while moving mysql data to hive using generic-jdbc-connector and kite-connec

New Contributor

The links and job informations :

sqoop:000> show link --name hive
1 link(s) to show:
link with name hive (Enabled: true, Created by cluster at 21/8/17 3:32 PM, Updated by cluster at 21/8/17 5:17 PM)
Using Connector kite-connector with name {1}
Global configuration
HDFS host and port: system102.cluster.com:9083
Hadoop conf directory:
sqoop:000> show link --name mysql
1 link(s) to show:
link with name mysql (Enabled: true, Created by cluster at 18/8/17 4:17 PM, Updated by cluster at 21/8/17 3:28 PM)
Using Connector generic-jdbc-connector with name {1}
Database connection
Driver class: com.mysql.jdbc.Driver
Connection String: jdbc:mysql://192.168.1.6/testdb
Username: root
Password:
Fetch Size:
Connection Properties:
protocol = tcp
SQL Dialect
Identifier enclose:

sqoop:000> show job --name mysql_to_hive
1 job(s) to show:
Job with name mysql_to_hive (Enabled: true, Created by cluster at 21/8/17 3:35 PM, Updated by cluster at 21/8/17 5:18 PM)
Throttling resources
Extractors: 1
Loaders: 1
Classpath configuration
Extra mapper jars:
From link: mysql
Database source
Schema name:
Table name: CustomerInvoice
SQL statement:
Column names:
Partition column: AccountNumber
Partition column nullable:
Boundary query:
Incremental read
Check column:
Last value:
To link: hive
Target configuration
Dataset URI: dataset:hive:vinodkumar/ci
File format: PARQUET
sqoop:000> start job --name mysql_to_hive

Exception in thread "main" org.apache.sqoop.common.SqoopException: CLIENT_0001:Server has returned exception
at org.apache.sqoop.client.request.ResourceRequest.doHttpRequest(ResourceRequest.java:137)
at org.apache.sqoop.client.request.ResourceRequest.put(ResourceRequest.java:187)
at org.apache.sqoop.client.request.JobResourceRequest.start(JobResourceRequest.java:113)
at org.apache.sqoop.client.request.SqoopResourceRequests.startJob(SqoopResourceRequests.java:170)
at org.apache.sqoop.client.SqoopClient.startJob(SqoopClient.java:477)
at volumata.library.service.SqoopTest.startJob(SqoopTest.java:133)
at volumata.library.service.SqoopTest.main(SqoopTest.java:159)
Caused by: java.lang.NullPointerException:
at org.apache.sqoop.utils.ClassUtils.jarForClass(ClassUtils.java:217)
at org.apache.sqoop.utils.ClassUtils.jarForClassWithClassLoader(ClassUtils.java:204)
at org.apache.sqoop.utils.ClassUtils.jarForClass(ClassUtils.java:192)
at org.apache.sqoop.connector.kite.KiteToInitializer.getJars(KiteToInitializer.java:85)
at org.apache.sqoop.connector.kite.KiteToInitializer.getJars(KiteToInitializer.java:45)
at org.apache.sqoop.driver.JobManager.addConnectorInitializerJars(JobManager.java:543)
at org.apache.sqoop.driver.JobManager.createJobRequest(JobManager.java:418)
at org.apache.sqoop.driver.JobManager.start(JobManager.java:317)
at org.apache.sqoop.handler.JobRequestHandler.startJob(JobRequestHandler.java:353)
at org.apache.sqoop.handler.JobRequestHandler.handleEvent(JobRequestHandler.java:114)
at org.apache.sqoop.server.v1.JobServlet.handlePutRequest(JobServlet.java:84)
at org.apache.sqoop.server.SqoopProtocolServlet.doPut(SqoopProtocolServlet.java:81)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:710)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:790)
at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:808)
at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1669)
at org.apache.hadoop.security.authentication.server.AuthenticationFilter.doFilter(AuthenticationFilter.java:617)
at org.apache.hadoop.security.token.delegation.web.DelegationTokenAuthenticationFilter.doFilter(DelegationTokenAuthenticationFilter.java:294)
at org.apache.hadoop.security.authentication.server.AuthenticationFilter.doFilter(AuthenticationFilter.java:576)
at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1652)
at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:585)
at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1127)
at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:515)
at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1061)
at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:97)
at org.eclipse.jetty.server.Server.handle(Server.java:499)
at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:310)
at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:257)
at org.eclipse.jetty.io.AbstractConnection$2.run(AbstractConnection.java:540)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)

1 REPLY 1

Re: Sqoop2 job start failed while moving mysql data to hive using generic-jdbc-connector and kite-co

Guru
Sqoop2 has been deprecated since 5.9 and will be removed in CDH6. I do not recommend you dig further, but rather to switch back to Sqoop1 to import data.

Please refer to:
https://www.cloudera.com/documentation/enterprise/release-notes/topics/rg_deprecated.html

for details.