Member since
02-17-2017
22
Posts
0
Kudos Received
0
Solutions
04-24-2017
03:47 PM
Can you share the output error you are getting?
... View more
04-12-2017
12:51 PM
i got this error 17/04/12 15:28:29 INFO mapreduce.Job: Counters: 8
Job Counters
Failed map tasks=1
Launched map tasks=1
Rack-local map tasks=1
Total time spent by all maps in occupied slots (ms)=654614
Total time spent by all reduces in occupied slots (ms)=0
Total time spent by all map tasks (ms)=327307
Total vcore-milliseconds taken by all map tasks=327307
Total megabyte-milliseconds taken by all map tasks=502743552
17/04/12 15:28:29 WARN mapreduce.Counters: Group FileSystemCounters is deprecated. Use org.apache.hadoop.mapreduce.FileSystemCounter instead
17/04/12 15:28:29 INFO mapreduce.ExportJobBase: Transferred 0 bytes in 342.7432 seconds (0 bytes/sec)
17/04/12 15:28:29 WARN mapreduce.Counters: Group org.apache.hadoop.mapred.Task$Counter is deprecated. Use org.apache.hadoop.mapreduce.TaskCounter instead
17/04/12 15:28:29 INFO mapreduce.ExportJobBase: Exported 0 records.
17/04/12 15:28:29 ERROR mapreduce.ExportJobBase: Export job failed!
17/04/12 15:28:29 ERROR tool.ExportTool: Error during export: Export job failed!
... View more
03-27-2017
06:36 AM
Hi @Harold Allen Badilla. By default sqoop creates a hive table based on the predefined data type conversion logic build inside sqoop. For Example: Number, datatime is not available in hive. Instead float,decimal,timestamp are the corresponding datatype available in hive. If sqoop comes under such case then it converts the data type into string such that the particular column in hive will not show NULL for all the records. Have a look at this link if you need to convert it while importing into hive. https://amalgjose.com/2015/07/27/changing-the-data-type-mapping-in-sqoop/
... View more
03-23-2017
03:00 PM
If want to do one time import,use the following command,It will use hcatalog to create the table and import the data in ORC format sqoop import --connect jdbc:sqlserver://11.11.111.11;databaseName=dswFICO --driver com.microsoft.sqlserver.jdbc.SQLServerDriver --username sqoop --password sqoop --table KNA1 --hcatalog-database default --hcatalog-table KNA1 --create-hcatalog-table --hcatalog-storage-stanza "stored as orcfile"
... View more
03-16-2017
07:03 AM
@Jay SenSharma, i successfully moved the sqljdbc42.jar here : /usr/hdp/current/sqoop-client/lib/ what else should i do after i moved the jar file? i try again another import command but somethings wrong again.
... View more
02-17-2017
12:39 PM
@Jay SenSharma im just pasting it. too large to attach on this page. 2017-02-17 09:46:00,150 INFO [main-SendThread(XX002.XXDP.i4.internal.cloudapp.net:2181)]: zookeeper.ClientCnxn (ClientCnxn.java:logStartConnect(1019)) - Opening socket connection to server XX002.XXDP.i4.internal.cloudapp.net/10.94.11.37:2181. Will not attempt to authenticate using SASL (unknown error) 2017-02-17 09:46:00,151 WARN [main-SendThread(XX002.XXDP.i4.internal.cloudapp.net:2181)]: zookeeper.ClientCnxn (ClientCnxn.java:run(1146)) - Session 0x0 for server null, unexpected error, closing socket connection and attempting reconnect java.net.ConnectException: Connection refused at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:717) at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:361) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1125) 2017-02-17 09:46:00,252 INFO [main-SendThread(XX001.XXDP.i4.internal.cloudapp.net:2181)]: zookeeper.ClientCnxn
... View more
06-20-2017
04:45 PM
I am getting the error regarding specifying connection manager even though I have added the jar file at /usr/hdp/current/sqoop_client/lib Can anyone help? I have used the same command as given above. Error- WARN sqoop.ConnFactory: Parameter --driver is set to an explicit driver however appropriate connection manager is not being set (via --connection-manager). Sqoop is going to fall back to org.apache.sqoop.manager.GenericJdbcManager. Please specify explicitly which connection manager should be used next time.
17/06/20 11:28:48 INFO manager.SqlManager: Using default fetchSize of 1000
17/06/20 11:28:48 INFO tool.CodeGenTool: Beginning code generation
17/06/20 11:28:48 ERROR sqoop.Sqoop: Got exception running Sqoop: java.lang.RuntimeException: Could not load db driver class: com.microsoft.jdbc.sqlserver.SQLServerDriver
... View more