Member since
02-17-2017
22
Posts
0
Kudos Received
0
Solutions
04-19-2017
11:52 AM
Hi there, can someone help me figure out whats the problem on my sqoop command? sqoop export --connect "jdbc:sqlserver://xx.xx.xxx.xx.\BACDASD;databaseName=dswFICO" \ --username user \ --password user \ --table hadoop_export \ --export-dir /tmp/sql_backup/part-m-00000 -m 1 --fields-terminated-by '\01' note: hadoop_export - this table is on ms sql server that will contain my exported data. --export-dir /tmp/sql_backup/part-m-00000 - this is the file i imported from other ms sql server and i want this to be exported to hadoop_export table .
... View more
- Tags:
- Data Processing
- export
- sql-server
- Sqoop
- Upgrade to HDP 2.5.3 : ConcurrentModificationException When Executing Insert Overwrite : Hive
Labels:
- Labels:
-
Apache Sqoop
04-12-2017
12:51 PM
i got this error 17/04/12 15:28:29 INFO mapreduce.Job: Counters: 8
Job Counters
Failed map tasks=1
Launched map tasks=1
Rack-local map tasks=1
Total time spent by all maps in occupied slots (ms)=654614
Total time spent by all reduces in occupied slots (ms)=0
Total time spent by all map tasks (ms)=327307
Total vcore-milliseconds taken by all map tasks=327307
Total megabyte-milliseconds taken by all map tasks=502743552
17/04/12 15:28:29 WARN mapreduce.Counters: Group FileSystemCounters is deprecated. Use org.apache.hadoop.mapreduce.FileSystemCounter instead
17/04/12 15:28:29 INFO mapreduce.ExportJobBase: Transferred 0 bytes in 342.7432 seconds (0 bytes/sec)
17/04/12 15:28:29 WARN mapreduce.Counters: Group org.apache.hadoop.mapred.Task$Counter is deprecated. Use org.apache.hadoop.mapreduce.TaskCounter instead
17/04/12 15:28:29 INFO mapreduce.ExportJobBase: Exported 0 records.
17/04/12 15:28:29 ERROR mapreduce.ExportJobBase: Export job failed!
17/04/12 15:28:29 ERROR tool.ExportTool: Error during export: Export job failed!
... View more
04-12-2017
07:17 AM
Hi @Deepesh, thank you for your response, but i have some question. --table TABLENAME - is this the table on sql server where i want to dump the data? --export-dir HDFS_EXPORT_DIR - and this command is for HDFS? but my data is on Hive. Please correct me if im wrong
... View more
04-12-2017
12:53 AM
Hi, Can anyone can help me to find a solution on transfering data from Hive to Sql Server? The Idea is Hive is our back up and im trying to load it to sql server. Thank you in advance.!
... View more
03-27-2017
03:22 AM
Hi, I try to import tables from Sql Server to hive, but after checking fields are set to STRING but the data type on Sql Server is nvarchar, is there code to copy the same data type when importing?
... View more
Labels:
- Labels:
-
Apache Hive
-
Apache Sqoop
03-20-2017
03:15 AM
Hi @Ravi Mutyala, is there any disadvantage when importing a table from Sql Server directly to HIVE? what is the best way to do it? Can you help me with this. thank you in advance
... View more
03-17-2017
09:33 AM
Hi , Im trying to import table from SQL Server to Hive with the commands below: sqoop import --connect "jdbc:sqlserver://11.11.111.11;databaseName=dswFICO" --username sqoop--password sqoop --driver com.microsoft.sqlserver.jdbc.SQLServerDriver --table KNA1 --target-dir "/tmp/dbo-customer" When i check on Hive View i cant see any KNA1 table created.
... View more
Labels:
- Labels:
-
Apache Hive
-
Apache Sqoop
03-17-2017
01:08 AM
Hi @Rajendra Manjunath, I try to revise my commands , i dont see any error but still no data transferred on the hdfs directory, please the image
... View more
03-16-2017
07:03 AM
@Jay SenSharma, i successfully moved the sqljdbc42.jar here : /usr/hdp/current/sqoop-client/lib/ what else should i do after i moved the jar file? i try again another import command but somethings wrong again.
... View more
03-16-2017
07:01 AM
Hi @Rajendra Manjunath, can you help me to identify whats wrong on my sqoop commands?
... View more
03-16-2017
03:28 AM
Hi @Jay SenSharma, i got two .jar files , is it ok if i put this both in /usr/hdp/current/sqoop-client/lib/ ?
... View more
03-13-2017
08:01 AM
Hi @Jay SenSharma, im now able to login on the sqoop client, but after executing some import commands i got this warning.
... View more
03-09-2017
04:00 AM
Hi @Jay SenSharma, I found out that its not listed on the sqoop client, Thanks for the help. but now my user dont have access on the other nodes.. I will post my updates once the user created. Thank you!
... View more
03-09-2017
03:04 AM
Hi @Jay SenSharma, Can you guide me how can install it on ambari? Please take a look on my ambari UI , yes i can see my "Sqoop Clients" whats next ?
... View more
03-09-2017
02:41 AM
Hi All, I dont know much about this please help me. Im going to get data from RDMS to HDFS using Sqoop. i got the commands that i need to do this, But after putting those commands on Putty. It doesn't recognize at all. Is there anything that i need to do first before i can put some command of sqoop on putty ? or is there another command shell for hadoop? Thank you in advance!
... View more
Labels:
- Labels:
-
Apache Sqoop
02-17-2017
12:39 PM
@Jay SenSharma im just pasting it. too large to attach on this page. 2017-02-17 09:46:00,150 INFO [main-SendThread(XX002.XXDP.i4.internal.cloudapp.net:2181)]: zookeeper.ClientCnxn (ClientCnxn.java:logStartConnect(1019)) - Opening socket connection to server XX002.XXDP.i4.internal.cloudapp.net/10.94.11.37:2181. Will not attempt to authenticate using SASL (unknown error) 2017-02-17 09:46:00,151 WARN [main-SendThread(XX002.XXDP.i4.internal.cloudapp.net:2181)]: zookeeper.ClientCnxn (ClientCnxn.java:run(1146)) - Session 0x0 for server null, unexpected error, closing socket connection and attempting reconnect java.net.ConnectException: Connection refused at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:717) at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:361) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1125) 2017-02-17 09:46:00,252 INFO [main-SendThread(XX001.XXDP.i4.internal.cloudapp.net:2181)]: zookeeper.ClientCnxn
... View more
02-17-2017
05:33 AM
@Artem Ervits do you see my logs?
... View more
02-17-2017
02:00 AM
i cant paste here my logs dont know why
... View more
02-17-2017
01:35 AM
Hi @Hamid Zorgani here's the config set on our HDFS ihere what
... View more
02-17-2017
01:15 AM
Hi @Sindhu, where can i find that "stack trace"?
... View more
02-17-2017
01:03 AM
Hi @Artem Ervits, Thank you for your quick response. can you guide how to that? im new on this technology. i recently assign to this to explore. im following some guides but this error alert stops me .
... View more