Member since
03-28-2016
99
Posts
9
Kudos Received
7
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
2416 | 05-08-2018 06:39 AM | |
1317 | 04-27-2018 10:12 AM | |
3240 | 09-11-2017 01:07 PM | |
22568 | 03-14-2017 10:00 AM | |
6255 | 02-10-2017 08:40 AM |
02-10-2017
08:44 AM
@Praveen Singh Thanks..!!, your comment helped in narrowing my problem.
... View more
02-10-2017
08:40 AM
1 Kudo
Finaly i resolved the issue...!!! Sqoop SQL Server data import to HDFS worked with manual parametric the authentication(using windows credential) with added parameter on the SQL Server JDBC driver, as integrated security is not supported by the SQL driver as of now due to the Kerberos authentication(Delegated tokens distributed over cluster while running MR job). So we need to pass the windows authentication with password and with the integrated security disabled mode to import the data to the system. As normal SQL server driver does not support, so I had used the jtds.jar and the different driver class to pull the data to the Hadoop Lake. Sample Command I tried on the server as follows, sqoop import --table Table1 --connect "jdbc:jtds:sqlserver://<Hostname>:<Port>;useNTLMv2=true;domain=<WindowsDomainName>;databaseName=XXXXXXXXXXXXX" \ --connection-manager org.apache.sqoop.manager.SQLServerManager --driver net.sourceforge.jtds.jdbc.Driver --username XXXXX --password 'XXXXXXX' \ --verbose --target-dir /tmp/33 -m 1 -- --schema dbo
... View more
02-10-2017
07:38 AM
1 Kudo
@Justin MillerI too faced the same problem, finally i resolved the issue with the below mention procedure,it may help you i hope. Sqoop SQL Server data import to
HDFS worked with manual parametric the authentication(using windows credential) with added parameter on the SQL
Server JDBC driver, as integrated security is not supported by the SQL driver
as of now due to the Kerberos authentication(Delegated tokens distributed over cluster while running MR job). So we need to pass the windows
authentication with password and with the integrated security disabled mode to
import the data to the system. As normal SQL server
driver does not support, so I had used the jtds.jar
and the different driver class to pull the data to the Hadoop Lake. Sample Command I tried on the
server as follows, sqoop import --table Table1 --connect
"jdbc:jtds:sqlserver://<Hostname>:<Port>;useNTLMv2=true;domain=<WindowsDomainName>;databaseName=XXXXXXXXXXXXX"
\ --connection-manager
org.apache.sqoop.manager.SQLServerManager --driver
net.sourceforge.jtds.jdbc.Driver --username XXXXX --password 'XXXXXXX' \ --verbose --target-dir
/tmp/33 -m 1 -- --schema dbo
... View more
02-09-2017
10:07 AM
@Venkat Ranganathan Even my opnion is same , eval picking the kerberos from the local host. But how to resolve for import?
... View more
02-09-2017
10:03 AM
@anatva yes i am using sqljdbc42.jar. and i tried with both sql and jtds.jar driver class. sqoop eval working fine with integratedSecurity and userid & password too.
... View more
02-09-2017
09:58 AM
@Praveen Singh I am trying to write the data to user home directory, so no problem with the permission. Sqoop Command: sqoop import --connect "jdbc:jtds:sqlserver://XXXXXXXXXXXXXXX;domain=NTXXXX;databaseName=XXXX;ServerSpn=XXXXXXXX@realm;authenticationScheme=JavaKerberos" --table data_table --connection-manager org.apache.sqoop.manager.SQLServerManager --driver net.sourceforge.jtds.jdbc.Driver --target-dir /tmp/111 --split-by AR_ID -m 1 -- --schema dbo --user XXXXXX --password 'XXXXXX' --verbose
... View more
02-09-2017
09:43 AM
@Venkat Ranganathan
I am using 4.2 driver only, i tried with both integrated and self authentication method, but no success.may be problem is with the delagated token authorization with SQL server i hope, because eval and list-databases are working fine, but map reduced triggered actions like import got failed
... View more
02-09-2017
09:37 AM
@Praveen Singh I am generating the ticket and then only i am sqooping. problem is with the delagated token authorization with SQL server i hope, because eval and list-databases are working fine, but map reduced triggered actions like import got failed.
... View more
- « Previous
- Next »