Member since
04-10-2018
4
Posts
0
Kudos Received
0
Solutions
12-12-2019
06:45 AM
What I understand from your reply is sqoop does NOT create hive database automatically if we don't hive that directory.
... View more
05-31-2019
12:44 PM
Hi Everyone, Is it possible to create hive database while running sqoop command? Sample Script: sqoop import \
--connect "jdbc:sqlserver://hostname:1433;databasename=sqldbname" \
--username asd \
--password "asd123" \
--table tblname \
--hive-import \
--hive-database db_name \
--hive-table tblname \
--incremental append \
--check-column tablepk \
--split-by tablepk \
-m 2 \
--target-dir /tmp \
-- --schema schname Error: Error: Error while compiling statement: FAILED: SemanticException [Error 10072]: Database does not exist: db_name
... View more
Labels:
03-12-2019
10:43 PM
Hello, I am trying to connect to MSSQL with sqoop jdbc javakerberos option. The command below returns result successfully. sqoop eval \
--connect "jdbc:sqlserver://FQDN:1433;databasename=dbName;integratedSecurity=true;authenticationScheme=JavaKerberos;"\
--query "select top 10 * FROM dbo.tableName" On the other hand, I'm getting error with the below command. sqoop import \
--connect "jdbc:sqlserver://FQDN:1433;databasename=databaseName;integratedSecurity=true;authenticationScheme=JavaKerberos;" \
--query "select top 10 * FROM dbo.tableName WHERE 1=1 AND \$CONDITIONS" \
--target-dir /user/root/sqoop \
-m 1 \
--delete-target-dir Caused by: com.microsoft.sqlserver.jdbc.SQLServerException: Integrated authentication failed. ClientConnectionId:08e00b0d-a2f6-4e7a-b7c5-9a7881fd2c82 at com.microsoft.sqlserver.jdbc.SQLServerConnection.terminate(SQLServerConnection.java:2435) at com.microsoft.sqlserver.jdbc.KerbAuthentication.intAuthInit(KerbAuthentication.java:135) Caused by: java.security.PrivilegedActionException: GSSException: No valid credentials provided (Mechanism level: Failed to find any Kerberos tgt) at java.security.AccessController.doPrivileged(Native Method) To solve this issue, I created a new jaas.conf file in tmp directory. SQLJDBCDriver {
com.sun.security.auth.module.Krb5LoginModule required
useTicketCache=false
useKeyTab=true
storeKey=true
keyTab="/etc/security/keytabs/hdfs.headless.keytab"
principal=hdfs-archieve@DN;
}; I tried to pass jaas.conf file to jdbc driver, but received another error : No LoginModules configured for /tmp/my_jaas.conf sqoop import \
--connect "jdbc:sqlserver://FQDN:1433;databasename=databaseName;integratedSecurity=true;authenticationScheme=JavaKerberos;jaasConfigurationName=/tmp/my_jaas.conf" \
--query "select top 10 * FROM dbo.tableName WHERE 1=1 AND \$CONDITIONS" \
--target-dir /user/root/sqoop \
--delete-target-dir \
-m 1 Any help will be very much appreciated. Thanks in advance 🙂
... View more
Labels:
01-29-2019
11:29 AM
If it is possible, Could you please share steps that how I can do it. Thanks. Versions: Sqoop1.4.7 NiFi1.8.0
... View more
Labels: