question Re: Sqoop Connect to DB with Truststore in Archives of Support Questions (Read Only)

Sqoop Connect to DB with Truststore

wnascimento — Tue, 07 Jun 2016 21:38:38 GMT

Hello,

I am trying to access a VIrtual Database from JBoss Data Virtualization using Sqoop. This database is defined to connect using a Truststore (JKS format), using another application like Squirrel i can connect using the following argument:

	-Djavax.net.ssl.trustStore=/home/user/truststore-xxxxx.jks

Does anyone knows how can I use this argument with Sqoop?

Ps.: I already deploy my .jar file on $SQOOP_HOME/lib.

Re: Sqoop Connect to DB with Truststore

jyadav — Tue, 07 Jun 2016 22:08:56 GMT

@Washington Nascimento

Try with below two commands.

export HADOOP_OPTS=" -Djavax.net.ssl.trustStore=/home/user/truststore-xxxxx.jks"

sqoop import -Dmapred.child.java.opts=" -Djavax.net.ssl.trustStore=/home/user/truststore-xxxxx.jks"

Re: Sqoop Connect to DB with Truststore

wnascimento — Wed, 08 Jun 2016 20:13:12 GMT

Hello Jitendra Yadav

The solution was great, the first one (export... HADOOP_OPTS...) worked for me!

Thanks

Re: Sqoop Connect to DB with Truststore

jyadav — Wed, 08 Jun 2016 20:18:08 GMT

@Washington Nascimento Thanks for confirming. Please accept the answer to close this thread.

Re: Sqoop Connect to DB with Truststore

wnascimento — Thu, 09 Jun 2016 01:45:41 GMT

Hello,

Now the problem is the following error:

Error: java.lang.RuntimeException: java.lang.RuntimeException: org.teiid.jdbc.TeiidSQLException: TEIID20020 Error establishing socket to host and port: xxxx.hostname:port. Reason: sun.security.validator.ValidatorException: PKIX path building failed: sun.security.provider.certpath.SunCertPathBuilderException: unable to find valid certification path to requested target
        at org.apache.sqoop.mapreduce.db.DBInputFormat.setConf(DBInputFormat.java:167)
        at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:76)
        at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:136)
        at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:749)
        at org.apache.hadoop.mapred.MapTask.run(MapTask.java:341)
        at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:164)
        at java.security.AccessController.doPrivileged(Native Method)
        at javax.security.auth.Subject.doAs(Subject.java:415)
        at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657)
        at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:158)

We tried to put the enviroment variable on all slave/master nodes like the following commando on /etc/profile ... /etc/bashrc

export HADOOP_OPTS="-Djavax.net.ssl.trustStore=/home/user/truststore.jks"

But unfortunately the error persists.

Thanks

Re: Sqoop Connect to DB with Truststore

jyadav — Thu, 09 Jun 2016 17:15:11 GMT

So is that the same exception you got initally?

Re: Sqoop Connect to DB with Truststore

wnascimento — Mon, 19 Aug 2019 10:10:08 GMT

Hello,

It worked fine now, the first solution worked connected to the database, but when Sqoop was running Map Reduce, the same error occurred. This way all Map Reduce agents have this configuration.

So the solution is configure the TrustStore parameter on Map Reduce Configuration inside Ambari

The value:

-Djavax.net.ssl.trustStore=/home/user/truststore.jks

Thank you