Support Questions
Find answers, ask questions, and share your expertise

Terradata Driver configuration in Scala

Terradata Driver configuration in Scala

New Contributor

Hi,

We are trying to connect to terradata from scala (spark) but it is unable to find the driver.

Getting class not found exception:


2019-06-28 13:37:04,714 [Driver] ERROR org.apache.spark.deploy.yarn.ApplicationMaster  - User class threw exception: java.lang.ClassNotFoundException: com.teradata.jdbc.TeraDriver
java.lang.ClassNotFoundException: com.teradata.jdbc.TeraDriver
        at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
        at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
        at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
        at org.apache.spark.sql.execution.datasources.jdbc.DriverRegistry$.register(DriverRegistry.scala:45)
        at org.apache.spark.sql.execution.datasources.jdbc.JDBCOptions$$anonfun$6.apply(JDBCOptions.scala:79)
        at org.apache.spark.sql.execution.datasources.jdbc.JDBCOptions$$anonfun$6.apply(JDBCOptions.scala:79)
        at scala.Option.foreach(Option.scala:257)
        at org.apache.spark.sql.execution.datasources.jdbc.JDBCOptions.<init>(JDBCOptions.scala:79)
        at org.apache.spark.sql.execution.datasources.jdbc.JDBCOptions.<init>(JDBCOptions.scala:35)
        at org.apache.spark.sql.execution.datasources.jdbc.JdbcRelationProvider.createRelation(JdbcRelationProvider.scala:34)
        at org.apache.spark.sql.execution.datasources.DataSource.resolveRelation(DataSource.scala:340)
        at org.apache.spark.sql.DataFrameReader.loadV1Source(DataFrameReader.scala:239)
        at org.apache.spark.sql.DataFrameReader.load(DataFrameReader.scala:227)
        at org.apache.spark.sql.DataFrameReader.load(DataFrameReader.scala:164)
        at com.tesco.pmr.SparkPOC.SparkJdbc$.main(SparkJdbc.scala:17)
        at com.tesco.pmr.SparkPOC.SparkJdbc.main(SparkJdbc.scala)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        tore_mgp_sub_departmentt sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:497)
        at org.apache.spark.deploy.yarn.ApplicationMaster$$anon$4.run(ApplicationMaster.scala:721)
2019-06-28 13:37:04,720 [Driver] INFO  org.apache.spark.deploy.yarn.ApplicationMaster  - Final app status: FAILED, exitCode: 15, (reason: User class threw exception: java.lang.ClassNotFoundException: com.teradata.jdbc.TeraDriver
        at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
        at java.lang.ClassLoader.loadClass(ClassLoader.java:424)

The following jars are added:

Terajdbc4.jar

Tdgssconfig.jar

Teradata-connector-1.4.1-hadoop2.jar


We are not sure where we need to configure the driver. Can someone help ?


Saurabh



1 REPLY 1
Highlighted

Re: Terradata Driver configuration in Scala

Hi @Saurabh…you might be more likely to get a timely answer if you post this as a question in the Teradata Developer Zone.

Bill Brooks, Community Moderator
Was your question answered? Make sure to mark the answer as the accepted solution.
If you find a reply useful, say thanks by clicking on the thumbs up button.