<?xml version="1.0" encoding="UTF-8"?>
<rss xmlns:content="http://purl.org/rss/1.0/modules/content/" xmlns:dc="http://purl.org/dc/elements/1.1/" xmlns:rdf="http://www.w3.org/1999/02/22-rdf-syntax-ns#" xmlns:taxo="http://purl.org/rss/1.0/modules/taxonomy/" version="2.0">
  <channel>
    <title>question Re: SPARK Dataframe and IMPALA CREATE TABLE issue in Support Questions</title>
    <link>https://community.cloudera.com/t5/Support-Questions/SPARK-Dataframe-and-IMPALA-CREATE-TABLE-issue/m-p/55834#M22623</link>
    <description>&lt;P&gt;Thanks for the reply, The peace of code is mentioned below.&lt;/P&gt;&lt;P&gt;&amp;nbsp;&lt;/P&gt;&lt;P&gt;DataFrame right = sqlContext.read().jdbc(DB_CONNECTION, "testDB.tab2", props);&lt;BR /&gt;DataFrame joined = sqlContext.read().jdbc(DB_CONNECTION, "testDB.tab1", props).join(right, "id");&lt;BR /&gt;joined.write().jdbc(DB_CONNECTION, DB_TABLE3, props);&lt;/P&gt;&lt;P&gt;&amp;nbsp;&lt;/P&gt;&lt;P&gt;Its default file comma delimited format. Please find the full exception is mentioned below.&amp;nbsp;&lt;/P&gt;&lt;P&gt;&lt;BR /&gt;Exception in thread "main" java.sql.SQLException: [Simba][ImpalaJDBCDriver](500051) ERROR processing query/statement. Error Code: 0, SQL state: TStatus(statusCode:ERROR_STATUS, sqlState:HY000, errorMessage:AnalysisException: Syntax error in line 1:&lt;BR /&gt;....tab3 (id INTEGER , col_1 TEXT , col_2 DOUBLE PRECISIO...&lt;BR /&gt;^&lt;BR /&gt;Encountered: IDENTIFIER&lt;BR /&gt;Expected: ARRAY, BIGINT, BINARY, BOOLEAN, CHAR, DATE, DATETIME, DECIMAL, REAL, FLOAT, INTEGER, MAP, SMALLINT, STRING, STRUCT, TIMESTAMP, TINYINT, VARCHAR&lt;/P&gt;&lt;P&gt;CAUSED BY: Exception: Syntax error&lt;BR /&gt;), Query: CREATE TABLE testDB.tab3 (id INTEGER , col_1 TEXT , col_2 DOUBLE PRECISION , col_3 TIMESTAMP , col_11 TEXT , col_22 DOUBLE PRECISION , col_33 TIMESTAMP ).&lt;BR /&gt;at com.cloudera.hivecommon.api.HS2Client.executeStatementInternal(Unknown Source)&lt;BR /&gt;at com.cloudera.hivecommon.api.HS2Client.executeStatement(Unknown Source)&lt;BR /&gt;at com.cloudera.hivecommon.dataengine.HiveJDBCNativeQueryExecutor.executeHelper(Unknown Source)&lt;BR /&gt;at com.cloudera.hivecommon.dataengine.HiveJDBCNativeQueryExecutor.execute(Unknown Source)&lt;BR /&gt;at com.cloudera.jdbc.common.SStatement.executeNoParams(Unknown Source)&lt;BR /&gt;at com.cloudera.jdbc.common.SStatement.executeUpdate(Unknown Source)&lt;BR /&gt;at org.apache.spark.sql.DataFrameWriter.jdbc(DataFrameWriter.scala:302)&lt;BR /&gt;Caused by: com.cloudera.support.exceptions.GeneralException: [Simba][ImpalaJDBCDriver](500051) ERROR processing query/statement. Error Code: 0, SQL state: TStatus(statusCode:ERROR_STATUS, sqlState:HY000, errorMessage:AnalysisException: Syntax error in line 1:&lt;BR /&gt;....tab3 (id INTEGER , col_1 TEXT , col_2 DOUBLE PRECISIO...&lt;BR /&gt;^&lt;BR /&gt;Encountered: IDENTIFIER&lt;BR /&gt;Expected: ARRAY, BIGINT, BINARY, BOOLEAN, CHAR, DATE, DATETIME, DECIMAL, REAL, FLOAT, INTEGER, MAP, SMALLINT, STRING, STRUCT, TIMESTAMP, TINYINT, VARCHAR&lt;/P&gt;&lt;P&gt;CAUSED BY: Exception: Syntax error&lt;BR /&gt;), Query: CREATE TABLE testDB.tab3 (id INTEGER , col_1 TEXT , col_2 DOUBLE PRECISION , col_3 TIMESTAMP , col_11 TEXT , col_22 DOUBLE PRECISION , col_33 TIMESTAMP ).&lt;BR /&gt;... 7 more&lt;/P&gt;&lt;P&gt;&amp;nbsp;&lt;/P&gt;&lt;P&gt;&amp;nbsp;&lt;/P&gt;</description>
    <pubDate>Wed, 14 Jun 2017 06:33:53 GMT</pubDate>
    <dc:creator>Msdhan</dc:creator>
    <dc:date>2017-06-14T06:33:53Z</dc:date>
  </channel>
</rss>

