Great, thanks ... View more

Hi @Yosieam    Thanks for sharing the code. You forgot to share the spark-submit/pyspark command. Please check what is executor/driver memory is passed to the spark-submit. Could you please confirm file is in local system/hdfs system.   ... View more

The issue is resolved by adding Stored as textfile in the table creation query. CREATE External TABLE GeoIP2_ISP_Blocks_IPv4 ( Client string, ID int, Number int, Name string, ) ROW FORMAT DELIMITED FIELDS TERMINATED BY ',' Stored as textfile    <---------------------- this new line needs to be added WITH SERDEPROPERTIES ( "separatorChar" = "\,", "quoteChar" = "\"" ) LOCATION 'hdfs:///user/hive/warehouse/tips/' tblproperties ("skip.header.line.count"="1");   Cloudera has changed the default file format from txt to parquet. So we need to specify this line for text files.   Thanks @mszurap  for the help.   ... View more

Thanks Guys. ... View more

Thanks @mszurap for your quick response. 🙂   ... View more

I'm sure my source code file has UTF-8 encoding and I compiling the class by maven. When my SQL is set to ： upsert into user_info(id, name, address, email, insert_time) values (?,cast(? as string),cast(? as string),?,?) it's works, but the url  parameter “UseNativeQuery=1” does't works!   ... View more

Hi Andrea, Great to see that it has been found now and thanks for marking the post as answered. All the best, Miklos  ... View more

Hi @tallamohan  The direct usage of the Hive classes (CliSessionState, SessionState, Driver) in the provided code falls under the "Hive CLI" or "Hcat CLI" access, which is not supported in CDP: https://docs.cloudera.com/cdp-private-cloud-upgrade/latest/upgrade/topics/hive-unsupported.html Please open a case on MyCloudera Support Portal to get that clarified. The recommended approach would be to use beeline and access the Hive service through HiveServer2.   Best regards  Miklos ... View more

@mszurap  Thanks for your detailed explanation this certainly helps. ... View more

That is great, thank you for sharing the solution!    Best regards  Miklos ... View more