@MichaelPlet, Has the reply helped resolve your issue? If so, please mark the appropriate reply as the solution, as it will make it easier for others to find the answer in the future.   ... View more

@hanumanth, have any if the replies helped resolve your issue? If so, please mark the appropriate reply as the solution, as it will make it easier for others to find the answer in the future.   ... View more

Great, thanks ... View more

Hi @Yosieam    Thanks for sharing the code. You forgot to share the spark-submit/pyspark command. Please check what is executor/driver memory is passed to the spark-submit. Could you please confirm file is in local system/hdfs system.   ... View more

The issue is resolved by adding Stored as textfile in the table creation query. CREATE External TABLE GeoIP2_ISP_Blocks_IPv4 ( Client string, ID int, Number int, Name string, ) ROW FORMAT DELIMITED FIELDS TERMINATED BY ',' Stored as textfile    <---------------------- this new line needs to be added WITH SERDEPROPERTIES ( "separatorChar" = "\,", "quoteChar" = "\"" ) LOCATION 'hdfs:///user/hive/warehouse/tips/' tblproperties ("skip.header.line.count"="1");   Cloudera has changed the default file format from txt to parquet. So we need to specify this line for text files.   Thanks @mszurap  for the help.   ... View more

HI @shivam0408 , Can you clarify what CDH/HDP/CDP version are you using and what is the datatype of the "DATETIME" column?  What is the desired end result of this command? To drop all the partitions? ... View more

Thanks Guys. ... View more

Thanks @mszurap for your quick response. 🙂   ... View more

I'm sure my source code file has UTF-8 encoding and I compiling the class by maven. When my SQL is set to ： upsert into user_info(id, name, address, email, insert_time) values (?,cast(? as string),cast(? as string),?,?) it's works, but the url  parameter “UseNativeQuery=1” does't works!   ... View more

Hi Andrea, Great to see that it has been found now and thanks for marking the post as answered. All the best, Miklos  ... View more