> Below is the document which has some more details on the same: https://impala.apache.org/docs/build/html/topics/impala_upsert.html   > Please let us know what is your concerns. ... View more

@MOMIE2005 Has the reply helped resolve your issue? If so, please mark the appropriate reply as the solution, as it will make it easier for others to find the answer in the future.  ... View more

Hi,   Attached screenshot does not give more details, Do check application logs, HS2 logs and metastore logs to find out the more information.  Check if you have required resources in the cluster to run the query. Check if any JVM pauses due to out of memory. Check if the tables involved in this job is not using by anyone for writing etc...   Try to restart Hive and rerun the job again and check.   Regards, Chethan YM ... View more

Hi Chethan   Thanks for the reply as per your examples   1. select name from census where year=2010; This works fine ie it only queries the partition but our problem is when the condition is not a literal like ='2010' but when we try to dynamically retrieve the data like your second example   We are finding that the query scans the whole table not just the partition - ie takes much longer in larger tables   ... View more

Hi,   We need to check the HS2 logs and application logs if it is throwing any errors/exceptions for this query.   Regards, Chethan YM ... View more

Hi @Lobitojc ,   It seems to be a Hive BUG please refer the below Jira: https://issues.apache.org/jira/browse/HIVE-24998   Regards, Chethan YM ... View more

@Orcs    Hive aux JARs path In CDP Private Cloud Base, click Cloudera Manager > Clusters and select the HIVE. Click Configuration and search for Hive Auxiliary JARs Directory. Specify a directory value for the Hive Aux JARs property if necessary, or make a note of the path. Upload the JAR to the specified directory on all Hive metastore instances. Click Cloudera Manager > Clusters and select the HIVE-ON-TEZ. Click Configuration and search for Hive Auxiliary JARs Directory. Upload the JAR to the specified directory on all HiveServer instances.   ... View more

Hi Chethan, Thank you for the reply. The parcel version was selected automatically after we clicked 'download' in the Cloudera Manager. I suppose it is the correct version.    2022-05-24 11:04:57,774 INFO New I/O worker #340:com.cloudera.parcel.components.ParcelDownloaderImpl: Completed download of: https://archive.cloudera.com/kafka/parcels/latest/KAFKA-4.1.0-1.4.1.0.p0.4-el7.parcel   However from this page, it shows for CDH 6.3.4, the Apache Kafka version is 2.2.1 https://docs.cloudera.com/documentation/enterprise/6/release-notes/topics/rg_cdh_63_packaging.html   Not sure how the parcel version and Apache version relate to each other. We have the complete log file, but I hesitate to send the log here in an open forum. Is there a way to send to you in a protected mode? Thanks again! ... View more

Hi,   The above log snippet does not give enough details you need to check complete HS2 log file for any other related errors. This error occurs for multiple reasons.   1. Does it work for any other user? can you change the user and try? 2. Check if you have any permission issue for this path/user. 3. Is encryption zone enabled? can set the below property in the beeline and retry the query?      set hive.exec.scratchdir=.staging;   Regards, Chethan YM ... View more