@Msdhan   https://www.cloudera.com/documentation/enterprise/5-3-x/topics/impala_porting.html   According to the above link, Take out any CREATE INDEX, DROP INDEX, and ALTER INDEX statements, and equivalent ALTER TABLEstatements. Remove any INDEX, KEY, or PRIMARY KEY clauses from CREATE TABLE and ALTER TABLE statements. Impala is optimized for bulk read operations for data warehouse-style queries, and therefore does not support indexes for its tables.   Yes in general, you cannot achieve both Performance and Indexing. So if possible, you can try to control duplicate in the source (select) portion instead of target (insert) portion   Ex: insert into table trg_table  select * from src_table       ... View more

@SpoorthyB   Can you execute your query directly in Impala/Hive?   it may need detailed analysis, becuase   1. If your answer is yes for my above question, the similar issue "Resource temporarily unavailable error message from Impala shell " has already been discussed in this link   https://community.cloudera.com/t5/Interactive-Short-cycle-SQL/Resource-temporarily-unavailable-error-message-from-Impala-shell/m-p/27473#M874   2. if your answer is no then it might be an issue with ODBC (or) your network capacity issue for the table with huge size. ... View more

@SpoorthyB   Do you have kerberos enabled in your environment?   Also pls check that your issue is related to the one mentioned in this link https://issues.apache.org/jira/browse/IMPALA-5020   ... View more

@Venkatk99   Since the error shows HiveSQLException, keep the Spark aside and execute your different table combinations directly in hive and make sure there is no issue   You can check something like 1. make sure the datatype of col1, col2, col3.. coln from table 5 is exactly matches/compatable with 6 & 7 2. Also focus on  exception from log "Exception when trying to remove partition predicates: fail to find child from parent" etc   You can try to execute it from spark once all combinations of quires are working fine from hive     ... View more

@SpoorthyB   pls hide the confidential info and share the command that you have used ... View more

@jazzman71   I think there could be two possibilities for this issue   Posibility 1. As you said, this might be an issue with odbc command with parameter   Posibility 2. Hive is not recognizing the argument as '?' from your code. May be you can try with different argument  options as mentioned in this link   https://stackoverflow.com/questions/12464636/how-to-set-variables-in-hive-scripts     ... View more

@gbezrukikh   The default log path for "HiveServer2 Log Directory" is /var/log/hive, not sure the reson to keep it under /tmp/username   ok, for your problem, you can set the max log size, also limit the number of log file backup as follows: Ex:  HiveServer2 Max Log Size to 200 MiB HiveServer2 Maximum Log File Backups to 10   This will help to limit the log growth   Note: This is cloudera name, pls use the corresponding xml property name ... View more

@HMC   Try this link it may help you     https://community.cloudera.com/t5/Batch-SQL-Apache-Hive/hive-authentication/m-p/56674#M2087   https://www.cloudera.com/documentation/cdh/5-0-x/CDH5-Installation-Guide/cdh5ig_hue_config.html#topic_15_6_8_unique_1     ... View more

@littlewolf   Pls refer the below links for time series queries, it may help you (i am not a java resource)   https://github.com/jrachiele/java-timeseries   https://github.com/jrachiele/java-timeseries/blob/master/src/test/java/timeseries/models/MeanModelSpec.java ... View more