The "msck repair table ..." command does not really read new data files, but adds new partitions (subdirectories in HDFS) in table metadata. What you could do is to create in advance all the partitions (for month or more) - initially empty- and run the "repair" command just once: hdfs dfs -mkdir /user/data/year=2021/month=04/day=1 ... hdfs dfs -mkdir /user/data/year=2021/month=04/day=30 hive>msck repair table <table_name>   When You put your log files inside one of these directories, they will be immediately visible from Hive (just set the correct permissions using Ranger or hdfs).   Maybe You can repeat this operations (create directories and "repair table") during logs maintenance, as you should have some policies to remove old logs   Hope this helps ... View more

hive-site.xml   It is also mentioned in another community post https://community.cloudera.com/t5/Support-Questions/Hive-hive-exec-parallel-property/td-p/49473 ... View more

Please find here the Apache Hive tutorial and more information on selecting distinct values under the Aggregations section.   For more on the Apache Hive content roadmap, please refer to our documentation. ... View more

Hi,  Can someone please help me.   Thank you ... View more

@tusharkathpal  okay got it thank you....!   So, here I need to export data from hive/impala into RDBMS table.   Can I export data into MySQL table which have already have some records, previously.. will the export delete the existing data in the MYSQL table?   We are planning to export 1 year data from impala to MySQL table. Can you please help with suggestion.   Thank You ... View more