@smkmuthu, Has the reply helped resolve your issue? If so, please mark the appropriate reply as the solution, as it will make it easier for others to find the answer in the future.  If you are still experiencing the issue, can you provide the information as requested? ... View more

You can use a script like this to create snapshots of old and new files - i.e. search files which are older than 3 days and search for files which are newer than 3 days, just make sure, you use the correct path to the cloudera jars. In the case of CDH5.15:   #!/bin/bash now=`date +"%Y-%m-%dT%H:%M:%S"` hdfs dfs -rm /data/cleanup_report/part=older3days/* hdfs dfs -rm /data/cleanup_report/part=newer3days/* hadoop jar /opt/cloudera/parcels/CDH/jars/search-mr-1.0.0-cdh5.15.1.jar org.apache.solr.hadoop.HdfsFindTool -find /data -type d -mtime +3 | sed "s/^/${now}\tolder3days\t/" | hadoop fs -put - /data/cleanup_report/part=older3days/data.csv hadoop jar /opt/cloudera/parcels/CDH/jars/search-mr-1.0.0-cdh5.15.1.jar org.apache.solr.hadoop.HdfsFindTool -find /data -type d -mtime -3 | sed "s/^/${now}\tnewer3days\t/" | hadoop fs -put - /data/cleanup_report/part=newer3days/data.csv   Then create an external table with partitions on top of this HDFS folder. ... View more

Glad to hear that the issue is resolved. You can either create local folder & give permissions or Hive will create hive.exec.local.scratchdir & provide permissions as configured in hive.scratch.dir.permission Provided if the user is having privileges on parent directory. If my answer helped to resolve the issue, accept the answer. It might help others in the community. ... View more

@Muthukumar Somasundaram Formatting is not an ideal option to solve this issue. In this case, you lost all your data. ... View more

Hi Jonathan Finally Issue is resolved now. Initially, I tried hdp 2.6 in RHEL 7.2 it gave me the error. So i tried using RHEL 7.4 Hope its due to compatibility issues. everything is fine in RHEL 7.4 One quick question to you. Is compatibility matrix link available for partners in community site? When I checked it asked for customer login or employee login. Any sugestions. Thx Muthu ... View more

Hi, this Looks like fifo-scheduling / capacity scheduling with 1 group only Try to switch to fair scheduling in yarn. Regards, Volker ... View more