second when I saved the parameter in ambari - Ambari -> HDFS -> Configs -> Advanced -> Custom hdfs-site dfs.namenode.fs-limits.max-directory-items=2097152 I GET: The configuration changes could not be validated for consistency due to an unknown error. Your changes have not been saved yet. Would you like to proceed and save the changes? dose this parameter supported in HDP version - 2.6.4? ... View more

@Geoffrey Shelton Okot - do you mean to restart the ambari server ? as ambari server restart? instead to restart the HDFS and YARN services ? ( after we set dfs.namenode.fs-limits.max-directory-items ) ... View more

@Jay actually it should be like this hadoop fs -rm -r -skipTrash hdfs://hdfsha/tmp/hive/hive/* need to add the "*" after slash in order to delete only the folders under /tmp/hive/hive and not the sub folder itself (/tmp/hive/hive) ... View more

@Jay , in my cluster ( HDFS --> config ) I see dfs.nameservices=hdfsha , so it should be like this? hadoop fs -rm -r -skipTrash hdfs://hdfsha/tmp/hive/hive/ ... View more

@jay - nice I see there the option: hadoop fs -rm -r -skipTrash hdfs://mycluster/tmp/hive/hive/ this option will remove all folders under /tmp/hive/hive but what is the value - mycluster ? ( what I need to replace instead that ? ... View more

@jay - nice I see there the option: hadoop fs -rm -r -skipTrash hdfs://mycluster/tmp/hive/hive/ this option will remove all folders under /tmp/hive/hive but what is the value - mycluster ? ( what I need to replace instead that ? ... View more

and we have folder under /tmp/hive/hive so why cli return - Cannot find any scratch directory to clear [hdfs@master01 hive]$ hdfs dfs -ls /tmp/hive/hive Found 4 items drwx------   - hive hdfs          0 2019-06-16 21:58 /tmp/hive/hive/2f95f6a5-76ad-487e-968c-1873264a3a9c drwx------   - hive hdfs          0 2019-06-16 21:45 /tmp/hive/hive/368d201c-cedf-48dc-bbad-f13d6aed7016 drwx------   - hive hdfs          0 2019-06-16 21:58 /tmp/hive/hive/717fb013-535b-4279-a12e-4fc4261c4d68 drwx------   - hive hdfs          0 2019-06-16 21:46 /tmp/hive/hive/a58a19fe-2fc1-4b71-82ec-3307de8e2d56 ... View more

@Jay when I run it on test lab we get why ? [hive@master01 hive]$ hive --service cleardanglingscratchdir Cannot find any scratch directory to clear ... View more