@Kumar Veerappan, is umask set properly in your cluster ? Refer to below article for details. https://community.hortonworks.com/content/supportkb/150234/error-path-disk3hadoopyarnlocalusercachesomeuserap.html ... View more

Zookeeper.out file contains log for zookeeper server. you can refer to below thread to enable log rotating for zookeeper. This way you can avoid too big log files. https://community.hortonworks.com/questions/39282/zookeeper-log-file-not-rotated.html ... View more

@Michael Bronson , Missing data block can be related to data corruption. Use 'hdfs fsck <path> -list-corruptfileblocks -files -locations' to find out which replicas got corrupted. Secondly, In order to fix issue, you can delete the corrupted blocks using 'hdfs fsck / -delete' I hope you find below thread useful for handing missing blocks. https://community.hortonworks.com/questions/17917/best-way-of-handling-corrupt-or-missing-blocks.html ... View more

There are multiple ways you can perform various operations on HDFS. You can choose any of the below approach as per your need. 1) Command Line Most of users use command line to interact with HDFS. HDFS CLI is easy to use. Its easy to automate with scripts. However, HDFS CLI need hdfs client installed on the host. 2) Java Api If you are familiar with Java and Apache Apis, You can choose to use Java api to communicate with HDFS Cluster. 3) Webhdfs This is rest api way of accessing HDFS. This approach does not require hdfs client to be installed on host. You can use this api to connect to remote HDFS cluster too. ... View more