@Abdul Qadeer I see what are you asking. Basically you want your application to be run on dedicated nodemanager. You can have a look at YARN's node label feature. https://hadoop.apache.org/docs/stable/hadoop-yarn/hadoop-yarn-site/NodeLabel.html Please do let me know if this is not what you are looking for. ... View more

@kishore sanchina I had fixed it yesterday by increasing ulimit. Error shown in provided logs were pointing to ulimit issue. nofile is variable for number of open files and nproc is number of processes limit for hue user. ... View more

@Yibing Liu +1 to @Joy's answer. Also, I know you must have taken care of this, however if there are any state entries in /etc/hosts file, please remove that from all the agents. ... View more

@Saurabh Kumar Please have a look at below documents, this information is useful for recovery https://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.3.4/bk_upgrading_hdp_manually/content/configure-yarn-mr-22.html https://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.3.2/bk_upgrading_hdp_manually/content/start-webhcat-20.html https://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.4.2/bk_upgrading_hdp_manually/content/start-tez-22.html https://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.4.0/bk_installing_manually_book/content/upload_pig_hive_sqoop_tarballs_to_hdfs.html ... View more

@ripunjay godhani Don't mount all the partitions on same disk, it will create lot of disk I/O. I would suggest to partition the disk according to your requirement and use dedicated disks for each component like DNs/NNs etc. Also, Please have a look at below links for Hadoop performance tuning http://crazyadmins.com/tune-hadoop-cluster-to-get-maximum-performance-part-1/ http://crazyadmins.com/tune-hadoop-cluster-to-get-maximum-performance-part-2/ ... View more