@Jay , actually I was asking about disk configuration as RAID configuration , lets say we have cluster HDP 2.6.4 with that details: 1) Worker-> (OS) Raid1 + Raid 5 2) Master -> (OS) Raid1 + Raid10 3) Kafka-> (OS) Raid1 + Raid10 based on that connfiguration , can we upgrade the HDP to 3.0 version ? dose HDP 3.0 support the above configuration ... View more

@jay regarding to upgrade to 3.0 version , we have versions as 2.6.4 so I guess it can be upgrade to 3.0 , do we need also to make storage changes in machines in the clusters ? , or just to upgrade the HDP without any disks changes ? ... View more

@Jay , thank you so much we do the testing and they are fine , now we need to do the steps VIA API ... View more

@Jay , great let me check your procedure on my cluster , I will update soon ... ... View more

@Akhil any suggestion regarding my comments ? ... View more

but files still not effected , seems this conf isnt work , or I miss something? ls -ltr total 1592376 -rw-r--r--. 1 mapred hadoop 268437275 Aug 22 2017 mapred-mapred-historyserver-master.sys64.com.log.6 -rw-r--r--. 1 mapred hadoop 268435538 Aug 28 2017 mapred-mapred-historyserver-master.sys64.com.log.5 -rw-r--r--. 1 mapred hadoop 268435639 Sep 2 2017 mapred-mapred-historyserver-master.sys64.com.log.4 -rw-r--r--. 1 mapred hadoop 268435470 May 30 10:02 mapred-mapred-historyserver-master.sys64.com.log.3 -rw-r--r-- 1 mapred hadoop 268441217 Jul 10 02:45 mapred-mapred-historyserver-master.sys64.com.log.2 -rw-r--r-- 1 mapred hadoop 268442505 Jul 16 01:17 mapred-mapred-historyserver-master.sys64.com.log.1 -rw-r--r-- 1 mapred hadoop 1477 Jul 19 15:28 mapred-mapred-historyserver-master.sys64.com.out.5 -rw-r--r-- 1 mapred hadoop 1687 Jul 25 17:51 mapred-mapred-historyserver-master.sys64.com.out.4 -rw-r--r-- 1 mapred hadoop 1477 Jul 29 15:17 mapred-mapred-historyserver-master.sys64.com.out.3 -rw-r--r-- 1 mapred hadoop 1477 Aug 1 19:30 mapred-mapred-historyserver-master.sys64.com.out.2 -rw-r--r-- 1 mapred hadoop 1687 Aug 7 11:48 mapred-mapred-historyserver-master.sys64.com.out.1 -rw-r--r-- 1 mapred hadoop 1477 Aug 8 17:09 mapred-mapred-historyserver-master.sys64.com.out -rw-r--r-- 1 mapred hadoop 19888308 Aug 8 17:20 mapred-mapred-historyserver-master.sys64.com.log ... View more

I set that under Custom mapred-site: and I restart the service ... View more

@Akhil thank you so much its works very cool , Another question regarding the configs.py lets say we want to add anew line as YARN_TEST=TEST in yarn-env template ( under Advanced yarn-env ) YARN_TEST=TEST ... View more