So I had some internal discussion and the real answer is dynamic scaling down is hard to achieve. You can scale down using cloudbreak, but cloudbreak does a decommissioning of the service before it kills the docker image. So you can technically do it, but as you do, HDFS will try to relocate the replicas which is going to be time consuming. The alternate is to use something like WASB, where the data is not in HDFS local store but in WASB. The storage and compute are separate so you can turn down instances easily. ... View more

Hi guys, thanks so much for what a great tutorial @Shivaji Dutta I have been trying to recreate your tutorial but with Centos7 so, guys I have a problem creating the docker image with Centos7 actually because your script fails in the steps to start the services as ssh and the other stuff. I share with you the file to create the docker image and I hope you can give me a hand to run it. @Vincent Jiang @Hajime dockerfile.txt Thanks so much ... View more

An updated guide was published recently by Isilon, covering OneFS 8.0.0.x. It's titled the EMC Isilon OneFS with Hadoop and Hortonworks Installation Guide: http://www.emc.com/collateral/TechnicalDocument/docu71396.pdf ... View more

It's not clear which version of Ambari this is for. Maybe 2.0? Current steps (Ambari 2.1/2.2, HDP 2.3/2.4 and OneFS 7.2.1.2/8.0.0.1) for most easily completing Kerberos configuration are linked in answer to this question: https://community.hortonworks.com/questions/38583/configure-kerberos-using-ambari-with-emc-isilon.html ... View more