@Airawat Just FYI, the new 1.16.5 version has become live on Marketplace, you can try it out, it includes the Availability Set fix - one AS can be assigned to multiple hostgroups - and Premium Managed Disk support too. Hope it helps! ... View more

@Airawat One can burn their custom images for HDP over Cloudbreak with the help of this repository, there is quite extensive documentation there. RHEL images can be burnt with setting the following parameters properly: AZURE_IMAGE_PUBLISHER (OpenLogic|RedHat) AZURE_IMAGE_OFFER (CentOS|RHEL) AZURE_IMAGE_SKU (6.8|7.2) The new images can be registered into Cloudbreak without the need to publish them into Azure Marketplace. Hope this helps! ... View more

@Airawat Your issue seems to be valid but unfortunately currently this is not possible as each availability set can be assigned to at most one hostgroup. I have filed a ticket so this restriction will be removed in a future release. ... View more

@Amey Hegde There are the two ways to achieve this as follows: The most cost effective way of doing this is by using Cloudbreak shell to automate the cluster create and tear-down and schedule it with e.g. cron. You can even start the application with a post recipe. The other way is using time based autoscaling and keep the minimum nodes alive. Post recipes will run on upscale. In this case consider that data nodes should not be subject of downscale. Hope this helps! ... View more

@Tim Shephard You were right about WebHDFS not exposed, but HDFS UI is exposed via the NameNode service so it should be accessible if you enable "Protected Gateway Access to Cluster Components". If you would like to enable WebHDFS, there is a workaround: SSH to master node of the cluster Edit /srv/pillar/gateway/init.sls Add "WEBHDFS" to gateway:exposed like below: gateway: address: 172.21.250.198 exposed: [WEBHDFS] location: .... After save, run salt '*' state.highstate (this will regenerate Knox topology) Hope this helps! ... View more