Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

OS Disk of HDP nodes in Azure using CloudBreak

SOLVED Go to solution
Highlighted

OS Disk of HDP nodes in Azure using CloudBreak

New Contributor

I'm using CloudBreak 2.6 for my HDP deployments onto Azure.

Currently can't see the option to set the size of the OS disk (you can set size of data disks only afaik).
The default OS Disk size in Azure is 30GB. That's way to small and Ambari is already alerting me about that (right after deployment). Is there any way I can make it bigger during deployment? My process is completely automated and would want to include that too.

1 ACCEPTED SOLUTION

Accepted Solutions

Re: OS Disk of HDP nodes in Azure using CloudBreak

New Contributor

Hello Jakub,

This feature is only supported since 2.7. Please upgrade your Cloudbreak to version 2.7 if it's possible, then in the Hardware and Storage step in Advanced View you are going to see the input field for it.

78495-screen-shot-2018-06-21-at-154714.png

In case of Azure sadly it's not enough to set the root volume size here, you also have to SSH into your instances and follow these steps:
https://docs.microsoft.com/en-us/azure/virtual-machines/linux/expand-disks

The feature works seamlessly on GCP and AWS, without additional steps.

3 REPLIES 3

Re: OS Disk of HDP nodes in Azure using CloudBreak

New Contributor

Hello Jakub,

This feature is only supported since 2.7. Please upgrade your Cloudbreak to version 2.7 if it's possible, then in the Hardware and Storage step in Advanced View you are going to see the input field for it.

78495-screen-shot-2018-06-21-at-154714.png

In case of Azure sadly it's not enough to set the root volume size here, you also have to SSH into your instances and follow these steps:
https://docs.microsoft.com/en-us/azure/virtual-machines/linux/expand-disks

The feature works seamlessly on GCP and AWS, without additional steps.

Re: OS Disk of HDP nodes in Azure using CloudBreak

New Contributor

Thanks @Attila Pálfi

So if I have to do this manually, there's no need for me to upgrade to 2.6 (even though I think I will anyway).

Also, wondering why this Root Volume Size option in CloudBreak, doesn't work with Azure. That's just an extra option in the API call / ARM template.

Re: OS Disk of HDP nodes in Azure using CloudBreak

New Contributor

@Jakub Igla

Without upgrading (and instead doing it manually) is not going to work.

You are right in that it is an extra property in the ARM template, although in case of Azure it is not enough to increase the root volume size in the ARM template. It's a necessary but not sufficient, because the OS will not be able to use the extended disc. This is why you have to follow these additional steps.

If you do not upgrade your Cloudbreak version to 2.7 and increase the root volume size in the UI, you will not be able to do these steps, because the physical disc size will still be 30G and the disk partition and file system will not be expandable.