question Re: Cloudbreak is not picking my custom image in Support Questions

Cloudbreak is not picking my custom image

pmalla — Wed, 01 Nov 2017 17:43:19 GMT

Hi Team,

We are exploring Cloudbreak in Azure. We want to use our custom image for HDP installation as some libraries needs to be present in the cluster nodes.

As suggested in the article http://sequenceiq.com/cloudbreak-docs/master/images/, i have created "arm-images.yml" in etc directory in cloudbreak-deployment directory. The whole path is "/root/cloudbreak-deployment/etc".

below is the content in arm-images.yml file.

azure_rm:

East Asia: https://sequenceiqeastasia2.blob.core.windows.net/images/cb-2016-06-14-03-27.vhd

East US: https://mystoredisks1558.blob.core.windows.net/vhds/Hdptestimage120171031154408.vhd

Central US: https://sequenceiqcentralus2.blob.core.windows.net/images/cb-2016-06-14-03-27.vhd

North Europe: https://sequenceiqnortheurope2.blob.core.windows.net/images/cb-2016-06-14-03-27.vhd

South Central US: https://sequenceiqouthcentralus2.blob.core.windows.net/images/cb-2016-06-14-03-27.vhd

North Central US: https://sequenceiqorthcentralus2.blob.core.windows.net/images/cb-2016-06-14-03-27.vhd

East US 2: https://mystoredisks1558.blob.core.windows.net/vhds/Hdptestimage120171031154408.vhd

Japan East: https://sequenceiqjapaneast2.blob.core.windows.net/images/cb-2016-06-14-03-27.vhd

Japan West: https://sequenceiqjapanwest2.blob.core.windows.net/images/cb-2016-06-14-03-27.vhd

Southeast Asia: https://sequenceiqsoutheastasia2.blob.core.windows.net/images/cb-2016-06-14-03-27.vhd

West US: https://sequenceiqwestus2.blob.core.windows.net/images/cb-2016-06-14-03-27.vhd

West Europe: https://sequenceiqwesteurope2.blob.core.windows.net/images/cb-2016-06-14-03-27.vhd

Brazil South: https://sequenceiqbrazilsouth2.blob.core.windows.net/images/cb-2016-06-14-03-27.vhd

I have put my custom image path for East US and East US 2.

When i start deploying cluster it is taking the default image "https://sequenceiqeastus12.blob.core.windows.net/images/hdc-hdp--1706211640.vhd" came up with Cloudbreak.

i have checked the log, but did not get any related info.

Does any one have any idea.

Thanks in Advance....

Re: Cloudbreak is not picking my custom image

mmolnar — Mon, 27 Nov 2017 20:38:03 GMT

Hi @Paramesh malla,

it seems to me that there is a documentation error. Please modify your file and replace "azure_rm:" with "azure:"

You can check the current file here.

Re: Cloudbreak is not picking my custom image

pmalla — Thu, 18 Jan 2018 18:36:34 GMT

Hi @mmolnar,

Thanks, that worked.

But i am getting an error, as that image is not having public access. Any tip to resolve it other than giving publicly available image?

Re: Cloudbreak is not picking my custom image

darvasip — Fri, 19 Jan 2018 22:43:31 GMT

@Paramesh malla

You can use an Azure Shared Access Signature to restrict the access to your VHD based on time or access policy. You can generate the URL with Azure Storage Explorer like documented here and replace the original in arm-images.yml.

Re: Cloudbreak is not picking my custom image

pmalla — Wed, 21 Feb 2018 22:13:55 GMT

@pdarvasi

Hi,

Can i update and use new image, Once i launched the cluster with my custom image?

if so, can you tell me how?

Thanks in Advance.

Re: Cloudbreak is not picking my custom image

darvasip — Wed, 21 Feb 2018 22:18:33 GMT

@Paramesh malla

New images can only be applied to new clusters so it is not possible to replace an image of a running cluster.

Hope this helps!

Re: Cloudbreak is not picking my custom image

pmalla — Wed, 21 Feb 2018 22:22:13 GMT

@pdarvasi

Hi, thanks for your quick reply.

What if i want to update some configuration/package in image? is there any way? like can i run some command (through cloud break) after creating new VM from image?

Thanks Again.

Re: Cloudbreak is not picking my custom image

darvasip — Wed, 21 Feb 2018 22:25:39 GMT

@Paramesh malla

Yes, you can utilize the recipe functionality of Cloudbreak like documented here.