Created 06-06-2017 11:35 AM
while provisioning HDP cluster on cloud using cloudbreak, from where are the docker images of various hadoop services downloaded ?
Created 06-06-2017 11:46 AM
Are you looking out for something like this: http://sequenceiq.com/cloudbreak-docs/latest/#install-deployer
Pre-build cloudbreak deployer images. http://sequenceiq.com/cloudbreak-docs/latest/#pre-built-images
Created 06-06-2017 11:56 AM
@prachi sharma we are not using docker images on the provisioned cluster anymore but in the past we used this one https://github.com/sequenceiq/docker-ambari which contains an ambari. Ambari is a deployment tool which can deploy any service what you want .
Created 06-06-2017 11:58 AM
There are a couple of things. Cloudbreak by default does not use docker on the HDP cluster. If you enable docker based provisioning it pulls the images from docker hub, but it pulls the ambari-server and ambari-agent images only. The HDP components are NOT isolated into individual docker images they are all running in 1 single docker container (ambari-agent container). However the docker based deployment is disabled for a while now. The only time we use it is with the yarn-services and mesos as providers.
Created 06-07-2017 11:11 AM
Hi @khorvath ,
Why docker based deployment of hadoop services is not being used ? what are the issues in using the docker container based services ?
But as per https://hortonworks.com/blog/announcing-cloudbreak-1-2/ cloudbreak uses docker container technology to deploy clusters in cloud-agnostic way.
Created 04-16-2018 09:14 AM
Does this mean that Cloudbreak brings up an ambari server container and multiple ambari agent containers, which then will be extended with all executables and the configuration data for the user-chosen HDP services on these "nodes"?