Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

docker container images for various hadoop services.

docker container images for various hadoop services.

New Contributor

while provisioning HDP cluster on cloud using cloudbreak, from where are the docker images of various hadoop services downloaded ?

5 REPLIES 5

Re: docker container images for various hadoop services.

Super Mentor

Re: docker container images for various hadoop services.

Expert Contributor

@prachi sharma we are not using docker images on the provisioned cluster anymore but in the past we used this one https://github.com/sequenceiq/docker-ambari which contains an ambari. Ambari is a deployment tool which can deploy any service what you want .

Re: docker container images for various hadoop services.

Expert Contributor

Hi,

There are a couple of things. Cloudbreak by default does not use docker on the HDP cluster. If you enable docker based provisioning it pulls the images from docker hub, but it pulls the ambari-server and ambari-agent images only. The HDP components are NOT isolated into individual docker images they are all running in 1 single docker container (ambari-agent container). However the docker based deployment is disabled for a while now. The only time we use it is with the yarn-services and mesos as providers.

Re: docker container images for various hadoop services.

New Contributor

Hi @khorvath ,

Why docker based deployment of hadoop services is not being used ? what are the issues in using the docker container based services ?

But as per https://hortonworks.com/blog/announcing-cloudbreak-1-2/ cloudbreak uses docker container technology to deploy clusters in cloud-agnostic way.

Highlighted

Re: docker container images for various hadoop services.

New Contributor

Does this mean that Cloudbreak brings up an ambari server container and multiple ambari agent containers, which then will be extended with all executables and the configuration data for the user-chosen HDP services on these "nodes"?