Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Multinode docker based installation

Multinode docker based installation

New Contributor

Hi Folks,

 

Has anyone successfully deployed a docker image based multinode cluster of Cloudera?

 

I am aware of the single-node all-in-one docker container from cloudera. But haven't found a guide to manage multi-node CDH cluster on docker. 

 

Is docker supported for multi-node cluster installation?

 

If yes, then it would be really useful to manage such a docker based cluster using kubernetes or similar container orchestration engine? 

 

Any thoughts?

6 REPLIES 6

Re: Multinode docker based installation

New Contributor

Would appreciate any pointers on this from the cloudera experts. Thanks!

Re: Multinode docker based installation

New Contributor

A quick reply would be highly appreciated

Re: Multinode docker based installation

Rising Star

Stay tuned. ;)

Re: Multinode docker based installation

New Contributor
Highlighted

Re: Multinode docker based installation

Master Collaborator

Re: Multinode docker based installation

New Contributor

I get the below error while starting multinode cdh clusterdock installation. Please help me resolve if anyoe has faced the same issue

 

[root@fmdcppxeon01 ~]# clusterdock_run ./bin/start_cluster cdh 
INFO:clusterdock.topologies.cdh.actions:Pulling image docker.io/cloudera/clusterdock:cdh580_cm581_primary-node. This might take a little while...
Trying to pull repository docker.io/cloudera/clusterdock ...
sha256:9feffbfc5573262a6efbbb0a969efde890e63ced8a4ab3c9982f4f0dc607e429: Pulling from docker.io/cloudera/clusterdock
Digest: sha256:9feffbfc5573262a6efbbb0a969efde890e63ced8a4ab3c9982f4f0dc607e429
Status: Image is up to date for docker.io/cloudera/clusterdock:cdh580_cm581_primary-node
INFO:clusterdock.topologies.cdh.actions:Pulling image docker.io/cloudera/clusterdock:cdh580_cm581_secondary-node. This might take a little while...
Trying to pull repository docker.io/cloudera/clusterdock ...
sha256:251778378b362adff4e93b99d423848216e4823965dabd1bd4c41dbb4c79afcf: Pulling from docker.io/cloudera/clusterdock
Digest: sha256:251778378b362adff4e93b99d423848216e4823965dabd1bd4c41dbb4c79afcf
Status: Image is up to date for docker.io/cloudera/clusterdock:cdh580_cm581_secondary-node
INFO:clusterdock.cluster:Successfully started node-2.cluster (IP address: 192.168.123.5).
INFO:clusterdock.cluster:Successfully started node-1.cluster (IP address: 192.168.123.4).
INFO:clusterdock.cluster:Started cluster in 6.67 seconds.
INFO:clusterdock.topologies.cdh.actions:Changing server_host to node-1.cluster in /etc/cloudera-scm-agent/config.ini...
INFO:clusterdock.topologies.cdh.actions:Restarting CM agents...
cloudera-scm-agent is already stopped
Starting cloudera-scm-agent: bash: /var/log/cloudera-scm-agent/cloudera-scm-agent.out: No such file or directory
[FAILED]
cloudera-scm-agent is already stopped
Starting cloudera-scm-agent: bash: /var/log/cloudera-scm-agent/cloudera-scm-agent.out: No such file or directory
[FAILED]

Fatal error: run() received nonzero return code 1 while executing!

Requested: service cloudera-scm-agent restart
Executed: /bin/bash -l -c "service cloudera-scm-agent restart"

Fatal error: run() received nonzero return code 1 while executing!

Requested: service cloudera-scm-agent restart
Executed: /bin/bash -l -c "service cloudera-scm-agent restart"

Aborting.

Aborting.

Fatal error: One or more hosts failed while executing task '_task'

Aborting.
INFO:clusterdock.topologies.cdh.actions:Waiting for Cloudera Manager server to come online...