Reply
Highlighted
New Contributor
Posts: 3
Registered: ‎07-12-2016

Multinode docker based installation

Hi Folks,

 

Has anyone successfully deployed a docker image based multinode cluster of Cloudera?

 

I am aware of the single-node all-in-one docker container from cloudera. But haven't found a guide to manage multi-node CDH cluster on docker. 

 

Is docker supported for multi-node cluster installation?

 

If yes, then it would be really useful to manage such a docker based cluster using kubernetes or similar container orchestration engine? 

 

Any thoughts?

New Contributor
Posts: 3
Registered: ‎07-12-2016

Re: Multinode docker based installation

Would appreciate any pointers on this from the cloudera experts. Thanks!

New Contributor
Posts: 3
Registered: ‎07-15-2016

Re: Multinode docker based installation

A quick reply would be highly appreciated

Cloudera Employee
Posts: 54
Registered: ‎07-19-2016

Re: Multinode docker based installation

Stay tuned. ;)

New Contributor
Posts: 3
Registered: ‎07-12-2016

Re: Multinode docker based installation

Posts: 354
Topics: 162
Kudos: 60
Solutions: 27
Registered: ‎06-26-2013

Re: Multinode docker based installation

New Contributor
Posts: 3
Registered: ‎07-15-2016

Re: Multinode docker based installation

I get the below error while starting multinode cdh clusterdock installation. Please help me resolve if anyoe has faced the same issue

 

[root@fmdcppxeon01 ~]# clusterdock_run ./bin/start_cluster cdh 
INFO:clusterdock.topologies.cdh.actions:Pulling image docker.io/cloudera/clusterdock:cdh580_cm581_primary-node. This might take a little while...
Trying to pull repository docker.io/cloudera/clusterdock ...
sha256:9feffbfc5573262a6efbbb0a969efde890e63ced8a4ab3c9982f4f0dc607e429: Pulling from docker.io/cloudera/clusterdock
Digest: sha256:9feffbfc5573262a6efbbb0a969efde890e63ced8a4ab3c9982f4f0dc607e429
Status: Image is up to date for docker.io/cloudera/clusterdock:cdh580_cm581_primary-node
INFO:clusterdock.topologies.cdh.actions:Pulling image docker.io/cloudera/clusterdock:cdh580_cm581_secondary-node. This might take a little while...
Trying to pull repository docker.io/cloudera/clusterdock ...
sha256:251778378b362adff4e93b99d423848216e4823965dabd1bd4c41dbb4c79afcf: Pulling from docker.io/cloudera/clusterdock
Digest: sha256:251778378b362adff4e93b99d423848216e4823965dabd1bd4c41dbb4c79afcf
Status: Image is up to date for docker.io/cloudera/clusterdock:cdh580_cm581_secondary-node
INFO:clusterdock.cluster:Successfully started node-2.cluster (IP address: 192.168.123.5).
INFO:clusterdock.cluster:Successfully started node-1.cluster (IP address: 192.168.123.4).
INFO:clusterdock.cluster:Started cluster in 6.67 seconds.
INFO:clusterdock.topologies.cdh.actions:Changing server_host to node-1.cluster in /etc/cloudera-scm-agent/config.ini...
INFO:clusterdock.topologies.cdh.actions:Restarting CM agents...
cloudera-scm-agent is already stopped
Starting cloudera-scm-agent: bash: /var/log/cloudera-scm-agent/cloudera-scm-agent.out: No such file or directory
[FAILED]
cloudera-scm-agent is already stopped
Starting cloudera-scm-agent: bash: /var/log/cloudera-scm-agent/cloudera-scm-agent.out: No such file or directory
[FAILED]

Fatal error: run() received nonzero return code 1 while executing!

Requested: service cloudera-scm-agent restart
Executed: /bin/bash -l -c "service cloudera-scm-agent restart"

Fatal error: run() received nonzero return code 1 while executing!

Requested: service cloudera-scm-agent restart
Executed: /bin/bash -l -c "service cloudera-scm-agent restart"

Aborting.

Aborting.

Fatal error: One or more hosts failed while executing task '_task'

Aborting.
INFO:clusterdock.topologies.cdh.actions:Waiting for Cloudera Manager server to come online...

 

Announcements