Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Installing a CDH cluster using Vagrant / Docker

Highlighted

Installing a CDH cluster using Vagrant / Docker

Rising Star

Hello,

 

I have gone though the steps of installing a cloudera clusrter published by cloudera. one of the things which bothers me that it takes a long time to configure the VMs which are required to be a part of the cluster.

 

Has cloudera created steps to create a cluster using Vagrant?

 

like this one

 

https://github.com/dnafrance/vagrant-hadoop-spark-cluster

 

this not only creates hadoop clusters but also configures the VMs.

 

it will be nice to have soemthing like this for cloudera as well

3 REPLIES 3

Re: Installing a CDH cluster using Vagrant / Docker

If I read it right, the tool you pointed to installs Spark, Hadoop and
starts the services. Isn't this done for you when you install CDH using CM?

Cloudera did introduce a new product called Director in October last year.
You can read about here[1]. It is currently supports AWS but other
virtualization platforms are targeted for future versions.

[1] www.cloudera.com/director

Regards,
Gautam Gopalakrishnan

Re: Installing a CDH cluster using Vagrant / Docker

New Contributor

I would also like to know how to install CDH via Docker.  Unlike directly using Cloudera Manager, doing it via Docker allows us to build on the whole open Docker ecosystem of great tools, great flexibility, and great efficiency (compared to traditional VMs).  We could install multiple versions of CDH for testing, on one machine, using familar open tools and processes.

 

Re: Installing a CDH cluster using Vagrant / Docker

New Contributor

I haven't tried this yet, but it looks promising: https://github.com/lucamilanesio/docker-cdh5.4

Cheers!

Don't have an account?
Coming from Hortonworks? Activate your account here