question Re: How do I automate installation of Cloudera CDH on 100 Node cluster without using Cloudera manage in Archives of Support Questions (Read Only)

How do I automate installation of Cloudera CDH on 100 Node cluster without using Cloudera manager?

clouderazone — Fri, 16 Sep 2022 09:49:57 GMT

How do I install Cloudera CDH on 100 Node cluster without using Cloudera manager? Installing and configuring CDH manually on each node in a cluster is a difficult task. What tools and technologies are used to automate the task in production?

Re: How do I automate installation of Cloudera CDH on 100 Node cluster without using Cloudera manage

sergevs — Thu, 26 Nov 2015 23:00:12 GMT

If you are going to use CDH 5.4 and CentOS 6, you can try https://github.com/sergevs/ansible-cloudera-hadoop

Let me to know if you have questions.

Regards,

Serge.

Re: How do I automate installation of Cloudera CDH on 100 Node cluster without using Cloudera manage

clouderazone — Mon, 30 Nov 2015 15:04:24 GMT

Thanks Sergevs for your response. Your answer is helpful if am using CDH 5.4 version. However am using CDH 4 on one cluster and CDH 5 on another cluster. Appreciate anyone's help in letting me know the overview of the tools and technologies used to automate CDH installation without Cloudera Manager.

Re: How do I automate installation of Cloudera CDH on 100 Node cluster without using Cloudera manage

valtri — Sun, 13 Dec 2015 23:34:08 GMT

We're using puppet in the production:

It is not "one-click" setup. But it is well described with examples.

We have cluster with 24 (+3) nodes (1 PB) and quite difficult environment (Kerberos enabled, with cross-realms, multihome network, HA enabled, ...).

Re: How do I automate installation of Cloudera CDH on 100 Node cluster without using Cloudera manage

clouderazone — Sun, 20 Dec 2015 08:48:52 GMT

Thanks Valtri. I will have a look into it and let me know for any queries or help.