question Re: Adding new gateway to Hadoop cluster in Support Questions

Adding new gateway to Hadoop cluster

AnandMS — Mon, 21 Nov 2016 08:47:37 GMT

We have a requirement to add a new gateway to hadoop cluster in additional to the one we already have. I have a couple of queries if anyone can help.

1. Are there any concerns in adding multiple gateways to a CDH cluster?

2. I came across the below article describing how to set up a gateway outside the cluster.

https://cloudera-portal.force.com/articles/KB_Article/Install-Cloudera-Client-on-non-Cloudera-server?popup=false&navBack=H4sIAAAAAAAAAIuuVipWslLyzssvz0lNSU_1yM9NVdJRygaKFSSmp4ZkluSA-KVAvn58aaZ-NkyhPpCDosu-ODWxKDnDVqk2FgDeHqwIVQAAAA

We have a kerberized cluster. Is it recommended to set up a gateway outside and will it be possible to submit jobs from this external gateway? (We have Oozie and Httpfs services running in a different host within the cluster). Are there any disadvantages to this approach?

Thank you in advance for your valuable inputs.

Re: Adding new gateway to Hadoop cluster

roczei — Mon, 21 Nov 2016 17:12:46 GMT

Hello,

You can add as many gateways as you want. If you add a gateway outside of Cloudera Manager then the only disadvantage is that you need to do every step manually. For example these:

installation of client configurations
installation of client packages
configuration of kerberos (/etc/krb5.conf)
etc.

Gabor

Re: Adding new gateway to Hadoop cluster

AnandMS — Tue, 22 Nov 2016 09:24:04 GMT

@roczei Thank you for your response.

Do you mean to say that functionally, there will be no difference in a gateway set up outside? I can submit applications and access HDFS as I would do from a gateway within the cluster, correct?

Re: Adding new gateway to Hadoop cluster

roczei — Tue, 22 Nov 2016 09:30:45 GMT

@AnandMSYes.

Re: Adding new gateway to Hadoop cluster

AnandMS — Tue, 22 Nov 2016 09:38:45 GMT

Thank you.