Reply
Highlighted
Explorer
Posts: 14
Registered: ‎08-16-2016
Accepted Solution

Adding new gateway to Hadoop cluster

[ Edited ]

We have a requirement to add a new gateway to hadoop cluster in additional to the one we already have. I have a couple of queries if anyone can help.

 

1. Are there any concerns in adding multiple gateways to a CDH cluster?

 

2. I came across the below article describing how to set up a gateway outside the cluster.

 

https://cloudera-portal.force.com/articles/KB_Article/Install-Cloudera-Client-on-non-Cloudera-server...

 

We have a kerberized cluster. Is it recommended to set up a gateway outside and will it be possible to submit jobs from this external gateway? (We have Oozie and Httpfs services running in a different host within the cluster). Are there any disadvantages to this approach?

 

Thank you in advance for your valuable inputs.

Posts: 39
Topics: 0
Kudos: 11
Blog Posts: 0
Ideas: 0
Solutions: 5
Registered: ‎11-26-2015

Re: Adding new gateway to Hadoop cluster

Hello,

 

You can add as many gateways as you want. If you add a gateway outside of Cloudera Manager  then the only disadvantage is that you need to do every step manually. For example these:

 

  • installation of client configurations
  • installation of client packages
  • configuration of kerberos (/etc/krb5.conf)
  • etc.

Gabor

Explorer
Posts: 14
Registered: ‎08-16-2016

Re: Adding new gateway to Hadoop cluster

@roczei Thank you for your response.

 

Do you mean to say that functionally, there will be no difference in a gateway set up outside? I can submit applications and access HDFS as I would do from a gateway within the cluster, correct?

Posts: 39
Topics: 0
Kudos: 11
Blog Posts: 0
Ideas: 0
Solutions: 5
Registered: ‎11-26-2015

Re: Adding new gateway to Hadoop cluster

@AnandMSYes.

Explorer
Posts: 14
Registered: ‎08-16-2016

Re: Adding new gateway to Hadoop cluster

Thank you.

Announcements