Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Deploying hadoop cluster

Solved Go to solution
Highlighted

Deploying hadoop cluster

New Contributor

I want to set up hadoop cluster where i want master node and few slave node to be in some country and remaining slave nodes sitting in different country. Is it possible to deploy this? Is there any article or tutorial which might help me to get the solution.

1 ACCEPTED SOLUTION

Accepted Solutions
Highlighted

Re: Deploying hadoop cluster

Hi @Kabirdas B K yes that's possible, you can just add remote nodes like local nodes, and yes you can set rack awareness, but it's not recommended because the performance, for example when running jobs can be very poor. Here is one such experience.

View solution in original post

5 REPLIES 5
Highlighted

Re: Deploying hadoop cluster

Mentor

Of course that possible. This doc could help you Topology scripts are used by Hadoop to determine the rack location of nodes

Topology configuration

Highlighted

Re: Deploying hadoop cluster

Hi @Kabirdas B K yes that's possible, you can just add remote nodes like local nodes, and yes you can set rack awareness, but it's not recommended because the performance, for example when running jobs can be very poor. Here is one such experience.

View solution in original post

Re: Deploying hadoop cluster

This! You can but you shouldn't. Cross-datacenter hadoop clusters do not perform. Don't do it.

Use data replication software like DistCP or Falcon to sync clusters in different data centers instead.

Highlighted

Re: Deploying hadoop cluster

Mentor

Do not do it! @Kabirdas B K

Highlighted

Re: Deploying hadoop cluster

@Kabirdas B K

I don't recommend doing this. It's possible but not the best practice. You can setup DR using Falcon or WanDisco.

Don't have an account?
Coming from Hortonworks? Activate your account here