Skip to main content
ARVINDR
ARVINDR
Gold ⭐️
March 3, 2020
Solved

How can we keep the data in 2 data centers in sync ?

Hi Team,

 

We have 12 nodes cluster hosted on premise in 2 different regions.

The question is how can we keep the data in 2 data centers in sync and what will be the latency.

 

Appreciate your help.

 

Thanks & Regards

 

StevenOD
StevenODAnswer
Platinum ⭐️
March 12, 2020

Hi @ARVINDR ,

 

I suggest you reach to Dell EMC for guidance around Isilon.

 

I found some documentation here:

 

https://www.dellemc.com/ro-ro/collaterals/unauth/white-papers/products/storage/h10588-isilon-data-availability-protection-wp.pdf

 

that suggests some techniques. I'll caveat that I'm not an expert in Isilon so my responses here are best endeavors.

 

Regards,

Steve

View in thread

8 replies

StevenOD
Platinum ⭐️
StevenOD
Platinum ⭐️
March 4, 2020

Hi @ARVINDR 

 

I'd like to clarify your scenario.  Do you have

 

A) 12 nodes in region A and 12 nodes in region B i.e. 2 distinct Cloudera clusters with a total of 24 nodes and you want to replicate data between these clusters?

 

or

 

B) 12 nodes split across regions A and B i.e. a single cluster of 12 nodes?

 

Also what version of Cloudera are you using?

 

Regards,

Steve

Translate
ARVINDR
ARVINDRAuthor
Gold ⭐️
March 4, 2020

Hi Steven,

Pls consider scenario A

 

A) 12 nodes in region A and 12 nodes in region B i.e. 2 distinct Cloudera clusters with a total of 24 nodes and we want to replicate data between these clusters

 

We are using version HDP 3.0.1 

 

Thanks & Regards

 

Translate
StevenOD
Platinum ⭐️
StevenOD
Platinum ⭐️
March 4, 2020

Hi @ARVINDR 

 

In this case, you would use Data Lifecycle Manager to replicate data between the two clusters.

 

Here is a link to the documentation:

 

https://docs.cloudera.com/HDPDocuments/DLM1/DLM-1.5.1/administration/content/dlm_hdfs_replication_overview_new.html

 

The latency will be a function of your network. I can share some general networking guidelines here:

 

https://docs.cloudera.com/documentation/other/reference-architecture/topics/ra_bare_metal_deployment.html#concept_qlk_mpk_v2b

 

Regards,

Steve

Translate
Terms & ConditionsAccessibility statement