Kafka offsets in DR scenario

[#1]

Hi All

I am working for a customer to set up a DR environment. 

Customer has created a DR as a Separate instance of Cloudera and PROD is a different instance.  The replication is schedule-based as of now. 

Can we use Kafka production offset location in DR instance? the customer is working on replication of Hive data and Kafka topics. ? will this work out ? 

What is the ideal way to restore a streaming job in DR when PROD is down? Any best practices? 

Let me know if you need more details. 

Thanks in advance

Muthu 

[#2 · Accepted solution]

You can check Kafka Mirror Maker here Set up MirrorMaker in Cloudera Manager , also if the 2 clusters are secured via kerberos and reside in 2 different realms you need to make sure there's trust between these 2 kerberos realms 

[#3]

I believe this is what you are looking for https://docs.cloudera.com/cdp-private-cloud-base/7.1.6/srm-using/topics/srm-migrating-consumer-group...

[#4]

@smkmuthu, Has the reply helped resolve your issue? If so, please mark the appropriate reply as the solution, as it will make it easier for others to find the answer in the future.  If you are still experiencing the issue, can you provide the information as requested?