Member since
07-24-2019
21
Posts
0
Kudos Received
0
Solutions
06-27-2021
01:15 AM
Hi All I am working for a customer to set up a DR environment. Customer has created a DR as a Separate instance of Cloudera and PROD is a different instance. The replication is schedule-based as of now. Can we use Kafka production offset location in DR instance? the customer is working on replication of Hive data and Kafka topics. ? will this work out ? What is the ideal way to restore a streaming job in DR when PROD is down? Any best practices? Let me know if you need more details. Thanks in advance Muthu
... View more
Labels:
- Labels:
-
Apache Kafka
08-04-2019
10:06 AM
Hi All
I am trying to achieve similar functionality to below Unix command in HDFS level.
find /temp -name '*.avro' -cnewer sample.avro
or to retrieve the files greater than a specific timestamp from HDFS level.
From the Hadoop documentation I came to know that we have limited functionality of
https://hadoop.apache.org/docs/r2.7.1/hadoop-project-dist/hadoop-common/FileSystemShell.html#find
Let me know how this can be achieved in Hadoop level. Any workarounds.
Thanks - Muthu
... View more
Labels:
- Labels:
-
Apache Hadoop