Support Questions
Find answers, ask questions, and share your expertise

Falcon hdfs mirroring not working

Falcon hdfs mirroring not working

Explorer

I am trying to mirror between two clusters.

I followed this document which I think only mirrors between same cluster :

https://hortonworks.com/hadoop-tutorial/mirroring-datasets-between-hadoop-clusters-with-apache-falco...

But for some reason the replication is not going through.

Some initial questions are :

1. After creating a Falcon Cluster, how do we view it(s) definition? I had created two falcon clusters - one for the primary and another for the target. I would like to see the information falcon holds for them.

2. After creating the Falcon job, I am not able to see its definition. How to view that?

3. After executing a Falcon job how do we check the logs to see what it did and where it failed?

Appreciate the feedback.

2 REPLIES 2

Re: Falcon hdfs mirroring not working

Explorer

I pretty much followed what has been given in chapter 11 and 12 under :

https://hortonworks.com/hadoop-tutorial/create-falcon-cluster/

Except the one difference as I noted earlier was that I tried to replicate between two different clusters.

Re: Falcon hdfs mirroring not working

Rising Star

Check the documentation at http://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.5.3/bk_data-movement-and-integration/content/ind.... There's additional information in the guide. In particular, see "Locating and Managing Entities" in ch 11 and "Falcon logs" in ch 15.