Created on 06-23-202108:23 PM - edited on 06-24-202112:31 AM by subratadas
When a Hive replication policy executes in Replication Manager, the admin can monitor the details of the policy and its execution by checking the underlying command details on the Datalake cluster's CM.
An admin can determine further details about the policy by checking “All Recent Commands”.
The first step is the Export Metadata step that is performed on the source cluster. This setup in turn exports the data and metadata of the input Hive databases and tables specified in the policy.
From the command details, the admin can find logs of the check metadata step.
Next is the Import metadata step that updates the Hive database (and table) metadata for a given replication policy.
Finally, the last step imports the Exported Sentry permissions into Ranger policies on the Data Lake cluster.
If the above steps ran into an error, the admin can determine the specific error by checking the stderr logs of the specific step that ran into an error to troubleshoot the actual error.