Is it possible to perform HIVE data mirroring on different hive version using Falcon?

[#1]

Hi All,

We are performing HIVE Mirroring from Cluster1 with HIVE 1.2 to Cluster2 with HIVE 0.14 version and facing below issue:

SQLException

SQLException: Could not establish connection to jdbc:hive2://<host>:10000/falcon;principal=hive/<host>@<realm>: Required field 'client_protocol' is unset! Struct:TOpenSessionReq(client_protocol:null, configuration:{use:database=falcon})

We understand this is caused due to difference of HIVE and HIVE JDBC version.

Is there are way to resolve this?

[#2 · Accepted solution]

@Dhaval Modi:

Following is the prerequisites to use Hive Mirrroring

1. Hive 1.2.0+
2. Oozie 4.2.0+*

Falcon Hive Mirroring is not supported without those prerequisites.

Thanks!

[#3]

@Sowmya Ramesh: Does this prerequisites apply to both the clusters?

Currently, we are running on the mirroring job on cluster that follow the prerequisite.

[#4]

Yup.

The "EXPORT ... FOR REPLICATION" command was added only in 1.2.0+ , and this is used in the source cluster.

IMPORT semantics changing to allow for "import-only-if-newer" which is used to apply updates to a table in the destination cluster, which is used by HiveDR was also added only in 1.2.0+.

Thus, you will need 1.2.0+ on both clusters.