question Re: Is it possible to perform HIVE data mirroring on different hive version using Falcon? in Archives of Support Questions (Read Only)

Is it possible to perform HIVE data mirroring on different hive version using Falcon?

dhavalmodi24 — Thu, 07 Jul 2016 17:17:31 GMT

Hi All,

We are performing HIVE Mirroring from Cluster1 with HIVE 1.2 to Cluster2 with HIVE 0.14 version and facing below issue:

SQLException

SQLException: Could not establish connection to jdbc:hive2://<host>:10000/falcon;principal=hive/<host>@<realm>: Required field 'client_protocol' is unset! Struct:TOpenSessionReq(client_protocol:null, configuration:{use:database=falcon})

We understand this is caused due to difference of HIVE and HIVE JDBC version.

Is there are way to resolve this?

Re: Is it possible to perform HIVE data mirroring on different hive version using Falcon?

sramesh — Fri, 08 Jul 2016 02:04:03 GMT

@Dhaval Modi:

Following is the prerequisites to use Hive Mirrroring

Hive 1.2.0+
Oozie 4.2.0+*

Falcon Hive Mirroring is not supported without those prerequisites.

Thanks!

Re: Is it possible to perform HIVE data mirroring on different hive version using Falcon?

dhavalmodi24 — Fri, 08 Jul 2016 02:10:08 GMT

@Sowmya Ramesh: Does this prerequisites apply to both the clusters?

Currently, we are running on the mirroring job on cluster that follow the prerequisite.

Re: Is it possible to perform HIVE data mirroring on different hive version using Falcon?

sush — Fri, 08 Jul 2016 02:23:04 GMT

Yup.

The "EXPORT ... FOR REPLICATION" command was added only in 1.2.0+ , and this is used in the source cluster.

IMPORT semantics changing to allow for "import-only-if-newer" which is used to apply updates to a table in the destination cluster, which is used by HiveDR was also added only in 1.2.0+.

Thus, you will need 1.2.0+ on both clusters.