Reply
Highlighted
New Contributor
Posts: 5
Registered: ‎03-03-2017

Hive Incremental Replication via BDR issue

[ Edited ]

Dear Team,

 

I am using BDR for HDFS and Hive Replication

1)HDFS Replication

       I am creating snapshots for all the required directory, so from next run only updated partition/folder is replicating in s3 

HDFS Replication is working fine

2)Hive Replication

       I was unable to do Incremental Hive updates from BDR[Hive Replication] to s3 ,each time complete data is being overwritten

 

Request your immense help to complete on same. Guide me the right approach to implement 

Announcements

Currently incubating in Cloudera Labs:

Envelope
HTrace
Ibis
Impyla
Livy
Oryx
Phoenix
Spark Runner for Beam SDK
Time Series for Spark
YCSB