Posts: 9
Registered: ‎04-20-2019

Update a dimension table -scd2

[ Edited ]

Hi Team

We are in process of converting existing dwh to hdfs based,we have a dim table which is being scd2 updated/inserted in parallel by various batches based on various sources ,how can we achieve this in hadoop .
Is there a way to ensure data consistency and also keep parallel upate/insert by several batches in same dim table.separate batches will work on different rows in dim based on source system /product.