Migrating data from SAP HANA to Hive

[#1]

Hi,

We have a large chunk of data which need to be migration from warehouse hosted in SAP HANA into Hadoop (Hive) as one time as well as schedule incremental loads. We were evaluating the options of

• Sqoop (which seems to have certain restrictions on the JDBC driver on performance front) and
• the two way approach of loading data from HANA into Flatfiles and then copy those files into Hive.

I would like to know if anyone has already done something similar and if they can share their experiences and the recommended methodology for the same.

Regards,

Phaneendra

[#2]

@Phaneendra S see this article which outlines all the different approaches.

https://community.hortonworks.com/content/kbentry/1154/hadoop-using-sap.html

The customers I have who are migrating data from HANA are using Sqoop. If you want an Enterprise solution, you should look into a solution like Attunity. Attunity provides you with realtime CDC.