Sqoop Merge in Hive External table with date partitions

RupinderKSishu — Wed, 21 Oct 2020 08:53:45 GMT

Problem Description : Sqoop is pushing data daily from MSSQL to HDFS location in date format like year/month/day (one pull daily for delta of data) and on top of it, created external Hive table. But Past data at source RDBMS is getting updated frequently so sqoop has to pull and merge those changes with already pulled data in HDFS. With that, I want to delete data that is 60 days old. Is there any way to achieve it. Can partitions in Hive resolve it.

Re: Sqoop Merge in Hive External table with date partitions

Mike in Austin — Thu, 22 Oct 2020 14:16:50 GMT

Here's a relevant community answer...

https://community.cloudera.com/t5/Support-Questions/How-to-use-merge-in-sqoop-import/td-p/161847

Mike

question Sqoop Merge in Hive External table with date partitions in Support Questions

Sqoop Merge in Hive External table with date partitions

Re: Sqoop Merge in Hive External table with date partitions