Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Sqoop Merge in Hive External table with date partitions

Solved Go to solution

Sqoop Merge in Hive External table with date partitions

Problem Description : Sqoop is pushing data daily from MSSQL to HDFS location in date format like year/month/day (one pull daily for delta of data) and on top of it, created external Hive table. But Past data at source RDBMS is getting updated frequently so sqoop has to pull and merge those changes with already pulled data in HDFS. With that, I want to delete data that is 60 days old. Is there any way to achieve it. Can partitions in Hive resolve it. 

1 ACCEPTED SOLUTION

Accepted Solutions
Highlighted

Re: Sqoop Merge in Hive External table with date partitions

Contributor
1 REPLY 1
Highlighted

Re: Sqoop Merge in Hive External table with date partitions

Contributor
Don't have an account?
Coming from Hortonworks? Activate your account here