Reply
Explorer
Posts: 104
Registered: ‎09-14-2016

sqoop question

Hi,

 

I have an issue with sqoop, i have a staging table which is a copy from prod, so i did a sqoop from the staging table, after that, i did an incremental append from the prod to sqoop the missing ones, it says completed and shows the correct last value, but in hive i dont see the new ones.

 

Is it boz it remembers they are from different databases? i use the same target-dir

 

Thanks

Shannon

Highlighted
Champion
Posts: 467
Registered: ‎05-16-2016

Re: sqoop question

[ Edited ]

Does your hive table location points to the that same target-dir ? if so then perform the REFRESH command. 

since you you had addedd  new data files into the HDFS data directory for the table.

 

try the below command and fire the hive command once again .

REFRESH database_name.table_name;

 

Let me know if that helps ? 

Announcements