To get a hive table to appear in impala I can do invalidate metadata on everything.
But that will be very memory intensive is there a way to invalidate metadata and just get this database invalidated.
Like say I have 100 schemas and I create a new one in hive say Ab.
Can I do something like invalidate metadata Ab.
I know this can be done on a table but what about a schema?
if you just fire the below command without table name .
INVALIDATE METADATA ;
All the table will be reloaded on the next access.
I dont have my vm to try ,let me know if that helps you .
possible recommendation for your consideration.
1. if you can create the same table in impala and avoid this costly process especially if you have 1000s of partition on your table.
2. if you just add a data file on the existing table then it is best to go with REFRESH statement over the above .