Created on 06-08-2017 04:01 PM - edited 09-16-2022 04:43 AM
I created an external hive table pointing to directory
LOCATION '/user/hive/warehouse/logs'
Inside logs directory I have multiple subfolders as follows:
/user/hive/warehouse/logs/test/day=20170606 /user/hive/warehouse/logs/test/day=20170607 /user/hive/warehouse/logs/test/day=20170608
I have also used the config:
set hive.mapred.supports.subdirectories=true; set mapred.input.dir.recursive=true;
Using the 'hive' cli I am able to query the data and see the results
But when I perform query using Impala I see no results. Do i need to provide some configuration here
Created on 06-08-2017 07:00 PM - edited 06-08-2017 07:01 PM
Because you defined a new the table from outside of impala , you need to refresh hive metadata in impala.
fire this command in the impala-shell or Hue
INVALIDATE METADATA
You should be able to query the table
Created on 07-17-2017 07:32 AM - edited 07-17-2017 07:33 AM
Reading directories recursively isn't supported by Impala, only Hive. There is a closed JIRA asking for this to be added.