Welcome to the Cloudera Community

Announcements
Celebrating as our community reaches 100,000 members! Thank you!

Who agreed with this topic

How to leverage Hive Index

avatar
New Contributor

I have a partitioned hive fact table, and created an index on columnA. The generated index files are partitioned in the same way as data files on HDFS.

 

What do I need to do to leverage the index when executing a query such as

 

select * from TableA where columnA="valueA" and partition_key="keyValue".

 

 

I read some paper what generate compact file from index file, and specify as hive.index.compact.file ="..."

 

This practice might work for non-partitioned table.

 

Whether hive execution engine is smart enough to pick up index file automatically?


Thanks


Fred

Who agreed with this topic