Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

How to leverage Hive Index

How to leverage Hive Index

New Contributor

I have a partitioned hive fact table, and created an index on columnA. The generated index files are partitioned in the same way as data files on HDFS.

 

What do I need to do to leverage the index when executing a query such as

 

select * from TableA where columnA="valueA" and partition_key="keyValue".

 

 

I read some paper what generate compact file from index file, and specify as hive.index.compact.file ="..."

 

This practice might work for non-partitioned table.

 

Whether hive execution engine is smart enough to pick up index file automatically?


Thanks


Fred

1 REPLY 1

Re: How to leverage Hive Index

New Contributor

Hi,

 

There are a couple of steps to be done to be able to use an index.

 

Also multiple index use, I still cannot do.

 

You can check the following links for furhter information.

 

http://maheshwaranm.blogspot.com.tr/2013/09/hive-indexing.html

 

http://mail-archives.apache.org/mod_mbox/hive-user/201205.mbox/%3C60367909.283357.1337221656873.Java...

 

Hope it helps,

 

 

Don't have an account?
Coming from Hortonworks? Activate your account here