Member since
01-20-2018
1
Post
0
Kudos Received
0
Solutions
01-20-2018
03:07 PM
Is there a way how I can disable creation of indices in ORC files for certain fields ? For example I don't want to create an index for payload type of fields which contains just base64 encoded content. I am having issues with OOM when working with ORC and unstructured data saved as base64 encoded content in HIVE. Such data varies in size dramatically from few kB to tens of MB and I think that unnecessary indices in ORC files may be the cause of such problem. Feel free to suggest any ORC file format configuration for payload data, basically BLOB's. Thanks.
... View more
Labels: