Support Questions
Find answers, ask questions, and share your expertise

How to create small files while inserting data to hive ORC table using TEZ

New Contributor

I have tried few options but I have only seen config settings to merge small files to big files like below but not vice versa.I am looking to create files of size 150kb .

set hive.merge.tezfiles=true; set hive.merge.smallfiles.avgsize=128000; set hive.merge.size.per.task=128000;