Guidance around setting right number for 'hive.exec.max.created.files'

[#1]

Hi, I'm looking for some guidance around setting hive.exec.max.created.files. Is there a formula or ratio to follow ahead of time to find a right number for my queries?

[#2]

@schauhan I could not find the answer. Really good question. @gopal @yzhang

[#3]

This is usually a symptom of the problem - general recommendation is to turn on

hive.optimize.sort.dynamic.partition=true;

to prevent partitioning+bucketing from blowing up HDFS file counts.

[#4]

are you facing this issue, while trying to load data in a large table.

[#5]

@schauhan are you still having issues with this? Can you accept best answer or provide your own solution?