I have a process that will push rows to an external table, it shall push around 500M cdr per day.
the external tables is using orc file with the following config:
what is the max records i go to while writing the files? to get the advantage of minimizing the number of generated files
And the other params used above, are the default per the product.. When should i tune these parameters?