Member since
06-07-2016
2
Posts
0
Kudos Received
0
Solutions
05-25-2017
03:31 PM
Thanks, I didn't see this until after the struggle but this worked for me.
... View more
05-25-2017
03:25 PM
This ultimately lead me to the solution. I started by removing hive.tez.java.opts -Xmx200m which gave me a slightly higher value in my error message increased from 192 MB to the 245 MB show below but my sort size was still to big. tez.runtime.io.sort.mb 3244 should be larger than 0 and should be less than the available task memory (MB):245 Removing it here allows me to leave the sort size and task completes as expected. tez.task.launch.cmd-opts -Xmx256m{{heap_dump_opts}} CHANGED TO RECOMMENDED shown next.
-XX:+PrintGCDetails -verbose:gc -XX:+PrintGCTimeStamps -XX:+UseNUMA -XX:+UseParallelGC{{heap_dump_opts}}
... View more