@srowen Is 12 executors really necessary? Surely you just need a total of 12 cores (so you could have 1 executor with 12 cores). Is this what you mean by " Also, 1 core per executor is generally very low."? What happens when you have more cores than kafka partitions? will it generall run faster?
... View more