Do I need to size RAM differently for YARN worker nodes?

Hi everyone,

We’re setting up a few new worker nodes for our cluster and I’m stuck on memory. Our jobs are mostly Spark and Hive, and sometimes they run out of memory when a lot of them start at once.

The servers we picked take  and I’m trying to decide how much to put in each node. Is it better to fill all the slots now, or start smaller and add more later?

How much memory per worker node do you run, and has it been enough? I’d love to hear what worked for you.

Thanks!