Support Questions
Find answers, ask questions, and share your expertise

memory usage by mapreduce job varies

Contributor

Hello All,

 

I observed in our cluster environment that one job is taking 100gb of memory and sometimes it is taking 2gb of memory(even though memory is available).

 

Please suggest.

 

Thanks,

Priya

2 REPLIES 2

Super Collaborator

Is it mapreduce or Spark?

 

Mapreduce can vary since it's depend on number of mappers and reducers and mainly mappers.

Contributor
Hi Fawze,

It's mapreduce, thanks for inputs.


Take a Tour of the Community
Don't have an account?
Your experience may be limited. Sign in to explore more.