Reply
Expert Contributor
Posts: 115
Registered: ‎08-07-2017

memory usage by mapreduce job varies

Hello All,

 

I observed in our cluster environment that one job is taking 100gb of memory and sometimes it is taking 2gb of memory(even though memory is available).

 

Please suggest.

 

Thanks,

Priya

Expert Contributor
Posts: 334
Registered: ‎01-25-2017

Re: memory usage by mapreduce job varies

Is it mapreduce or Spark?

 

Mapreduce can vary since it's depend on number of mappers and reducers and mainly mappers.

Expert Contributor
Posts: 115
Registered: ‎08-07-2017

Re: memory usage by mapreduce job varies

Hi Fawze,

It's mapreduce, thanks for inputs.


Announcements