Reply
Expert Contributor
Posts: 124
Registered: ‎08-07-2017

memory usage by mapreduce job varies

Hello All,

 

I observed in our cluster environment that one job is taking 100gb of memory and sometimes it is taking 2gb of memory(even though memory is available).

 

Please suggest.

 

Thanks,

Priya

Highlighted
Expert Contributor
Posts: 338
Registered: ‎01-25-2017

Re: memory usage by mapreduce job varies

Is it mapreduce or Spark?

 

Mapreduce can vary since it's depend on number of mappers and reducers and mainly mappers.

Expert Contributor
Posts: 124
Registered: ‎08-07-2017

Re: memory usage by mapreduce job varies

Hi Fawze,

It's mapreduce, thanks for inputs.


Announcements