Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

memory usage by mapreduce job varies

memory usage by mapreduce job varies

Contributor

Hello All,

 

I observed in our cluster environment that one job is taking 100gb of memory and sometimes it is taking 2gb of memory(even though memory is available).

 

Please suggest.

 

Thanks,

Priya

2 REPLIES 2

Re: memory usage by mapreduce job varies

Super Collaborator

Is it mapreduce or Spark?

 

Mapreduce can vary since it's depend on number of mappers and reducers and mainly mappers.

Re: memory usage by mapreduce job varies

Contributor
Hi Fawze,

It's mapreduce, thanks for inputs.


Don't have an account?
Coming from Hortonworks? Activate your account here