Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

CLoudera quickstart VM - mapper speed

CLoudera quickstart VM - mapper speed

Explorer

I am using a computer of 8GB RAM and i installed cloudera quickstart vm on it. I used 5 GB from the 8 for the cloudera quick start VM and the rest for the computer.

The problem is that it is running map tasks very slow in files with size 400KB or above. I am using cloudera manager to adjust yarn values. i increased the yarn.app.mapreduce.am.mb to 1024mb instead of 128mb and i also did the same adjustment for mapreduce.map.memory.mb And for the heap size i raised it from 50mb to 512 mb. This raised the speed of the mapper slightly but not that much. Actually i did those changes based on other posts but really cant figure out how to correctly adjust them.

Is the slow speed caused by size i specified to the vm or the yarn adjustments.

please help me in that issue...