Created on 10-01-2018 01:15 AM - edited 09-16-2022 06:45 AM
Hi All,
I have installed Cloudera 5.13 and given 9 gb + 2 cores. When i run spark2-shell, it takes a very long time and system slows down. I am not able to perform any task.My total system RAM is 12 gb (8 gb + 4 gb)
Please suggest any configuration changes.
Thanks,
Nishikant
Created 10-01-2018 03:47 AM
Created 10-01-2018 04:25 AM
Created 10-01-2018 08:38 AM
Created 10-01-2018 08:52 AM
yes, when testing on a limited-resource VM, I shut down anything I don't need.
Still, with limited resources, don't expect awesome performance. If you are using YARN, that spins up containers that will require memory as well.
If you have Cloudera Manager installed, it is what you use to start and stop all hadoop roles.
You may also need to configure heap space in Cloudera Manager to reduce the heap to ensure you don't overcommit.