10-01-2018 01:15 AM
I have installed Cloudera 5.13 and given 9 gb + 2 cores. When i run spark2-shell, it takes a very long time and system slows down. I am not able to perform any task.My total system RAM is 12 gb (8 gb + 4 gb)
Please suggest any configuration changes.
10-01-2018 04:25 AM
10-01-2018 08:52 AM
yes, when testing on a limited-resource VM, I shut down anything I don't need.
Still, with limited resources, don't expect awesome performance. If you are using YARN, that spins up containers that will require memory as well.
If you have Cloudera Manager installed, it is what you use to start and stop all hadoop roles.
You may also need to configure heap space in Cloudera Manager to reduce the heap to ensure you don't overcommit.