Support Questions

Find answers, ask questions, and share your expertise
Announcements
Celebrating as our community reaches 100,000 members! Thank you!

spark shell - lack of memory

avatar
Contributor

I tried for the first time the command "spark-shell" on git bash in on order to learn how to manage data with spark and hive.

I have faced a problem a memory as you can see on the picture.spark-shell.png

I am on sandbox docker hdp 2.5 trying to learn with the "hello world" case.

I have allocated 5GO of ram for my sandbox and my PC have 8GO of RAM in total.

Until now , I have not faced a memory problem

Is it compulsory to add RAM or is there a simple solution for this problem.

1 ACCEPTED SOLUTION

avatar
Contributor
hide-solution

This problem has been solved!

Want to get a detailed solution you have to login/registered on the community

Register/Login
4 REPLIES 4

avatar
@Oriane

Try stopping the services which are not in use. This helps in freeing up the memory so that you can use spark.

avatar
Contributor

Thanks @Sandeep. You are rigth for a quick solution.

avatar
Contributor
hide-solution

This problem has been solved!

Want to get a detailed solution you have to login/registered on the community

Register/Login

avatar
Contributor

Thanks @michael.

You are rigth for a long term solution.