Member since
07-19-2016
2
Posts
0
Kudos Received
0
Solutions
07-19-2016
07:12 AM
Thanks Rajkumar for quick reply. I have increased value for spark.executor.memory but not sure how to change value for spark.memory.storageFraction. Please suggest the location to find spark.memory.storageFraction. Thanks, Yoges
... View more
07-19-2016
07:04 AM
Hi, I have downloaded HDP 2.4 sandbox for evaluation of new memory management. Below are the environment details - Windows Desktop (64 bit) with 16 GB memory - Oracle VM player - HDP 2.4 (Sandbox) I started the VM and checked the executors for Spark Thrift server (port 4040). The value for Storage Memory is 511.5 MB. That means total Java heap size is ~1GB. Kindly let me know how can I increase the Java Heap size and setting for other dependent service/configuration. Thanks, Yogesh
... View more
Labels:
- Labels:
-
Apache Spark