question Re: Need Spark Thrift Server Design because STS hang after started about 2 hours in Support Questions

question Re: Need Spark Thrift Server Design because STS hang after started about 2 hours in Support Questions https://community.cloudera.com/t5/Support-Questions/Need-Spark-Thrift-Server-Design-because-STS-hang-after/m-p/187013#M149115 Hi all and <A rel="user" href="https://community.cloudera.com/users/21188/tsharma.html" nodeid="21188">@tsharma</A>,I didn't see OMM exception in STS log file. However when I added "-XX:+PrintGCDetails -XX:+PrintGCDateStamps -XX:+PrintAdaptiveSizePolicy -XX:+PrintTenuringDistribution", I saw this message in gc log file "G1Ergonomics (Heap Sizing) did not expand the heap, reason: heap already fully expanded" (please see detail message below). It seems the memory is not enough, but when I increased -Xmx, STS only work a little more time and hang again. Back to my previous questions:1) What is kept in driver memory? Why it is too large (48G) and more if I increase -Xmx? As <A rel="user" href="https://community.cloudera.com/users/21188/tsharma.html" nodeid="21188">@tsharma</A> said STS only a gateway. I am using client mode (not cluster mode)2) How can I sizing memory that need to configure proper for my driver in STS?3) I need a document like <A href="https://cwiki.apache.org/confluence/display/Hive/Design#Design-HiveArchitecture">https://cwiki.apache.org/confluence/display/Hive/Design#Design-HiveArchitecture</A> to understand how STS process query from client because it seems that driver memory keep increasing when there are more people connect and query to STSThank you,My gc log:2017-11-16T08:32:23.876+0700: 46776.282: [GC pause (G1 Evacuation Pause) (young) Desired survivor size 167772160 bytes, new threshold 15 (max 15) 46776.282: [G1Ergonomics (CSet Construction) start choosing CSet, _pending_cards: 0, predicted base time: 13.63 ms, remaining time: 186.37 ms, target pause time: 200.00 ms] 46776.282: [G1Ergonomics (CSet Construction) add young regions to CSet, eden: 0 regions, survivors: 0 regions, predicted young region time: 0.00 ms] 46776.282: [G1Ergonomics (CSet Construction) finish choosing CSet, eden: 0 regions, survivors: 0 regions, old: 0 regions, predicted pause time: 13.63 ms, target pause time: 200.00 ms] 46776.289: [G1Ergonomics (Heap Sizing) attempt heap expansion, reason: recent GC overhead higher than threshold after GC, recent GC overhead: 97.41 %, threshold: 10.00 %, uncommitted: 0 bytes, calculated expansion amount: 0 bytes (20.00 %)] , 0.0069342 secs] [Parallel Time: 3.6 ms, GC Workers: 33] [GC Worker Start (ms): Min: 46776282.1, Avg: 46776282.4, Max: 46776282.7, Diff: 0.6] [Ext Root Scanning (ms): Min: 1.6, Avg: 2.0, Max: 3.2, Diff: 1.7, Sum: 64.4] [SATB Filtering (ms): Min: 0.0, Avg: 0.0, Max: 0.0, Diff: 0.0, Sum: 0.0] [Update RS (ms): Min: 0.0, Avg: 0.0, Max: 0.0, Diff: 0.0, Sum: 0.1] [Processed Buffers: Min: 0, Avg: 0.0, Max: 1, Diff: 1, Sum: 1] [Scan RS (ms): Min: 0.0, Avg: 0.0, Max: 0.0, Diff: 0.0, Sum: 0.0] [Code Root Scanning (ms): Min: 0.0, Avg: 0.0, Max: 0.0, Diff: 0.0, Sum: 0.0] [Object Copy (ms): Min: 0.0, Avg: 0.0, Max: 0.1, Diff: 0.1, Sum: 1.3] [Termination (ms): Min: 0.0, Avg: 1.0, Max: 1.1, Diff: 1.1, Sum: 34.4] [GC Worker Other (ms): Min: 0.0, Avg: 0.0, Max: 0.0, Diff: 0.0, Sum: 0.4] [GC Worker Total (ms): Min: 2.7, Avg: 3.0, Max: 3.3, Diff: 0.6, Sum: 100.5] [GC Worker End (ms): Min: 46776285.4, Avg: 46776285.4, Max: 46776285.4, Diff: 0.1] [Code Root Fixup: 0.7 ms] [Code Root Purge: 0.0 ms] [Clear CT: 0.6 ms] [Other: 2.0 ms] [Choose CSet: 0.0 ms] [Ref Proc: 1.1 ms] [Ref Enq: 0.0 ms] [Redirty Cards: 0.6 ms] [Humongous Reclaim: 0.0 ms] [Free CSet: 0.0 ms] [Eden: 0.0B(2432.0M)->0.0B(2432.0M) Survivors: 0.0B->0.0B Heap: 47.5G(48.0G)->47.5G(48.0G)] [Times: user=0.10 sys=0.00, real=0.01 secs] 46776.290: [G1Ergonomics (Heap Sizing) attempt heap expansion, reason: allocation request failed, allocation request: 32 bytes] 46776.290: [G1Ergonomics (Heap Sizing) expand the heap, requested expansion amount: 33554432 bytes, attempted expansion amount: 33554432 bytes] 46776.290: [G1Ergonomics (Heap Sizing) did not expand the heap, reason: heap already fully expanded] 2017-11-16T08:32:23.884+0700: 46776.290: [Full GC (Allocation Failure) Thu, 16 Nov 2017 10:10:21 GMT anobido 2017-11-16T10:10:21Z