Using G1GC of JDK 8 on Cloudera

[#1]

Hi,

We have CDH 5.15 on our production cluster with JDK 8,

What is your recommendation about moving to G1GC or stay with the CMS,

didn't find any clear instruction about it.

Does it depend on the CDH version? or on the components I'm using?

Thanks

[#2]

Hello @hores,

If you plan to use and enable G1 GC for all your YARN jobs then please modify YARN's Configuration -> "Map Task Java Opts Base" and "Reduce Task Java Opts Base".

Hope that helps.

[#3]

Hi @Consult,

1. What is your recommendation about it? It is better to use it on all your components (Hive, ImpalaEmbeddedJVM, YARN, hdfs etc) or not? are their some exceptional components?

2. How do I configure theImpalaEmbeddedJVM ?

Thanks

[#4 · Accepted solution]

Hello @hores,

I am not sure about your use case scenario to opt for g1. But as per most of the GC test, cms still seems to the best and default option. G1 may have improved latency but throughput is still a challenge in many tested scenario.

Also, you may review tunning GC for HBase. 

Hope that helps.