For large clusters (>50M files), MaxGCPauseMillis should be set to 4000.
Are there any rationale for this? Why is it acceptable to have a pause up to 4s? The pause delay will be added into the latency of upper systems like HBase. Why shouldn't we set it to a lower value like 400?