Member since
01-13-2019
6
Posts
0
Kudos Received
0
Solutions
02-14-2019
04:15 AM
Hi, we also want to avoid upgrading to CDH6 for now but we would benefit a lot if we could use the ORC format with Impala. Thus we are also very interested in a patch :-). Thanks!
... View more
01-24-2019
07:31 PM
It is unlikely to be in CDH5, but more likely in CDH6. No ETA yet though.
... View more
03-22-2019
10:19 PM
Have you found the root cause , we are facing the same problem
... View more
01-08-2019
12:29 PM
Anyone has a good experience for enabling G1GC in NameNode? We need to increase the heap size of our NameNode to be larger than 120GB. CMS may not be suitable for such a large heap so we are considering using G1GC. There're few documents about preference settings. I found Hortonworks has a relative tech blog but is still in "Technical Preview" state: https://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.6.5/bk_hdfs-administration/content/ch_g1gc_garbage_collector_tech_preview.html There's a suggestion that I'm quite confused:
For large clusters (>50M files), MaxGCPauseMillis should be set to 4000. Are there any rationale for this? Why is it acceptable to have a pause up to 4s? The pause delay will be added into the latency of upper systems like HBase. Why shouldn't we set it to a lower value like 400?
... View more
Labels: