Member since
12-09-2018
3
Posts
0
Kudos Received
0
Solutions
05-17-2023
08:09 PM
Hi All, I would like to know what is heap value that I need to set for SNN ? I have a big cluster with ~600 nodes and ~150M blocks so I had set NN heap to be 150GB but what value should I keep for SNN ? Currently its running with 8GB, I feel its low as it needs more MEM to perform checkpointing. Each hosts are running with 750GB of MEM. Please suggest.
... View more
Labels:
- Labels:
-
HDFS
05-02-2023
06:43 PM
Hi Brian, Hope the /opt file system permissions are correct. Also make sure you got enough space. [Errno 2] No such file or directory: '/opt/cloudera/parcels/CDH-7.1.8-1.cdh7.1.8.p0.30990532/
... View more
03-02-2021
08:32 AM
Hi All, I had similar issue, while building new cluster and enabling HA. Both NN were is standby and error in NN log {1}. Fix was in CM, we need to "Initialize HA state in ZK" under "Federation and High Availability. There then restart cluster. {1}Caused by: java.net.ConnectException: Call From <NN1> to <NN2>:8022 failed on connection exception: java.net.ConnectException: Connection refused; For more details see: http://wiki.apache.org/hadoop/ConnectionRefused
... View more