Member since
07-30-2020
197
Posts
31
Kudos Received
58
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
183 | 10-26-2023 08:08 AM | |
589 | 09-13-2023 06:56 AM | |
622 | 08-25-2023 06:04 AM | |
427 | 08-17-2023 12:51 AM | |
248 | 08-04-2023 12:36 AM |
07-25-2023
01:46 AM
Hi @lukepoo . Yes, you can try to raise the timeouts as well do check if the regions of this table have a good locality. For the current run, it seems the timeout happened on the region '1e8adfc0af2cf791361126e24822e63c'. So you can check the region locality and try to compact them if its less than 1.
... View more
07-25-2023
01:39 AM
Hi @dmitrybalak . Try the below Cloudera article and see if that helps resolve this. https://my.cloudera.com/knowledge/Rebalance-option-is-greyed-out-in-the-Cloudera-Manager-under?id=91268
... View more
07-21-2023
04:11 AM
Hi @cdl-support . You can refer to the below article and check if those help. https://my.cloudera.com/knowledge/Issue-with-Small-Files-in-HDFS?id=308948 Using Hive : https://docs.cloudera.com/best-practices/latest/impala-performance/topics/bp-impala-avoiding-small-files.html
... View more
06-22-2023
06:34 AM
hi @yagoaparecidoti Yes, the Block for the file would be present on the Datanode in either of the rack. So if you write a file with RF 3, 1 block will be present on a rack and its 2 replicas will be present on different Datanodes of 2nd rack.
... View more
06-22-2023
02:27 AM
Hi, @yagoaparecidoti With a replication factor of 3, the BlockPlacementPolicyDefault will put one replica on the local machine if the writer is on a datanode, otherwise on a random datanode in the same rack as that of the writer, another replica on a node in a different (remote) rack, and the last on a different node in the same remote rack. So totally 2 racks will be used, in sceneraio like 2 racks going down at the same time will cause data inavailability where using BlockPlacementPolicyRackFaultTolerant will help in placing 3 blocks on 3 different racks. So, you can safely set 2 racks. In case, you want to go with BlockPlacementPolicyRackFaultTolerant ( rare cases where both the racks go down ), you can follow the below doc : https://hadoop.apache.org/docs/stable/hadoop-project-dist/hadoop-hdfs/HdfsBlockPlacementPolicies.html
... View more
06-22-2023
02:11 AM
HI @damon The most likely culprit, in this case, would be the Packet length crossing the jute buffer limit. As this is seen for the Kms service, verify if you are getting any warnings such as "Packet len is out of range!" If you do, then raise the jute buffer for the Zookeeper service as well as for the Kms service ( client ) and restart the respective services to resolve this issue.
... View more
06-21-2023
03:09 AM
Hi @damon Apart from these CancelledKeyException, are you seeing any other specific warnings or errors in the Zookeeper logs?
... View more
06-05-2023
12:21 AM
Hi @hanumanth There could be various factors that could cause such issues. Can you check what the Namenode was logging at the same time? It could be some Block Placement issue as the Datanodes are considered for the operation but something has restricted the write/read.
... View more
05-18-2023
02:06 AM
Hi, @tangxu Do check if the below Cloudera article helps you. https://community.cloudera.com/t5/Customer/Configure-SPNEGO-Kerberos-Authentication-from-Windows/ta-p/89450 https://community.cloudera.com/t5/Customer/Authentication-Fails-Configuring-SPNEGO-Kerberos/ta-p/72030
... View more
05-18-2023
12:24 AM
Hi @kolli_sandeep , I believe you are talking about Secondary Namenode and not the Standby Namenode on a Non-HA cluster. If so, the functionality of the Secondary Namenode would be to perform the checkpointing of the fsimage with the new edits. The Secondary NameNode does require some memory to hold the data structures and objects necessary for merging the edits log and the FsImage. However, it does not load the entire FsImage into memory at once. As such, I would suggest keeping the heap to atleast 2x times the fsimage fpr smooth functioning.
... View more