Cloudera Community
yagoaparecidoti
user rank
Expert Contributor

Rebalance HDFS - Not able to copy block 1314213952...

by Expert Contributor in Support Questions
‎04-04-2022 12:00 PM
‎04-04-2022 12:00 PM
We are running rebalance on HDFS and we are getting the error below:   "WARN balancer.Dispatcher: Failed to move blk_1314197946_240487461 with size=134217728 from 10.10.10.109:1019:DISK to 10.10.10.183:1019:DISK through 10.10.10.99:1019: Got error, status message opReplaceBlock BP-1707938289-10.10.10.96-1520510791093:blk_1314197946_240487461 received exception java.io.IOException: Got error, status message Not able to copy block 1314197946 to /10.10.10.183:51650 because threads quota is exceeded., copy block BP-1707938289-10.10.10.96-1520510791093:blk_1314197946_240487461 from /10.10.10.99:1019, block move is failed"   we would like to know why we are getting these errors?   would it be because the network interfaces are 1GB?   if so, how can we resolve these errors? increasing the speed of network interfaces?   PS: The hosts have 1GB network interfaces PS: We are using Ambari Server version 2.6.2.2. ... View more
Labels:

Re: create a dynamic resource pool for use in YARN...

by Expert Contributor in Support Questions
‎04-04-2022 11:16 AM
‎04-04-2022 11:16 AM
hi @Scharan    Thanks for the feedback,   but we need to configure thread queues for users separately, example:   YARN has 1 TB of memory and 400 vCPU   we need to configure the following:   1. The default queue occupies 50% (500 GB memory and 200 vCPU) 2. User1 queue occupies 25% (250 GB memory and 100 vCPU) 3. User2 queue occupies 25% (250 GB memory and 100 vCPU)   all this configuration must be done in Ambari.   how can we make this configuration? ... View more

create a dynamic resource pool for use in YARN in ...

by Expert Contributor in Support Questions
‎04-04-2022 08:47 AM
‎04-04-2022 08:47 AM
Is it possible to create a dynamic resource pool in YARN on Ambari?   We need to limit the use of YARN resources per user. ... View more

Re: Kudu Tablet taking too long to sync with Kudu ...

by Expert Contributor in Support Questions
‎04-04-2022 08:40 AM
‎04-04-2022 08:40 AM
hi @jromero    thanks for the feedback.   unfortunately we cannot make the TS logs available as they contain sensitive information.   we will try to open a ticket with support.   checking the TS replica charts "Total Tablet Size On Disk Across Kudu Replicas", they all contain the same size. ... View more

Re: Kudu Tablet taking too long to sync with Kudu ...

by Expert Contributor in Support Questions
‎03-29-2022 04:53 PM
‎03-29-2022 04:53 PM
hi @jromero    on the page "http://ip_host:8050/rpcz":   in "inbound_connections" shows the addresses of other tablet servers with "open" state.   in "outbound_connections" it shows the addresses of other tablet servers and master with "open" state.   this above also happens with other tablet servers.   I didn't find anything that could be related to the mentioned problems. ... View more

Re: Kudu Tablet taking too long to sync with Kudu ...

by Expert Contributor in Support Questions
‎03-29-2022 02:03 PM
‎03-29-2022 02:03 PM
Hi @jromero    the "metrics[1]" and "rpcs[2]" web pages are too long:   what should we actually look at? what parameter do we need to look at?   [1] - http://ip_host:8050/metrics [2] - http://ip_host:8050/rpcz ... View more

Re: Kudu Tablet taking too long to sync with Kudu ...

by Expert Contributor in Support Questions
‎03-29-2022 08:54 AM
‎03-29-2022 08:54 AM
hi @jromero    kudu is balanced correctly.   there are 5 kudu tablet and a total of 1173 replicas and each kudu tablet has 234 tablets, this shows that it is balanced.   even being balanced, it presents these two mentioned problems. ... View more

Kudu Tablet taking too long to sync with Kudu Mast...

by Expert Contributor in Support Questions
‎03-28-2022 12:56 PM
‎03-28-2022 12:56 PM
We would like to understand two behaviors that Kudu is showing.   1. When restarting the Kudu Tablet, it takes between 5 and 10min for this Kudu Tablet to communicate with the Kudu Master again, why is this happening?   2. There are 5 Kudu Tablets and two of those Kudu Tablets is using more than 90% of the memory that was set in "memory_limit_hard_bytes", why is this happening? ... View more
Labels:

Re: Cloudera Manager - javax.net.ssl.SSLException:...

by Expert Contributor in Support Questions
‎03-02-2022 05:30 PM
‎03-02-2022 05:30 PM
Hi @araujo  after logging into Cloudera Manager, the error already appears. ... View more

Re: Cloudera Manager - javax.net.ssl.SSLException:...

by Expert Contributor in Support Questions
‎03-02-2022 07:33 AM
‎03-02-2022 07:33 AM
Hi @araujo    yes, normally ... View more
Contact Me
Online
Offline
Last Visited
‎10-10-2025 07:05 AM
Community Statistics
Member Since ‎02-28-2022 11:49 AM
Last Visited ‎10-10-2025 07:05 AM
Posts 171
Kudos received 14