Member since
04-21-2016
15
Posts
0
Kudos Received
0
Solutions
10-19-2022
11:13 AM
@DataMike Yes, you can use the CC APIs as per your requirements [1] [2] [1] https://docs.cloudera.com/cdp-private-cloud-base/7.1.7/cctrl-managing/topics/cctrl-using-rest-api.html [2] https://community.cloudera.com/t5/Customer/Frequently-Used-CRUISE-CONTROL-API-and-important-DOCs/ta-p/324729 From the above articles you can use the following API to rebalance topics/partitions: curl -k --negotiate -u: -X POST "https://<CC FQDN>:8899/kafkacruisecontrol/rebalance?dryrun=false&rebalance_disk=true" To avoid high CPU, memory and disk read write you can initiate rebalance process in batches. It will automatically create a batch and rebalance topics. curl -X POST "http://$HOSTNAME:8899/kafkacruisecontrol/rebalance?dryrun=true&concurrent_partition_movements_per_broker=10&concurrent_leader_movements=500" If it will help you then please click on ”Accept as Solution" below this post. Thank you.
... View more
01-10-2022
01:37 PM
@DataMike Has the reply helped resolve your issue? If so, please mark the appropriate reply as the solution, as it will make it easier for others to find the answer in the future. Thanks!
... View more
04-16-2020
07:39 AM
Thanks for checking @StevenOD (sorry for posting that last post under a different account - forgot who I was logged in as).
... View more
10-31-2019
09:25 PM
Hi @DataMike, Yes, once CM is down, you can't update the configuration unless you "hack" into CM's backend database, which is also down in our scenario. So if you setup MySQL in such a way that CM will connect to LB / VIP host, which will route to the MySQL host that you want to, so in the event of one MySQL instance is down, simply update LB to only go to the working one. This avoids the needs to update the CM config. Hope that can help. Cheers Eric
... View more
09-10-2019
12:06 AM
@DataMike, I am afraid that there is no such option that I am aware of, you would have to stop and start one by one manually. Cheers Eric
... View more
07-17-2019
02:58 AM
It would be safe if you remove balancer role. balancer is required only when there is data incosistency.stop the role and follow below steps. You can goto HDFS-> instances -> select balancer -> migrate roles and specify target host. Regards, Asim
... View more
04-24-2019
10:07 AM
1 Kudo
hi @DataMike , The Balancer role is normally added (by default) when the HDFS service is installed, so the "Balancer" Resides usally in your nameNode , but to make sure where it's assigned you can check HDFS->Instances then check the role Type , you'll find the role 'balancer' assigned to a host ( usally it's the nameNode ) . for your second question I guess it's better to use the nameNode just to maintain the architecture since we're talking about checking all the other DataNodes,moving blocks...
... View more
04-11-2019
12:32 AM
Hi @DataMike, You need to restart all afected component. If not this will run like nothing. Regards, Manu.
... View more
07-13-2018
03:50 PM
@DataMike, That should be OK. You can consider what to do with the other roles afterward. Just note that if the impalad or regionserver are used for anything, they will need to read/write to a remote DataNode and they will also be competing with the movement of blocks from the decomissioned dn to a new one.
... View more
02-13-2018
09:00 AM
Hi, support for device UUIDs with navencrypt was introduced in version 3.13.0: https://www.cloudera.com/documentation/enterprise/release-notes/topics/rg_navigator_encrypt_new_features.html#nav_encrypt_313 Please check the relevant documentation on how to use it here: https://www.cloudera.com/documentation/enterprise/latest/topics/navigator_encrypt_prepare.html#concept_device_uuids regards, Gabor Zele Customer Operations Engineer
... View more