Member since
05-29-2015
6
Posts
0
Kudos Received
0
Solutions
05-10-2016
01:55 PM
1 Kudo
Short Answer: No, not possible to balance with respect to cpu/memory resources out of the box today to my knowledge. Longer Answer: You can write a custom balancer either external to hbase or using the hbase balancer protocol. Using the region_mover.rb as an example you can write your own jruby that can be run by the shell. Unfortunately, ultimately you will likely be better off without the underpowered nodes in the cluster than you are with them in. Perhaps keep them in for HDFS storage and run just YARN there?
... View more
08-12-2015
08:50 AM
Thanks. This helped. By looking at the logs, I was able to fix the classpath issue on one of the nodes and giving enough executor memory helped the container not to get killed.
... View more