Hi all, my team are currently testing on HDFS rebalancing in a HDFS cluster with two DataNode. I have read the documentation https://docs.cloudera.com/cdp-private-cloud-base/7.1.6/scaling-namespaces/topics/hdfs-step-1-storage-group-classification.html We have a few question about how the file moving size is calculated. 1. How is cluster average utilization calculated. Do the calculation use Configured capacity or Present capacity? 2. How is individual utilization calculated. Do the calculation use configured capacity or the sum of DFS used and remaining? 3. When looking at the balancer log, it said need to move 4.98GB to make the cluster balanced. However, afterwards, the log show that the balancer decided to move 18.98GB from one host to another host. Why there is difference? Balancer log 4. We have set the DataNode balancing bandwidth to 200MiB, but as per observation, the bandwidth consumption can exceed 200MiB. Why did it happen? Please help me with my questions. Thank you in advance.         ... View more

Hi all,   Recently I am practicing Apache Atlas and my cluster enabled Kerberos.   After I created a Hive table using hive service principle, I use an AD account to access Atlas console. However, when I search for hive process, no record appears.   I have checked the integration between Hive and Atlas in Hive configuration.   Do I need to create a ranger policy and grant read permission to the AD user? If yes, please kindly suggest how to set the ranger policy.   Thank you in advance. Looking forward to hearing from all of you.   ... View more

Hi all,   I have a CDP 7.1.8 cluster running in my environment. Recently, I would like to try enabling CM server High Availability. I studied the instruction in this link https://docs.cloudera.com/cdp-private-cloud-base/7.1.8/managing-clusters/topics/cm-ha-configure-steps.html.   My question is, currently I have tried migrating the CM server to another host and I cannot see my cluster on the new CM server console until I manually restore the cluster. I really doubt that after I enabled CM server HA, when the system failover to the passive CM server, I will not see my cluster as well.   Could someone clarify for me please? Thank you very much.  ... View more

Hi all,   I have a CDP 7.1.8 cluster running in my environment. Recently I would like to migrate the existing CM server to another host.   I followed the instruction in the link https://docs.cloudera.com/cdp-private-cloud-base/7.1.8/managing-clusters/topics/cm-moving-the-cm-server-new-host2.html.    After that, the CM server is successfully migrated to the target host and I can see the cluster node recognized by the new CM server.   However, I cannot see the cluster appear on the new CM server console. Finally, I have to manually restore the cluster using the link https://docs.cloudera.com/cdp-private-cloud-base/7.1.8/configuring-clusters/topics/cm-api-import-configuration.html.   My question is, am I suppose to restore the cluster manually? What I expected is I can see the cluster immediately without extra work done after switching CM server.   Could someone clarify for me please? Thank you. ... View more