Hello, I am managing  CDH 5.14 cluster with 4 datanodes. Each datanode has 10*3TB of total disk space, split in 10 mount points (dfs.datanode.data.dir). The 4 datanodes have similar configuration so far.   Now, I want to add an extra datanode, which has 8*4TB of space. I have the following questions: 1. Do II have to create 10 similar mount points as in the rest datanodes? 2. Is it a balancing problem that the extra datanode will have a bit greater capacity? The main services used are Impala, Hive and Spark   Thank you! ... View more

Hello,   I have configured CDH cluster with LDAP integration and CompositeGroupMapping (ShellBasedUnixGroupsMapping and LdapGroupsMapping) on HDFS. HDFS, Hive and Impala works great with both local user principals as well as AD users.   The problem I have now is with Spark (on YARN), where jobs submitted by local users work, but those submitted by AD users fail:   main : run as user is ldap1 main : requested yarn user is ldap1 User ldap1 not found   If I create user ldap1 on all hosts, then Spark works. What am I missing here?   Thank you ... View more

Hello,   I noticed the following behaviour:   1. I have set the following:   <property> <name>hive.metastore.kerberos.keytab.file</name> <value>/etc/hive/conf/hive.keytab</value> </property> 2. I have generated and placed the hive.keytab in both MetaStoreServer and HS2 nodes   Now, each time I restart Hive these files are deleted as the whole /etc/hive/conf directory is re-created.   Am I doing something wrong? ... View more

Hello,   As pointed out in the documentation:   "The Hadoop   LdapGroupsMapping   group mapping mechanism. The   LdapGroupsMapping   library may not be as robust a solution needed for large organizations in terms of scalability and manageability, especially for organizations managing identity across multiple systems and not exclusively for Hadoop clusters. Support for the   LdapGroupsMapping   library is not consistent across all operating systems."   Our case is:   - A central AD for all organization's users - CDH cluster with local MIT KDC for service principals and cross-realm trusted LDAP for user principals (on-going process) - CDH cluster runs on identical versioned RHEL nodes   Is there any reason that we shouldn't use LdapGroupsMapping option for user-group mapping?   Thank you, Gerasimos ... View more

Hello,   I am managing a CDH 5.13 cluster with 4 datanodes. Each datanode had 10 x 2.7 TB disks (~90% used) and we just added another 8 x 3.6 TB disks on each node.   I did a "Rebalance" on HDFS service, which apparently did nothing as all nodes have the same disk usage (in total).   Now, I followed this post in order to intra-node-balance the disks (with threshold set to 25). After 1 hour of execution, the progress is terribly slow (as you can see in the last /data/18 node which gets data):     $ sudo df -h ... /dev/sdc1 2.8T 2.4T 361G 88% /data/02 /dev/sdk1 2.8T 2.5T 315G 89% /data/10 /dev/sdg1 2.8T 2.5T 308G 89% /data/07 /dev/sdi1 2.8T 2.5T 314G 89% /data/08 /dev/sdj1 2.8T 2.5T 300G 90% /data/09 /dev/sde1 2.8T 2.5T 299G 90% /data/04 /dev/sdf1 2.8T 2.5T 303G 90% /data/06 /dev/sdh1 2.8T 2.4T 353G 88% /data/05 /dev/sdb1 2.8T 806G 2.0T 29% /data/01 /dev/sdd1 2.8T 2.5T 298G 90% /data/03 ---#NEW DISKS#--- /dev/sdl1 3.7T 35M 3.7T 1% /data/11 /dev/sdm1 3.7T 36M 3.7T 1% /data/12 /dev/sdn1 3.7T 34M 3.7T 1% /data/13 /dev/sdo1 3.7T 35M 3.7T 1% /data/14 /dev/sdp1 3.7T 34M 3.7T 1% /data/15 /dev/sdq1 3.7T 34M 3.7T 1% /data/16 /dev/sdr1 3.7T 34M 3.7T 1% /data/17 /dev/sds1 3.7T 26G 3.7T 1% /data/18     I would like to ask the following:    1. Currently, there are not pipelines accessing HDFS, but tomorrow morning there will be, and it's obvious from the progress that disk balancing won't have finished. Is it safe to leave this process to finish, while having the cluster in production?     2. Is there something I can do to speed things up?    3. How can I terminate this process, safely, if required?   Thank you, Gerasimos ... View more