Member since
09-06-2017
4
Posts
0
Kudos Received
0
Solutions
01-02-2019
05:00 PM
1 Kudo
Hi @Oleg Khaykin ,
If your Cluster is managed by ambari then you are not supposed to edit the configs in the cluster manually.
you can perform the editing of configuration of your Hive service by logging into ambari-ui and clicking on Services -> Hive -> configs -> custom hive-site and edit the config as you require You can read more at
https://docs.hortonworks.com/HDPDocuments/Ambari-2.6.2.0/bk_ambari-operations/content/edit_advanced_config_properties.html
https://docs.hortonworks.com/HDPDocuments/Ambari-2.6.2.0/bk_ambari-operations/content/ch_Overview_hdp-ambari-user-guide.html
Please accept this answer if you found it helpful
... View more
07-05-2018
07:37 AM
One other thing. It looks like there were some issues with the Ubuntu OS and after switching over to Centos 7.5 the CDH 5.15 install ran without much issues. I have a question though, in the the install screens it has a Data Node configuration value: DataNode Data Directory dfs.data.dir, dfs.datanode.data.dir Comma-delimited list of directories on the local file system where the DataNode stores HDFS block data. Typical values are /data/N/dfs/dn for N = 1, 2, 3.... These directories should be mounted using the noatime option, and the disks should be configured using JBOD. RAID is not recommended. In JBOD mode say the server has 20 hard disks so each of the 20 disk will have 20 file mount points. I think we need to set this value to comma-delimited /data/1/dfs/dn, /data/2/dfs/dn, /data/3/dfs/dn....../data/20/dfs/dn . Now what happens if some of the data nodes have different number of JBOD disks say 20 disks in some and 10 disks in others. Since this is a global variable dfs.data.dir how does it allocate the 20 data directories in those data nodes with only 10 JBOD hard disks? Since there is no hostname defined in this variable to indicate different nunber of disks in different hosts. Also in future if new datanodes are added with different number of disks how is this specified while adding new data nodes? Thanks!
... View more