Hi, Do you know about any issues about using network bonding on Hadoop clusters that use Centos 7 as OS? Any comments appreciated. ... View more

Hi, I am going to setup a Hadoop cluster on brand new physical servers and this will be my first time. There are servers those planned to be masters and slaves. Regarding to this page: http://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.5.3/bk_cluster-planning/content/ch_partitioning_chapter.html I guess I need to format disks on slaves as ext3, then mount them then define them in hfs-site.xml files. Is that correct? I also read about command hadoop namenode -format Am I also supposed to format RAID partitions on masters before this command? Or does this command also do what is needed on OS level? Maybe it is not possible to mount a drive before formatting it on Linux and maybe this command is not about file system formatting but I couldn't make sure since I am also not familiar with linux disk mounting. Thanks in advance. ... View more

Hi, I am about to setup an Hadoop ecosystem. I have some practices with the environment setup but not with monitoring/managing the logs with an external solution. Since there will be a lot of applications to print logs and yet so much log files, I will need a solution which will be able to monitor them (Will be great if I can also manage and analyze them). I have heard about ELK and some others but I would like to hear from some experienced people. Can you recommend one such solution? Btw I'll use Ambari so it'd be good if you add its compatibility information whether or not can be managed by Ambari. ... View more