Created 02-01-2016 05:15 PM
Hi,
is there a simple way to install all hdp components using a common prefix ? A single path prefix box where I could enter /opt/mydumbo/ ? I do try to accomplish this with linking all I can. I don't mind having a /var/log/hbase which is a link to /opt/mydumbo/hbase/log. Can this be accomplished with a blueprint ?
Thanks,
Created 02-10-2016 04:25 PM
I have it now working (moved everything to one volume for now and linked all the directories). The important thing is to keep the rights of the files. Basically the requirement is to isolate the appliacation to a set of volumes so you won't overflow the system tmp/log partitions. Then the outline might look like (several data dirs are used so you can keep several copies of data on different volumes/disks on the same host):
/opt/mydumbo/app/ - binaries, static config like in /etc/...
/opt/mydumbo/data1/ - dynamic data like hdfs/namenode hdfs/datanode...
/opt/mydumbo/data2/ - dynamic data like hdfs/namenode hdfs/datanode...
/opt/mydumbo/data3/ - dynamic data like hdfs/namenode hdfs/datanode...
/opt/mydumbo/log - all the log files
/opt/mydumbo/tmp - temporary data
Ideally I would like to blueprint it. I let it run for a while but hints, pointers and doubts are welcome. Might end in tears as mentioned before but I want to try 🙂 The truth is no kerberos and such is used at the moment so might be easier.
Thanks,
Peter
Created 03-16-2016 09:01 AM