Member since
12-10-2015
9
Posts
11
Kudos Received
2
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
3001 | 02-10-2016 04:25 PM | |
5472 | 12-17-2015 09:14 AM |
03-16-2016
09:01 AM
1 Kudo
https://community.hortonworks.com/articles/16763/cheat-sheet-and-tips-for-a-custom-install-of-horto.html excellent
... View more
02-10-2016
04:38 PM
This is not reqired anymore when deploying ? oozie.service.JPAService.create.db.schema=true
... View more
02-10-2016
04:25 PM
1 Kudo
I have it now working (moved everything to one volume for now and linked all the directories). The important thing is to keep the rights of the files. Basically the requirement is to isolate the appliacation to a set of volumes so you won't overflow the system tmp/log partitions. Then the outline might look like (several data dirs are used so you can keep several copies of data on different volumes/disks on the same host): /opt/mydumbo/app/ - binaries, static config like in /etc/... /opt/mydumbo/data1/ - dynamic data like hdfs/namenode hdfs/datanode... /opt/mydumbo/data2/ - dynamic data like hdfs/namenode hdfs/datanode... /opt/mydumbo/data3/ - dynamic data like hdfs/namenode hdfs/datanode... /opt/mydumbo/log - all the log files /opt/mydumbo/tmp - temporary data Ideally I would like to blueprint it. I let it run for a while but hints, pointers and doubts are welcome. Might end in tears as mentioned before but I want to try 🙂 The truth is no kerberos and such is used at the moment so might be easier. Thanks, Peter
... View more
02-02-2016
10:38 AM
1 Kudo
Yes the binaries. But I think some of the ambari-server, ambari-agent and some python scripts end up also in /usr/bin or /usr/sbin and of course all operational logs /var/run /var/log.
... View more
02-02-2016
09:13 AM
1 Kudo
But I did it by hand and will have to update it accordingly for every component when added and I do not really want to thing about upgrades. Yes I think it is a PIA but I somehow imagined it will be easier than convincing our security
... View more
02-02-2016
09:13 AM
1 Kudo
The reason is that for HDP there is a dedicated volume where everything should be stored. This is a requirement so the OS stays unaffected by hdp doings. The other possibility would be to size the locations where hdp is storing it's files and create appropriate volumes/mounts. The linking actually works quite well, I have a sudoers file with a dedicated user and all the folders are linked into a single volume and works for several weeks now.
... View more
02-01-2016
05:15 PM
1 Kudo
Hi, is there a simple way to install all hdp components using a common prefix ? A single path prefix box where I could enter /opt/mydumbo/ ? I do try to accomplish this with linking all I can. I don't mind having a /var/log/hbase which is a link to /opt/mydumbo/hbase/log. Can this be accomplished with a blueprint ? Thanks,
... View more
Labels:
12-17-2015
09:14 AM
4 Kudos
I have added the value "usr" to the list on line 234 in script /usr/bin/hdp-select and it seems to work. I did not run any cleanup. The HDP version is 2.3.2.0-2950
... View more
12-10-2015
11:56 AM
1 Kudo
Hi, the HDP install (with ambari) fails in step "App Timeline Server Install". The error message is: resource_management.core.exceptions.Fail: Execution of 'ambari-sudo.sh -H -E touch /var/lib/ambari-agent/data/hdp-select-set-all.performed ; ambari-sudo.sh /usr/bin/hdp-select set all `ambari-python-wrap /usr/bin/hdp-select versions | grep ^2.3 | tail -1`' returned 1. Traceback (most recent call last):
File "/usr/bin/hdp-select", line 378, in <module>
printVersions()
File "/usr/bin/hdp-select", line 235, in printVersions
result[tuple(map(int, versionRegex.split(f)))] = f
ValueError: invalid literal for int() with base 10: 'usr'
ERROR: set command takes 2 parameters, instead of 1
usage: hdp-select [-h] [<command>] [<package>] [<version>]
Set the selected version of HDP.
positional arguments: Does it matter if the /usr/hdp directory already exists (is a symlink to a partition with enough space and is empty) ? Thanks Peter.
... View more
Labels:
- Labels:
-
Hortonworks Data Platform (HDP)