About peter_bartal

peter_bartal · ‎03-16-2016

https://community.hortonworks.com/articles/16763/cheat-sheet-and-tips-for-a-custom-install-of-horto.html excellent

peter_bartal · ‎02-10-2016

This is not reqired anymore when deploying ? oozie.service.JPAService.create.db.schema=true

peter_bartal · ‎02-10-2016

I have it now working (moved everything to one volume for now and linked all the directories). The important thing is to keep the rights of the files. Basically the requirement is to isolate the appliacation to a set of volumes so you won't overflow the system tmp/log partitions. Then the outline might look like (several data dirs are used so you can keep several copies of data on different volumes/disks on the same host): /opt/mydumbo/app/ - binaries, static config like in /etc/... /opt/mydumbo/data1/ - dynamic data like hdfs/namenode hdfs/datanode... /opt/mydumbo/data2/ - dynamic data like hdfs/namenode hdfs/datanode... /opt/mydumbo/data3/ - dynamic data like hdfs/namenode hdfs/datanode... /opt/mydumbo/log - all the log files /opt/mydumbo/tmp - temporary data Ideally I would like to blueprint it. I let it run for a while but hints, pointers and doubts are welcome. Might end in tears as mentioned before but I want to try 🙂 The truth is no kerberos and such is used at the moment so might be easier. Thanks, Peter

peter_bartal · ‎02-02-2016

Yes the binaries. But I think some of the ambari-server, ambari-agent and some python scripts end up also in /usr/bin or /usr/sbin and of course all operational logs /var/run /var/log.

peter_bartal · ‎02-02-2016

But I did it by hand and will have to update it accordingly for every component when added and I do not really want to thing about upgrades. Yes I think it is a PIA but I somehow imagined it will be easier than convincing our security

peter_bartal · ‎02-02-2016

The reason is that for HDP there is a dedicated volume where everything should be stored. This is a requirement so the OS stays unaffected by hdp doings. The other possibility would be to size the locations where hdp is storing it's files and create appropriate volumes/mounts. The linking actually works quite well, I have a sudoers file with a dedicated user and all the folders are linked into a single volume and works for several weeks now.

peter_bartal · ‎02-01-2016

Hi, is there a simple way to install all hdp components using a common prefix ? A single path prefix box where I could enter /opt/mydumbo/ ? I do try to accomplish this with linking all I can. I don't mind having a /var/log/hbase which is a link to /opt/mydumbo/hbase/log. Can this be accomplished with a blueprint ? Thanks,

peter_bartal · ‎12-17-2015

I have added the value "usr" to the list on line 234 in script /usr/bin/hdp-select and it seems to work. I did not run any cleanup. The HDP version is 2.3.2.0-2950

peter_bartal · ‎12-10-2015

Hi, the HDP install (with ambari) fails in step "App Timeline Server Install". The error message is: resource_management.core.exceptions.Fail: Execution of 'ambari-sudo.sh -H -E touch /var/lib/ambari-agent/data/hdp-select-set-all.performed ; ambari-sudo.sh /usr/bin/hdp-select set all `ambari-python-wrap /usr/bin/hdp-select versions | grep ^2.3 | tail -1`' returned 1. Traceback (most recent call last): File "/usr/bin/hdp-select", line 378, in <module> printVersions() File "/usr/bin/hdp-select", line 235, in printVersions result[tuple(map(int, versionRegex.split(f)))] = f ValueError: invalid literal for int() with base 10: 'usr' ERROR: set command takes 2 parameters, instead of 1 usage: hdp-select [-h] [<command>] [<package>] [<version>] Set the selected version of HDP. positional arguments: Does it matter if the /usr/hdp directory already exists (is a symlink to a partition with enough space and is empty) ? Thanks Peter.

Online	Offline
Last Visited	‎02-25-2019 10:09 AM

Member Since	‎12-10-2015 11:32 AM
Last Visited	‎02-25-2019 10:09 AM
Posts	9
Kudos received	11

Cloudera Community

Re: An easy way to define a prefix for all hdp com...

Re: Install of HDP fails with "ValueError: invalid...

Re: An easy way to define a prefix for all hdp com...

Re: Oozie db to PGSQL in Ambari install.

Re: An easy way to define a prefix for all hdp com...

Re: An easy way to define a prefix for all hdp com...

Re: An easy way to define a prefix for all hdp com...

Re: An easy way to define a prefix for all hdp com...

An easy way to define a prefix for all hdp compone...

Re: Install of HDP fails with "ValueError: invalid...

Install of HDP fails with "ValueError: invalid lit...