question Re: Installing HDF on Ambari with HDP 3.0.0.0 fails in Archives of Support Questions (Read Only)

Installing HDF on Ambari with HDP 3.0.0.0 fails

L_Berle — Sun, 18 Aug 2019 08:12:56 GMT

Hi,

I ve a completely new cluster setup with ambari 2.7 and HDP 3.0.0.0. I want to install HDF 3.1.2.0 using ambari, however it does not work:

I installed hdf-ambari-mpack-3.1.3.0-7. There was no problem.

1. Then I went to Ambari UI --> Cluster Admin --> Stack and Versions --> Versions --> Manage Versions. I came to this view:

1.png(15.5 kB)

2. I selected "Register Version" and i come to the second view also attached. However, there is no version called "HDF-XXXX". Why? Is this a bug?

2.png(38.8 kB)
3. I tried to Workaround and clicked on HDP-3.0 dropdown and uploaded the Version Definition File of HDF-3.1.2.0. I came to the menu attached in the 3. attachment and entered my local HDF and HDF Utils repositories.

3.png(55.8 kB)

4. When I came back to the menu:

6.png(19.2 kB)

.. I clicked INSTALL ON and choose my cluster. However: Nothing happened.

I suspect that the there failed something with the hdf mpack. However there was no error or warning at all.

I Installed the ambari HDP Cluster two times and both times I come to exact this problem

Could you give me any advice / workaround?

Best

Luke

Re: Installing HDF on Ambari with HDP 3.0.0.0 fails

stevenmatison — Sat, 21 Jul 2018 00:45:27 GMT

@Luke Luke nice one on the HDF Version Definition file!! I could not find one, can you share? I was able to take the HDF Mpack and modify it to get Nifi to show up in the Add Service for HDP-3.0.0. I am going through the install as i type this.

Re: Installing HDF on Ambari with HDP 3.0.0.0 fails

L_Berle — Sat, 21 Jul 2018 01:00:06 GMT

@steven I found the file (a XML file) in the Linux package repository of HDF.

It would be nice to know how you modified the mpack in order to be able to install NiFi. Could u tell us?

Re: Installing HDF on Ambari with HDP 3.0.0.0 fails

stevenmatison — Mon, 23 Jul 2018 18:24:14 GMT

@Luke Luke I downloaded and extracted the HDF Mpack, then started editing the files inside. I changed the config for stack "HDF" to "HDP" and was able to get NiFi to appear in Add Services. At first my installs failed but I finished wizard to find Nifi and Nifi CA listed in the side bar, but as "Installed Failed". I did re-installs manually by choosing Re-Install on the NiFi host page and started modifying the scripts on the nifi node (path: /var/lib/ambari-agent/cache/common-services/NIFI/1.0.0/package/scripts/) until all errors were satisfied. I was mostly just commenting out the conflicting lines. Then NiFi installed and started as expected.

My plan today is delete NiFi, and get a full install without errors thus completing my HDP Mpack for NiFi.

Re: Installing HDF on Ambari with HDP 3.0.0.0 fails

stevenmatison — Tue, 24 Jul 2018 01:22:48 GMT

@Luke Luke Attach that VDF please?

Re: Installing HDF on Ambari with HDP 3.0.0.0 fails

L_Berle — Tue, 24 Jul 2018 16:33:39 GMT

@Steven Matison

Download the rpm repo from here:

http://public-repo-1.hortonworks.com/HDF/centos7/3.x/updates/3.1.2.0/HDF-3.1.2.0-centos7-rpm.tar.gz

In it you find a file called HDF-3.1.2.0-7.xml which seem to be the VDF.

Re: Installing HDF on Ambari with HDP 3.0.0.0 fails

stevenmatison — Tue, 24 Jul 2018 18:20:38 GMT

@Luke Luke Thanks. I wanted to try your method to see if I could get it to go further.

Re: Installing HDF on Ambari with HDP 3.0.0.0 fails

akhilsnaik — Thu, 26 Jul 2018 14:08:58 GMT

Hi @Luke Luke ,

I see as per website : https://supportmatrix.hortonworks.com/ (accessible with hortonworks support subscription) and this link : https://docs.hortonworks.com/HDPDocuments/HDF3/HDF-3.1.2/support-matrix.html

Ambari-2.7.0 is not compatable with HDF 3.1.2.0 .

You might need to install Ambari-2.6.2.2 inorder to support HDF-3.1.2.0 or lesser Ambari-2.6.x.x versions.

Hope this helps.

Re: Installing HDF on Ambari with HDP 3.0.0.0 fails

L_Berle — Thu, 26 Jul 2018 16:42:22 GMT

@Akhil S Naik

Thanks a lot for this fact! Do u have any information about when ambari >2.7 will be compatible with HDF?

Re: Installing HDF on Ambari with HDP 3.0.0.0 fails

akhilsnaik — Thu, 26 Jul 2018 16:46:03 GMT

HDF-3.2 is releasing in some more days which will be compatabile with Ambari-2.7. as of now Ambari-2.7 supports only HDP-3.0 installation .

If you found this answer helpfull. please mark the answer as best and close this thread.

Re: Installing HDF on Ambari with HDP 3.0.0.0 fails

douglasharley — Sun, 16 Sep 2018 03:53:53 GMT

@Akhil S Naik

This still appears to be a problem...I am attempting to install HDF 3.2.0.0 into Ambari 2.7.0.0 that is managing a brand new HDP 3.0.0 cluster, management pack installed fine, but when I ayyempt to specify the version info file URL (had to google for it: http://public-repo-1.hortonworks.com/HDF/ubuntu16/3.x/updates/3.2.0.0/HDF-3.2.0.0-520.xml) Ambari complains: "An internal system exception occurred: Stack data, Stack HDF 3.2 is not found in Ambari metainfo"

Any idea what might be the issue(s)?

Thanks,

Doug

Re: Installing HDF on Ambari with HDP 3.0.0.0 fails

douglasharley — Thu, 20 Sep 2018 10:07:31 GMT

Nevermind, used the PDF docs (https://docs.hortonworks.com/HDPDocuments/HDF3/HDF-3.2.0/installing-hdf/hdf-installing-hdf.pdf) with new VMs and all is good now.