Why NIFI is not installed on HDP but installed on HDF?,Nifi not installed on sandbox HDP but on HDF.

[#1]

I am learning using Hortonworks Sandbox HDP 2.6.4 and HDF 3.1.0. I noticed NIFI service is not intalled in HDP. There is a way to install NIFI throw Ambari -> Admin -> Stack and Versions, but "This service is for demo purposes only and not officially supported". However, Sandbox HDF contains the fully installed NIFI service. Why NIFI is not installed along with other services like HBASE and SPARK in the same HDP?

I am following the instruction: https://hortonworks.com/tutorial/realtime-event-processing-in-hadoop-with-nifi-kafka-and-storm/secti.... In INSTALL NIFI section, the reference links are all broken. I am curious if this is a very old instruction which does not support current HDP 2.6.4 and HDF 3.1.0 combination? Do I still need to install NIFI on HDP or local machine?

,

I am using Hortonworks Sandbox HDP 2.6.4 and HDF 3.1.0. Just noticed the NIFI service is not installed in HDP. In HDP, there is a way to add NIFI service through Ambari -> Admin -> Stack and Versions, but This service is for demo purposes only and not officially supported.

However in Sandbox HDF, I saw the NIFI service fully installed. Why NIFI is not installed in HDP with other services like HBASE and SPARK?

I am trying to learn through the link: https://hortonworks.com/tutorial/realtime-event-processing-in-hadoop-with-nifi-kafka-and-storm/secti.... In the INSTALL NIFI step, the reference links are both broken which made me confused. Do I still need to install NIFI in HDP?

[#2]

Sorry, not sure why my two posts appears on the same page. I posted it twice, the first time is not successful, but the content appeared on the second post. Just take a look at either post content. Thanks.

[#3]

Hi @Quan Zhang

Hortonworks has two principal platforms HDP and HDF. NiFi is part of HDF which is designed for data in motion. HDP contains technologies for managing data at rest. NiFi is added in HDP Sandbox only for demo purposes to have all services in one VM. Please take a look at HDP and HDF components to have more informations:

• https://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.6.4/bk_release-notes/content/comp_versions.html
• https://docs.hortonworks.com/HDPDocuments/HDF3/HDF-3.1.1/bk_release-notes/content/ch_hdf_relnotes.ht...

[#4]

Take a look at this tutorial:

https://hortonworks.com/tutorial/realtime-event-processing-in-hadoop-with-nifi-kafka-and-storm/secti...

It utilized not only components in HDF such as NIFI, KAFKA and STORM, but also HBASE and HIVE in HDP. To complete this lab, Do I have to launch both HDP and HDF at the same time on VM? (I only have 16GB RAM on my machine, but HDP and HDF both require at least 8GB RAM in VM, which caused my computer very slow)

Can I fully install NIFI on HDP so that I can use NIFI, KAFKA, STORM, HBASE and HIVE on the same VM? Otherwise does the DEMO version of NIFI on HDP support this lab?

[#5]

can i add NIFI to the HDP as i have currently HDP Cluster and i want to configure NIFI in this cluster

[#6]

Download it and add it

https://nifi.apache.org/download.html

On a sandbox, you will not have enough RAM or CPU.

NiFi will run with few resources.

[#7]

I am sorry, what you said made me confused. Which of the following did you mean?

1. Download and install on sandbox, but you will have RAM or CPU issues, since it consumes a lot of resources.

2. Download and install on sandbox. Don't worry about your RAM or CPU, since it does not consume many resources.

3. Download and install on your local machine, since sandbox does not have enough RAM or CPU.

[#8]

@Timothy Spann Can i add nifi to the HDP Cluster ?