Community Articles

Find and share helpful community-sourced technical articles.
Announcements
Celebrating as our community reaches 100,000 members! Thank you!
Labels (1)
avatar
Rising Star

Introduction

CFM is out for CDH and that's awesome. While the install documentation is very thorough, I thought I'd share a screenshot based tutorial, avoiding some of the gotchas of the installation

Pre-Requisites

  • Healthy CDH 6.2 cluster
  • Admin privileges on the cluster and its nodes
  • wget installed
  • Open JDK 1.8 installed (see doc)
  • Zookeeper service installed (see doc)


Step 1: Get the CFM CSD Files

Connect to your Cloudera Manager node as root, and enter the following:

cd /opt/cloudera/csd
wget http://archive.cloudera.com/CFM/csd/1.0.0.0/NIFI-1.9.0.1.0.0.0-90.jar
wget http://archive.cloudera.com/CFM/csd/1.0.0.0/NIFICA-1.9.0.1.0.0.0-90.jar
wget http://archive.cloudera.com/CFM/csd/1.0.0.0/NIFIREGISTRY-0.3.0.1.0.0.0-90.jar
chown cloudera-scm:cloudera-scm NIFI*.jar 
chmod 644 NIFI*.jar 
service cloudera-scm-server restart

After restart, log to CM and restart the Cloudera Management Service:

108643-screen-shot-2019-05-15-at-23624-pm.png

Wait for the restart to finish:

108705-screen-shot-2019-05-15-at-23635-pm.png

Step 2: Get the CFM Parcel

Go to the parcels configuration (parcel icon top right):

108644-screen-shot-2019-05-15-at-23239-pm.png


Go to parcel configuration and add http://archive.cloudera.com/CFM/parcels/1.0.0.0/ to the parcel repository list by clicking on the "+" icon:

108694-screen-shot-2019-05-15-at-24305-pm.png

Click on the "Check for New Parcels" button:

108695-screen-shot-2019-05-15-at-23842-pm.png

You should see a CFM parcel, click on "Download":

108669-screen-shot-2019-05-15-at-23903-pm.png

After the download completes, distribute and activate the parcel.

Step 4: Install services

Go to your CM main page, and click on "Add Service":

108645-screen-shot-2019-05-15-at-25801-pm.png


Select the Nifi service:

108733-screen-shot-2019-05-15-at-25905-pm.png

Select the host onto which you want to install Nifi:

108646-screen-shot-2019-05-15-at-25921-pm.png

Click on next and wait for the service to install.

Step 5: Profit

You can now go to your Nifi URL:

108741-screen-shot-2019-05-15-at-30936-pm.png


Bonus: Changing election timeout

By default, the nifi.cluster.flow.election.max.wait.time property is set to 5 minutes, which can be confusing by giving rise to a log message like Cluster is still in the process of voting on the appropriate Data Flow. You can modify the property by adding it to the nifi.properties.xml in CM, as follows:

108783-screen-shot-2019-05-17-at-75320-am.pngRestart your Nifi instance via CM, and voilà!

8,177 Views
Comments

The above was originally posted in the Community Help track. On Sun May 19 16:41 UTC 2019, the HCC moderation staff moved it to the Data Ingestion & Streaming track. The Community Help Track is intended for questions about using the HCC site itself.