Community Articles
Find and share helpful community-sourced technical articles
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.
Labels (1)
Super Guru

IoT Edge Processing with Deep Learning on HDF 3.2 and HDP 3.0 - Part 2

For: https://conferences.oreilly.com/strata/strata-ny/public/schedule/detail/68140

See Pre-Work: https://community.hortonworks.com/articles/203638/ingesting-multiple-iot-devices-with-apache-nifi-17...

See Part 1: https://community.hortonworks.com/articles/215079/iot-edge-processing-with-deep-learning-on-hdf-32-a...

87515-stratafullarchitecture2018.jpg


Step By Step Processing


Step 1: Install Apache NiFi (One or More Nodes or clusters)

Choose: https://docs.hortonworks.com/HDPDocuments/HDF3/HDF-3.2.0/installing-hdf/content/install-ambari.html or docker pull hortonworks/nifi Apache NiFi Configuration for IoT https://community.hortonworks.com/articles/67756/ingesting-log-data-using-minifi-nifi.html You will need to set: nifi.remote.input.host and nifi.remote.input.socket.port in the conf/nifi.properties or Ambari settings.

Step 2: Install Apache NiFi - MiniFi on Your Device(s)

Download MiniFi (https://nifi.apache.org/minifi/download.html) You can choose Java or C++. For your first usage, I recommend the Java edition unless your device is too small. You can also install on a RHEL or Debian Linux machine or OSX. Download MiniFi Toolkit (https://nifi.apache.org/minifi/minifi-toolkit.html) Resources: https://cwiki.apache.org/confluence/display/MINIFI/Release+Notes#ReleaseNotes-Versioncpp-0.5.0 https://cwiki.apache.org/confluence/display/MINIFI/Release+Notes#ReleaseNotes-Version0.5.0 https://docs.hortonworks.com/HDPDocuments/HDF3/HDF-3.1.2/bk_release-notes/content/ch_hdf_relnotes.ht... https://community.hortonworks.com/articles/108947/minifi-for-ble-bluetooth-low-energy-beacon-data-in... https://community.hortonworks.com/content/kbentry/107379/minifi-for-image-capture-and-ingestion-from...

Step 3: Install Apache MXNet (On MiniFi Devices and NiFi Nodes - optional)

https://mxnet.incubator.apache.org/install/index.html?platform=Devices&language=Python&processor=CPU Install build tools and build from scratch Walk through install: https://community.hortonworks.com/articles/176932/apache-deep-learning-101-using-apache-mxnet-on-the... Resources and Source https://github.com/tspannhw/StrataNYC2018 rainbow-processing.xml rainbow-gateway-processing.xml display-images-server.xml rainbowminifi.xml https://community.hortonworks.com/articles/203638/ingesting-multiple-iot-devices-with-apache-nifi-17...


Resources and Source


334 Views
Don't have an account?
Coming from Hortonworks? Activate your account here
Version history
Revision #:
2 of 2
Last update:
‎08-17-2019 06:32 AM
Updated by:
 
Contributors
Top Kudoed Authors