IoT Edge Processing with Deep Learning on HDF 3.2 and HDP 3.0 - Part 2

[#1]

IoT Edge Processing with Deep Learning on HDF 3.2 and HDP 3.0 - Part 2

For: https://conferences.oreilly.com/strata/strata-ny/public/schedule/detail/68140

See Pre-Work: https://community.hortonworks.com/articles/203638/ingesting-multiple-iot-devices-with-apache-nifi-17...

See Part 1: https://community.hortonworks.com/articles/215079/iot-edge-processing-with-deep-learning-on-hdf-32-a...

Step By Step Processing

Step 1: Install Apache NiFi (One or More Nodes or clusters)

Choose: https://docs.hortonworks.com/HDPDocuments/HDF3/HDF-3.2.0/installing-hdf/content/install-ambari.html or docker pull hortonworks/nifi Apache NiFi Configuration for IoT https://community.hortonworks.com/articles/67756/ingesting-log-data-using-minifi-nifi.html You will need to set: nifi.remote.input.host and nifi.remote.input.socket.port in the conf/nifi.properties or Ambari settings.

Step 2: Install Apache NiFi - MiniFi on Your Device(s)

Download MiniFi (https://nifi.apache.org/minifi/download.html) You can choose Java or C++. For your first usage, I recommend the Java edition unless your device is too small. You can also install on a RHEL or Debian Linux machine or OSX. Download MiniFi Toolkit (https://nifi.apache.org/minifi/minifi-toolkit.html) Resources: https://cwiki.apache.org/confluence/display/MINIFI/Release+Notes#ReleaseNotes-Versioncpp-0.5.0 https://cwiki.apache.org/confluence/display/MINIFI/Release+Notes#ReleaseNotes-Version0.5.0 https://docs.hortonworks.com/HDPDocuments/HDF3/HDF-3.1.2/bk_release-notes/content/ch_hdf_relnotes.ht... https://community.hortonworks.com/articles/108947/minifi-for-ble-bluetooth-low-energy-beacon-data-in... https://community.hortonworks.com/content/kbentry/107379/minifi-for-image-capture-and-ingestion-from...

Step 3: Install Apache MXNet (On MiniFi Devices and NiFi Nodes - optional)

https://mxnet.incubator.apache.org/install/index.html?platform=Devices&language=Python&processor=CPU Install build tools and build from scratch Walk through install: https://community.hortonworks.com/articles/176932/apache-deep-learning-101-using-apache-mxnet-on-the... Resources and Source https://github.com/tspannhw/StrataNYC2018 rainbow-processing.xml rainbow-gateway-processing.xml display-images-server.xml rainbowminifi.xml https://community.hortonworks.com/articles/203638/ingesting-multiple-iot-devices-with-apache-nifi-17...

Resources and Source

• https://github.com/tspannhw/StrataNYC2018
• rainbow-processing.xml
• rainbow-gateway-processing.xml
• display-images-server.xml
• rainbowminifi.xml