IoT Edge Processing with Deep Learning on HDF 3.2 and HDP 3.0 - Part 2
For: https://conferences.oreilly.com/strata/strata-ny/public/schedule/detail/68140
See Pre-Work: https://community.hortonworks.com/articles/203638/ingesting-multiple-iot-devices-with-apache-nifi-17...
See Part 1: https://community.hortonworks.com/articles/215079/iot-edge-processing-with-deep-learning-on-hdf-32-a...
Step By Step Processing
Step 1: Install Apache NiFi (One or More Nodes or clusters)
Choose: https://docs.hortonworks.com/HDPDocuments/HDF3/HDF-3.2.0/installing-hdf/content/install-ambari.html or docker pull hortonworks/nifi Apache NiFi Configuration for IoT https://community.hortonworks.com/articles/67756/ingesting-log-data-using-minifi-nifi.html You will need to set: nifi.remote.input.host and nifi.remote.input.socket.port in the conf/nifi.properties or Ambari settings.
Step 2: Install Apache NiFi - MiniFi on Your Device(s)
Download MiniFi (https://nifi.apache.org/minifi/download.html) You can choose Java or C++. For your first usage, I recommend the Java edition unless your device is too small. You can also install on a RHEL or Debian Linux machine or OSX. Download MiniFi Toolkit (https://nifi.apache.org/minifi/minifi-toolkit.html) Resources: https://cwiki.apache.org/confluence/display/MINIFI/Release+Notes#ReleaseNotes-Versioncpp-0.5.0 https://cwiki.apache.org/confluence/display/MINIFI/Release+Notes#ReleaseNotes-Version0.5.0 https://docs.hortonworks.com/HDPDocuments/HDF3/HDF-3.1.2/bk_release-notes/content/ch_hdf_relnotes.ht... https://community.hortonworks.com/articles/108947/minifi-for-ble-bluetooth-low-energy-beacon-data-in... https://community.hortonworks.com/content/kbentry/107379/minifi-for-image-capture-and-ingestion-from...
Step 3: Install Apache MXNet (On MiniFi Devices and NiFi Nodes - optional)
https://mxnet.incubator.apache.org/install/index.html?platform=Devices&language=Python&processor=CPU Install build tools and build from scratch Walk through install: https://community.hortonworks.com/articles/176932/apache-deep-learning-101-using-apache-mxnet-on-the... Resources and Source https://github.com/tspannhw/StrataNYC2018 rainbow-processing.xml rainbow-gateway-processing.xml display-images-server.xml rainbowminifi.xml https://community.hortonworks.com/articles/203638/ingesting-multiple-iot-devices-with-apache-nifi-17...
- https://github.com/tspannhw/StrataNYC2018
- rainbow-processing.xml
- rainbow-gateway-processing.xml
- display-images-server.xml
- rainbowminifi.xml
