Skip to main content
TimothySpann
Platinum ⭐️⭐️⭐️
Platinum ⭐️⭐️⭐️
March 30, 2018

Enterprise IIoT: Edge Processing with Apache NiFi, MiniFi, TensorFlow, Apache MXNet

  • October 5, 2026 at 9:11 AM
  • 0 replies
  • 2136 views
  • Translate All

64966-eiiottitle.png

http://iotfusion.net/session/enterprise-iiot-edge-processing-with-apache-nifi-minifi-and-deep-learning/

Join me for this live in Philly on April 5, 2018.

Sending Data to an Advanced Analytics Platform like https://www.zoomdata.com/ is childsplay. I added that as a live stream via REST while I am sending the JSON to be converted to AVRO then ORC for storage and Hive queries.

64965-integrationwithzoomdata.png

As part of the ingest we store the images and make a current image for display.

See: https://community.hortonworks.com/articles/182850/vision-thing.html

https://community.hortonworks.com/content/kbentry/182984/vision-thing-part-2-processing-capturing-and-displ.html

64967-overviewflow.png

An Overview of a Flow to Ingest Both Apache MXNet + SenseHat Data plus multiple rows of TensorFlow data

64968-movidiusprocessingflowtfmx.png

If TensorFlow json data, split it into individual JSON records

64970-movidiusosxingestflow.png

64971-splittensorflowrecords.png

This is how to split an array of JSON that doesn't have a top element.

Reference:

https://community.hortonworks.com/articles/182850/vision-thing.html

Github:

https://github.com/tspannhw/OpenSourceComputerVision

https://github.com/tspannhw/ApacheDeepLearning101

https://github.com/tspannhw/nifi-tensorflow-processor