IoT Trucking App with Spark Structured Streaming

[#1]

Repo Description

This project reimplements HDF IoT Trucking Apps with Spark Structured Streaming.

• trucking-iot, Hadoop Summit 2017

This project provides couple of sample applications which leverage stream-stream join, window aggregation, deduplication respectively.

This project depends on HDP version of Spark, so you may want to modify Spark version before building the project to accomodate your installation of Spark.

Apps depend on Truck Geo Event as well as Truck Speed Event, which are well explained in README.md in sam-trucking-data-utils.

Apps also assume both truck geo events and truck speed events are ingested into Kafka topics, which can be easily done via sam-trucking-data-utils.

Detailed explanation on how to build and run is described in repo's README.md file.

Repo Info
Github Repo URL https://github.com/HeartSaVioR/iot-trucking-app-spark-structured-streaming
Github account name HeartSaVioR
Repo name iot-trucking-app-spark-structured-streaming