Code Repositories

Find and share code repositories
Announcements
Celebrating as our community reaches 100,000 members! Thank you!
Labels (1)
avatar
Contributor
Repo Description

This project reimplements HDF IoT Trucking Apps with Spark Structured Streaming.

This project provides couple of sample applications which leverage stream-stream join, window aggregation, deduplication respectively.

This project depends on HDP version of Spark, so you may want to modify Spark version before building the project to accomodate your installation of Spark.

Apps depend on Truck Geo Event as well as Truck Speed Event, which are well explained in README.md in sam-trucking-data-utils.

Apps also assume both truck geo events and truck speed events are ingested into Kafka topics, which can be easily done via sam-trucking-data-utils.

Detailed explanation on how to build and run is described in repo's README.md file.

Repo Info
Github Repo URL https://github.com/HeartSaVioR/iot-trucking-app-spark-structured-streaming
Github account name HeartSaVioR
Repo name iot-trucking-app-spark-structured-streaming
1,026 Views
0 Kudos