Created 03-25-2018 06:15 AM
After searching on google I understood how to create spark cluster and also made a sample cluster but cant get any tutorial for IOT data computation on spark cluster.
There are lots of websites where you can find the IOT datasets. just import the data and play around with it in spark.
Hey @Pradarttana Panda Thanks for your reply!
But I was asking for tutorial/blog of spark for processing of IOT data. I don't know how to use spark in cluster form. I had created cluster in spark but after that I dont know how to do computation on that cluster of spark.
First Thing you should go for Core-spark processing use. Extraction/Transformation . Then you should start using spark-sql. I would suggest, take a dataset, have an overview of the data. frame a most difficult question you want to extract from it. apply action/transformation to reach to answer. After that only try spark streaming. one of the best tutorial videos for this https://www.youtube.com/watch?v=2-d8WwdtlUI&list=PLf0swTFhTI8rDQXfH8afWtGgpOTnhebDx . Hope this answer your question.
It's better to process IoT workloads with HDF 3.1 starting with MiniFi on the device, NiFi to ingest and SAM for real-time windowing and time series data to HBase.