Created 03-25-2018 06:15 AM
After searching on google I understood how to create spark cluster and also made a sample cluster but cant get any tutorial for IOT data computation on spark cluster.
Created 03-26-2018 09:29 AM
There are lots of websites where you can find the IOT datasets. just import the data and play around with it in spark.
Created 03-26-2018 10:37 AM
Hey @Pradarttana Panda Thanks for your reply!
But I was asking for tutorial/blog of spark for processing of IOT data. I don't know how to use spark in cluster form. I had created cluster in spark but after that I dont know how to do computation on that cluster of spark.
Created 03-26-2018 11:33 AM
First Thing you should go for Core-spark processing use. Extraction/Transformation . Then you should start using spark-sql. I would suggest, take a dataset, have an overview of the data. frame a most difficult question you want to extract from it. apply action/transformation to reach to answer. After that only try spark streaming. one of the best tutorial videos for this https://www.youtube.com/watch?v=2-d8WwdtlUI&list=PLf0swTFhTI8rDQXfH8afWtGgpOTnhebDx . Hope this answer your question.
Created 03-26-2018 12:10 PM
It's better to process IoT workloads with HDF 3.1 starting with MiniFi on the device, NiFi to ingest and SAM for real-time windowing and time series data to HBase.
Created 03-26-2018 12:21 PM