Good Morning, guys Before i will go with the question, first i must to tell you this. I'm college student (IT) in Indonesia. This year is my final year and i want to make a project in Big Data. So, i want to get some data with Apache Nifi dan send it to Output. Afterwards, i process it with Spark and Storm. 1. What Performance Comparison should i do ? Response Time ? Throughput ? Real Time Proccessing Speed ? 2. Is it possible to do that ? Because, i know someone in the internet says benchmark between Spark and Storm inaccurate and there is no paper or journal about this. ( http://www.slideshare.net/ptgoetz/apache-storm-vs-spark-streaming ) 3. If you have a better idea about my final project. Let me know it. Thanks before, Have a nice day. ... View more

Good Morning, everyone. Before i go with my question, i will start why i need fuzzy algorithm. In my project, i use Arduino to collect some data about temperature, etc. After i collect a lot of data, i want to use Fuzzy Algorithm to predict rainfall in some area. But, i dont find fuzzy algorithm in MLlib's Apache Spark ? What should i do ? How i can use fuzzy algorithm in HDF, or there is another way ? Or can i use python library in Apache Spark ? ; Because i heard there are some fuzzy library in Python, maybe i can use it in Apache Spark Thanks a lot. ... View more

Hello anyone, First, i want say sorry because maybe my question is out of the topic. But, i need to ask it because i dont find another forum that discuss about Big Data and how to use it with your own (Using Tutorial that provided by Hortonworks). My question is 1. Can i get data from twitter to HDP ? Is it true that i can use Apache Nifi or Can i use another Software like Apache Kafka ? But How ? 2. When i get the data form Twitter, how to process it ? Can i use Spark or Mahout ? In this case, i want to find the most people personality from twitter, which is the best option ? 3. Then, if i can calculate the data, how i can access it with android aplication ? In my mind, i think i can use web service but i dont know how to make it with HDP ? I will make a clear explanation about this, a. User want to use my app. But, user must login to Twitter before use this app. b. After this, i want to collect some twitter data from user. c. Twitter data passes to HDP using Web services. d. HDP will calculate the data with certain algorithm. e. After that, HDP will send the result the data to android app. f. Voila, use can see his/her personality using twitter data. Can i implement this ? Or maybe i think too much how use HDP ? 4. Do you some another idea for my final project in the college ? Actually, my older lecturer use HDP but only single cluster (Sandbox). And i want to make it multi node, but i dont know how to maximize the potential how to use HDP and real Bid Data. I hope my question with not confuse you guys, why i ask to many question because my lack knowledege how to use HDP and Big Data. I hope i can get the answer and have a nice day :). ... View more