Dear Community, I finally was able to work and manage my twitter analysis using NiFi + Hortonworks. Now that i've accomplished my data source, i would like to create a nice report output. got a suggestion? ps: I used to work with Bi Publisher. Regards ... View more

Dear community, I've been wondering something that cannot figure out yet. A quick summary I was able to work for a while with Flume to gather data from twitter and store it in a external table using Hive. After processing data using Hive, i finally got the results that i want. All steps made were manually. What i need now is to make same process, but automatically because i need to finally make it public. A suggestion? Thanks for your help, Regards ... View more

Hi everyone reading this. As you can see, the main subject of this post is to get tips from you all for taking the best decision. I've been working with Hortonworks Sandbox 2,5 since a month ago. I've been playing with Flume, collecting data from twitter and trying to transform it into a readable format inside a Hive Table. Streaming-twitter-data-using-flume/ Until now, i successfully loaded data into Hive table (called tweets) using this guide Tweets using Hive My problem is the following. It's not easy for me at this step to select and process data. I would like to make it more readable (is it possible? if so, can you tell me how?). Also, would like to filter data. I want to now, for example: 1.List most used words 2.List most used time for tweeting 3.List active users and so on... Any technique, technology is welcome. I am trying to learn as fast as i can, but your help will be always welcome. Let's work together if you want, you're welcome. Regards, Cristian ... View more

Hi there! I'm new using hortonworks sandbox 2.5 and i wonder why HIVE shows different behavior: hive> select * from tweets limit 2; OK then shows fetched rows hive> select count(*) from tweets; Query ID = hdfs_20161205070716_8b694554-f4fe-4aea-b4c9-507d2fc343e0Total jobs = 1Launching Job 1 out of 1 then shows -------------------------------------------------------------------------------- VERTICES STATUS TOTAL COMPLETED RUNNING PENDING FAILED KILLED -------------------------------------------------------------------------------- Map 1 FAILED 4 0 0 4 13 0 Reducer 2 KILLED 1 0 0 1 0 0 -------------------------------------------------------------------------------- VERTICES: 00/02 [>>--------------------------] 0% ELAPSED TIME: 261.46 s -------------------------------------------------------------------------------- it is because the second query requires more capability? Regards ... View more

Hi, I'm trying to do a select count(*) from tweets; using Hive CLI. But as you can see, it is taking to much time (i guess) It is normal? Any tip? Regards ... View more