Member since
05-09-2016
280
Posts
58
Kudos Received
31
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
3764 | 03-28-2018 02:12 PM | |
3027 | 01-09-2018 09:05 PM | |
1652 | 12-13-2016 05:07 AM | |
5065 | 12-12-2016 02:57 AM | |
4330 | 12-08-2016 07:08 PM |
11-27-2016
12:33 AM
Solr is not dependent on HDFS directory /tmp/tweets-staging, its getting data from Nifi and storing it in /etc/solr/data_dir, not HDFS directory. You are getting confused between the usage of all the tools here. Nifi is fetching data from Twitter API, sending it to Solr to view the streamed data in real-time to gather information. Nifi is also storing the data in HDFS in JSON format, we are creating tables in Hive referencing this new HDFS data to analyze the social sentiment. Lastly, we are using Zeppelin to visualize our dataset
... View more
11-27-2016
12:19 AM
you don't have to delete anything in Solr. You are accessing data from HDFS, not Solr. Delete your HDFS folder /tmp/tweets_staging and then run Nifi workflow.
... View more
11-27-2016
12:13 AM
@rishabh jain , the error shows invalid JSON object. Can you have a look at /tmp/tweets_staging folder in HDFS and check whether the files you are getting are valid JSON files. I am getting these kind of records: {"tweet_id":802654182859632640,"created_unixtime":1480202644444,"created_time":"Sat Nov 26 23:24:04 +0000 2016","lang":"it","displayname":"ivrivs","time_zone":"Pacific Time (US & Canada)","msg":"RT sunshinehems 130 Con lansia non si scherza ?? inutile che vi fate tutte ansiose solo per stare al centro dellattenzione Lansia ?????"}
{"tweet_id":802654205374828544,"created_unixtime":1480202649812,"created_time":"Sat Nov 26 23:24:09 +0000 2016","lang":"it","displayname":"concettaconsoli","time_zone":"Greenland","msg":"RT DiegoFusaro Populista ?? nella neolingua chiunque difenda interessi che non siamo quelli dell??lite dominante finanziaria"} and so on. Further, when you follow the tutorial and create different tables and views, try to do select * after every table you create, so that you are aware of how data is transforming.
... View more
11-24-2016
09:36 PM
2 Kudos
@Marco Chou, make sure yo do ssh to docker container, not the VM. Do this: ssh -p2222 root@127.0.0.1 and then try all the commands you want to.
... View more
11-23-2016
11:33 PM
Provide two pairs of coordinates and it should work. Ideally, if you are not able to do it, you should try starting a new thread and close this one. Accept the best answer to close the thread.
... View more
11-23-2016
10:13 PM
please use comment section when you are not answering anything. There is a property in GetTwitter processor (Locations to filter on) where you can mention comma separated list of coordinates specifying one or more bounding boxes to filter on. Each bounding box is specified by a pair of coordinates in the format: swLon,swLat,neLon,neLat
... View more
11-23-2016
09:37 PM
this only shows that it is not able to connect to localhost:2181/solr. Log file always tells you the extra information. You can try restarting Solr from Ambari and then start Nifi workflow again
... View more
11-23-2016
08:25 PM
It has no errors, can you please check and send the entire file which has errors.
... View more
11-23-2016
05:00 PM
@pierluigi francischelli , this log file states that there is no live Solr servers available. Can you please start Ambari Infra first and then start Ranger? Let us know if that works.
... View more