Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Unable to visualize tweets on Banana.

Solved Go to solution

Unable to visualize tweets on Banana.

New Contributor

I am trying to do a POC of sentiments analysis using nifi and banana. I was able to setup everything but unfortunately I am unable to see any data in Banana, however I can see sometimes data are coming in nifi. Please see the below screenshot to have a look at the error.

8991-nifi.jpg

I had almost tried everything that was mentioned everywhere as a solution like switching off the firewall, making sure about the port forwarding in virtualbox etc.

1 ACCEPTED SOLUTION

Accepted Solutions
Highlighted

Re: Unable to visualize tweets on Banana.

One thing to point out: the "java.net.ConnectException: Connection refused" error is not related. It just means that Ambari metrics service is probably not started - it's usually turned off by default on sandbox, to conserve resources

From the screenshots it seems the flow was started and tweets are flowing. If you can not query them in Solr UI/APIs, I would check if the PutSolrContentStream processor in Nifi is showing any errors - sometimes the zookeeper zknode that solr is using may not be correctly specified in its settings. In this example, I used the Solr ambari service which usually sets up Solr to use /solr zknode

9080-screen-shot-2016-11-02-at-115048-am.png

If you are able to query tweets in Solr, but not in Banana try to switch the "Time Window" or re-installing the .json file for the dashboard

9 REPLIES 9

Re: Unable to visualize tweets on Banana.

New Contributor

@Ali Bajwa Just wanted to request you if you can help me with this. Thanks.

Re: Unable to visualize tweets on Banana.

Super Guru

can you post the logs? it should have more details.

Is SOLR and Banana installed and running? Can you check those?

What component is that error on?

Do you have the twitter setup? Did you create a twitter app with Read/Write/Direct Message and grabbed those four values?

Re: Unable to visualize tweets on Banana.

Super Guru

do you see anything in data provenance at any of the components?

Re: Unable to visualize tweets on Banana.

New Contributor

solr-logging.jpgsolr-stats.jpgYes, Solr and Banana are working I have attached the snapshots please have a look. Yes, I have created the Twitter App and configured the four values. I have set the Twitter app permission as Read Only.

What I have already tried:

Note: I have followed every bit of this page.

http://hortonworks.com/hadoop-tutorial/how-to-refine-and-visualize-sentiment-data/

1. Checked Port Forwarding of the NiFi under Network settings of Hortonworks Sandbox.

2. Ensured the time on sandbox is accurate:

  • yum install -y ntp
  • service ntpd stop
  • ntpdate pool.ntp.org
  • service ntpd start

3. Deleted the Twitter App and created a new one.

ambari-main.jpg

P.S. I am just a beginner with all this and trying to learn while doing sentiment analysis, in case you want me to do anything specific to check something to give more details please do inform me.

Thanks

Re: Unable to visualize tweets on Banana.

@Amod Gehlot

It looks like you have a problem with your SolrCloud Zookeeper configuration.

Overseer cannot talk to ZK

Are you storing your Solr Index in HDFS or on local disks?

Could you please check your solrcloud configuration especially the ZK Quorum and maybe post the configuration files (solrconfig.xml of the collection, solr.in.sh of your solr cloud)

Is this a secured environment?

Highlighted

Re: Unable to visualize tweets on Banana.

One thing to point out: the "java.net.ConnectException: Connection refused" error is not related. It just means that Ambari metrics service is probably not started - it's usually turned off by default on sandbox, to conserve resources

From the screenshots it seems the flow was started and tweets are flowing. If you can not query them in Solr UI/APIs, I would check if the PutSolrContentStream processor in Nifi is showing any errors - sometimes the zookeeper zknode that solr is using may not be correctly specified in its settings. In this example, I used the Solr ambari service which usually sets up Solr to use /solr zknode

9080-screen-shot-2016-11-02-at-115048-am.png

If you are able to query tweets in Solr, but not in Banana try to switch the "Time Window" or re-installing the .json file for the dashboard

Re: Unable to visualize tweets on Banana.

New Contributor

@Ali Bajwa

Right on! This worked for me. Thanks a ton! What I did: 1. Deleted my sandbox and re-installed it.

2. Configured PutSolrContentStream processor's Solr Location to localhost:2181/solr

3. Turned on Ambari metrics service. I really appreciate your input. Thanks for sparing the time.

Re: Unable to visualize tweets on Banana.

Thanks for the feedback @Amod Gehlot. I have updated the original HCC article with this info for others as well

Re: Unable to visualize tweets on Banana.

New Contributor

thnx @Ali Bajwa