Member since
08-17-2017
54
Posts
2
Kudos Received
1
Solution
My Accepted Solutions
Title | Views | Posted |
---|---|---|
3430 | 08-20-2017 11:20 AM |
09-06-2017
04:24 AM
Hi Team , I am using NiFi . I am behind the proxy . When trying to connect the Nifi with Tweeter , its getting connection timeout . Can you please help me to know , how to configure Nifi to make use of Proxy .
... View more
Labels:
09-05-2017
08:12 AM
Hi Team , i need help on freteching tweets using the Flume stashing to Solr . Can you please help with some documents .
... View more
- Tags:
- flume-1.6
Labels:
09-04-2017
09:40 AM
It works, after stating manually as mention on this doc . Thanks
... View more
09-04-2017
09:23 AM
@Geoffrey Shelton Okot I tried that several time . It give following error too afemode: Call From hostname/16.250.53.40 to hostnamet:8020 failed on connection exception: java.net.ConnectException: Connection refused; For more details see: http://wiki.apache.org/hadoop/ConnectionRefused
... View more
09-04-2017
09:17 AM
@Geoffrey Shelton Okot ifconfig
eth1 Link encap:Ethernet HWaddr 00:50:56:A3:35:62
inet addr:16.250.21.229 Bcast:16.250.23.255 Mask:255.255.248.0
UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
RX packets:225204 errors:0 dropped:0 overruns:0 frame:0
TX packets:54663 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:1000
RX bytes:83297332 (79.4 MiB) TX bytes:20422522 (19.4 MiB)
lo Link encap:Local Loopback
inet addr:127.0.0.1 Mask:255.0.0.0
UP LOOPBACK RUNNING MTU:65536 Metric:1
RX packets:1170 errors:0 dropped:0 overruns:0 frame:0
TX packets:1170 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:0
RX bytes:301861 (294.7 KiB) TX bytes:301861 (294.7 KiB) cat /etc/resolv.conf search internal_host.com nameserver 16.110.135.51
nameserver 16.110.135.52 Note : internal_host.com --List of internal hosts OF HP . service iptables status
iptables: Firewall is not running.
... View more
09-04-2017
09:05 AM
Hi All , I am trying to start the HDFS using ambari . It remains stuck at following error . safemode: Call From hostname/16.250.53.40 to hostname:8020 failed on connection exception: java.net.ConnectException: Connection refused; For more details see: http://wiki.apache.org/hadoop/ConnectionRefused
2017-09-04 09:00:04,064 - Retrying after 10 seconds. Reason: Execution of '/usr/hdp/current/hadoop-hdfs-namenode/bin/hdfs dfsadmin -fs hdfs://hostname:8020 -safemode get | grep 'Safe mode is OFF'' returned 1. safemode:
Call From hostname/16.250.53.40 to hostname:8020 failed on connection exception: java.net.ConnectException: Connection refused; For more details see: http://wiki.apache.org/hadoop/ConnectionRefused
safemode:
Call From hostname/16.250.53.40 to hostname:8020 failed on connection exception: java.net.ConnectException: Connection refused; For more details see: http://wiki.apache.org/hadoop/ConnectionRefused
... View more
- Tags:
- Hadoop Core
- HDFS
Labels:
09-04-2017
04:02 AM
@Geoffrey Shelton Okot traceroute -T www.google.com traceroute to www.google.com (74.125.21.99), 30 hops max, 60 byte packets 1 16.250.16.3 (16.250.16.3) 0.476 ms 0.409 ms 0.395 ms 2 * * * 3 * * * perl ping.pl google.com Protocol tcp port 443 google.com is NOT reachable Protocol udp port 7 google.com is NOT reachable Protocol icmp port 7 google.com is NOT reachable Protocol syn port 7 google.com is reachable
... View more
08-31-2017
08:01 AM
I am able to curl to the Twitter API . But not connecting from NiFi curl --get 'https://stream.twitter.com/1.1/statuses/filter.json?delimited=length&stall_warnings=true ' --data 'count=2&screen_name=twitterapi' --header 'Authorization: OAuth oauth_consumer_key="ccccccccc", oauth_nonce="BBBBBBBBBBBBBBBBBBBBBBB", oauth_signature="CCCCCCCCCCCCCCCCCCCCCCCCCCC", oauth_signature_method="HMAC-SHA1", oauth_timestamp="1471672391", oauth_token="9009090909", oauth_version="1.0"' --verbose
* About to connect() to proxy proxy.houston.hpecorp.net port 8080 (#0)
* Trying 16.85.88.10... connected
* Connected to proxy.houston.hpecorp.net (16.85.88.10) port 8080 (#0)
* Establish HTTP proxy tunnel to stream.twitter.com:443
> CONNECT stream.twitter.com:443 HTTP/1.1
> Host: stream.twitter.com:443
> User-Agent: curl/7.19.7 (x86_64-redhat-linux-gnu) libcurl/7.19.7 NSS/3.19.1 Basic ECC zlib/1.2.3 libidn/1.18 libssh2/1.4.2
> Proxy-Connection: Keep-Alive
> Authorization: OAuth oauth_consumer_key="ZCY8L9UGJ4GO1c3fV4vw3jPCJ", oauth_nonce="BBBBBBBBBBBBBBBBBBBBBBB", oauth_signature="CCCCCCCCCCCCCCCCCCCCCCCCCCC", oauth_signature_method="HMAC-SHA1", oauth_timestamp="1471672391", oauth_token="75463767-XhrwuoEAmHaeFD6RHWyvJXLphcsU8PA0oaCeCNVQD", oauth_version="1.0"
> < HTTP/1.1 200 Connection established
... View more
08-31-2017
08:00 AM
Here is more details out put of curl command curl --get 'https://stream.twitter.com/1.1/statuses/filter.json?delimited=length&stall_warnings=true ' --data 'count=2&screen_name=twitterapi' --header 'Authorization: OAuth oauth_consumer_key="ZCY8L9UGJ4GO1c3fV4vw3jPCJ", oauth_nonce="BBBBBBBBBBBBBBBBBBBBBBB", oauth_signature="CCCCCCCCCCCCCCCCCCCCCCCCCCC", oauth_signature_method="HMAC-SHA1", oauth_timestamp="1471672391", oauth_token="75463767-XhrwuoEAmHaeFD6RHWyvJXLphcsU8PA0oaCeCNVQD", oauth_version="1.0"' --verbose * About to connect() to proxy port 8080 (#0)
* Trying 16.85.88.10... connected
* Connected to (16.85.88.10) port 8080 (#0)
* Establish HTTP proxy tunnel to stream.twitter.com:443
> CONNECT stream.twitter.com:443 HTTP/1.1
> Host: stream.twitter.com:443
> User-Agent: curl/7.19.7 (x86_64-redhat-linux-gnu) libcurl/7.19.7 NSS/3.19.1 Basic ECC zlib/1.2.3 libidn/1.18 libssh2/1.4.2
> Proxy-Connection: Keep-Alive
> Authorization: OAuth oauth_consumer_key="ZCY8L9UGJ4GO1c3fV4vw3jPCJ", oauth_nonce="BBBBBBBBBBBBBBBBBBBBBBB", oauth_signature="CCCCCCCCCCCCCCCCCCCCCCCCCCC", oauth_signature_method="HMAC-SHA1", oauth_timestamp="1471672391", oauth_token="75463767-XhrwuoEAmHaeFD6RHWyvJXLphcsU8PA0oaCeCNVQD", oauth_version="1.0"
>
< HTTP/1.1 200 Connection established
... View more
08-31-2017
05:57 AM
@Geoffrey Shelton Okot. Yeah "Grab Garden Hose" . Using the curl from NiFi server, i am able to access that end point . curl https://stream.twitter.com/1.1/statuses/sample.json?delimited=length&stall_warnings=true [1] 5432
[root@c9t21841 nifi]# <html>\n<head>\n<meta http-equiv="Content-Type" content="text/html; charset=utf-8"/>\n<title>Error 401 Unauthorized</title>
</head>
<body>
<h2>HTTP ERROR: 401</h2>
<p>Problem accessing '/1.1/statuses/sample.json?delimited=length'. Reason:
<pre> Unauthorized</pre>
</body>
</html>
... View more
08-31-2017
05:31 AM
@Joe Here is the output # service iptables status iptables: Firewall is not running.
... View more
08-31-2017
05:29 AM
@Geoffrey Shelton Okot I am selecting all then running he processors . It fails at the Twitter processor itself . .
... View more
08-30-2017
02:39 PM
@Geoffrey Shelton Okot Any finding please ? I am blocked due to that .
... View more
08-30-2017
12:39 AM
Try that as well. Same error . d4734] IOException caught when establishing connection to https://stream.twitter.com/1.1/statuses/sample.json?delimited=length&stall_warnings=true
2017-08-30 00:37:06,092 ERROR [Timer-Driven Process Thread-2] o.a.nifi.processors.twitter.GetTwitter GetTwitter[id=17f6d19f-6a6f-46df-a98c-5059921d4734] Received error CONNECTION_ERROR: connect timed out. Will attempt to reconnect
2017-
... View more
08-29-2017
10:07 AM
@Geoffrey Shelton Okot Here is the screen shot of Processor Properties . Following document i am following . https://hortonworks.com/tutorial/analyzing-social-media-and-customer-sentiment-with-apache-nifi-and-hdp-search/ @Geoffrey Shelton Okot Forgot to mention Error : 2017-08-29 11:06:12,043 WARN [hosebird-client-io-thread-0] com.twitter.hbc.httpclient.ClientBase GetTwitter[id=17f6d19f-6a6f-46df-a98c-5059921d4734] IOException caught when establishing connection to https://stream.twitter.com/1.1/statuses/filter.json?delimited=length&stall_warnings=true
2017-08-29 11:06:12,206 ERROR [Timer-Driven Process Thread-6] o.a.nifi.processors.twitter.GetTwitter GetTwitter[id=17f6d19f-6a6f-46df-a98c-5059921d4734] Received error CONNECTION_ERROR: connect timed out. Will attempt to reconnect
201
2017-08-29 11:06:17,212 ERROR [Timer-Driven Process Thread-6] o.a.nifi.processors.twitter.GetTwitter GetTwitter[id=17f6d19f-6a6f-46df-a98c-5059921d4734] Received error CONNECTION_ERROR: connect timed out. Will attempt to reconnect
... View more
08-29-2017
09:09 AM
@Geoffrey Shelton Okot NiFi Version : Version 1.2.0.3.0.0.0-453 .Its Cluster with HDP and Ambari Kerberized : No Bare Metal
... View more
08-28-2017
11:32 PM
@Wynner Please find the attache screen clip of GetTwitter Processor conf .
... View more
08-28-2017
04:47 PM
Hi Team , I am getting following error while connecting from Nifi to Twitter . 2017-08-28 16:41:52,443 ERROR [Timer-Driven Process Thread-8] o.a.nifi.processors.twitter.GetTwitter GetTwitter[id=17f6d19f-6a6f-46df-95b5-23335e63fedd] Received error CONNECTION_ERROR: Failed to establish connection properly. Will attempt to reconnect
... View more
Labels:
08-24-2017
09:45 AM
@Jay SenSharma . Tried that option didn't work .
... View more
08-24-2017
08:41 AM
@Jay SenSharma While installing the Solr from Ambari , i am getting following exception File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", line 303, in _call
raise ExecutionFailed(err_msg, code, out, err)
resource_management.core.exceptions.ExecutionFailed: Execution of '/usr/bin/yum -d 0 -e 0 -y install lucidworks-hdpsearch' returned 1. Error: failure: repodata/a2e514aba11a5426bbdbb7744c3d68f3ca97510b-primary.sqlite.bz2 from Delivery-SharedHosting-RedHat-6.5Server-x86_64: [Errno 256] No more mirrors to try.
stdout:.
... View more
08-24-2017
05:54 AM
Thanks @Jay SenSharma With this i am able to get the Nifi . Solr didnt show up into "Choose Services " still .
... View more
08-24-2017
05:24 AM
Hi Team , I want to added Solr and NiFi into my exiting Ambari Cluster . Please help . Best regards ~Kishore
... View more
- Tags:
- Hadoop Core
- solr
Labels:
08-23-2017
07:33 AM
@Geoffrey Shelton Okot . Sorry i missed the last message . Can you please let me know how to do Accept the Response ?
... View more
08-20-2017
11:20 AM
1 Kudo
@Geoffrey Shelton Okot Now all works . After deleting the old view . Thanks a lot @Geoffrey Shelton Okot for helping and answering question very prompt .
... View more
08-20-2017
11:10 AM
@Geoffrey Shelton Okot Now all those errors are fixed with this and i could mostly all Views . For Smart Sense view i am getting following error . ster information associated with this view instance
20 Aug 2017 11:07:02,068 ERROR [ambari-client-thread-28] ViewRegistry:930 - Could not find the cluster identified by 2.
20 Aug 2017 11:07:02,070 ERROR [ambari-client-thread-28] ContainerResponse:419 - The RuntimeException could not be mapped to a response, re-throwing to the HTTP container
org.apache.ambari.server.view.IllegalClusterException: Failed to get cluster information associated with this view instance
at org.apache.ambari.server.view.ViewRegistry.getCluster(ViewRegistry.java:931)
at org.apache.ambari.server.view.ViewContextImpl.getCluster(ViewContextImpl.java:370)
at org.apache.ambari.server.view.ViewContextImpl.getPropertyValues(ViewContextImpl.java:437)
at org.apache.ambari.server.view.ViewContextImpl.getProperties(ViewContextImpl.java:171)
at com.hortonworks.support.tools.view.ServerProxy.buildHeaders(ServerProxy.java:243)
at com.hortonworks.support.tools.view.ServerProxy.execute(ServerProxy.java:133)
at com.hortonworks.support.tools.view.ServerProxy.execute(ServerProxy.java:112)
at com.hortonworks.support.tools.view.ServerProxy.execute(ServerProxy.java:94)
... View more