Re: Service 'hdfs' check failed-From Ambari

kishoretiwari · ‎09-06-2017

Team , Anyone did this before ? Best regards ~Kishore

kishoretiwari · ‎09-06-2017

Hi Team , I am using NiFi . I am behind the proxy . When trying to connect the Nifi with Tweeter , its getting connection timeout . Can you please help me to know , how to configure Nifi to make use of Proxy .

kishoretiwari · ‎09-04-2017

It works, after stating manually as mention on this doc . Thanks

kishoretiwari · ‎09-04-2017

@Geoffrey Shelton Okot I tried that several time . It give following error too afemode: Call From hostname/16.250.53.40 to hostnamet:8020 failed on connection exception: java.net.ConnectException: Connection refused; For more details see: http://wiki.apache.org/hadoop/ConnectionRefused

kishoretiwari · ‎09-04-2017

@Geoffrey Shelton Okot ifconfig eth1 Link encap:Ethernet HWaddr 00:50:56:A3:35:62 inet addr:16.250.21.229 Bcast:16.250.23.255 Mask:255.255.248.0 UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1 RX packets:225204 errors:0 dropped:0 overruns:0 frame:0 TX packets:54663 errors:0 dropped:0 overruns:0 carrier:0 collisions:0 txqueuelen:1000 RX bytes:83297332 (79.4 MiB) TX bytes:20422522 (19.4 MiB) lo Link encap:Local Loopback inet addr:127.0.0.1 Mask:255.0.0.0 UP LOOPBACK RUNNING MTU:65536 Metric:1 RX packets:1170 errors:0 dropped:0 overruns:0 frame:0 TX packets:1170 errors:0 dropped:0 overruns:0 carrier:0 collisions:0 txqueuelen:0 RX bytes:301861 (294.7 KiB) TX bytes:301861 (294.7 KiB) cat /etc/resolv.conf search internal_host.com nameserver 16.110.135.51 nameserver 16.110.135.52 Note : internal_host.com --List of internal hosts OF HP . service iptables status iptables: Firewall is not running.

kishoretiwari · ‎09-04-2017

Hi All , I am trying to start the HDFS using ambari . It remains stuck at following error . safemode: Call From hostname/16.250.53.40 to hostname:8020 failed on connection exception: java.net.ConnectException: Connection refused; For more details see: http://wiki.apache.org/hadoop/ConnectionRefused 2017-09-04 09:00:04,064 - Retrying after 10 seconds. Reason: Execution of '/usr/hdp/current/hadoop-hdfs-namenode/bin/hdfs dfsadmin -fs hdfs://hostname:8020 -safemode get | grep 'Safe mode is OFF'' returned 1. safemode: Call From hostname/16.250.53.40 to hostname:8020 failed on connection exception: java.net.ConnectException: Connection refused; For more details see: http://wiki.apache.org/hadoop/ConnectionRefused safemode: Call From hostname/16.250.53.40 to hostname:8020 failed on connection exception: java.net.ConnectException: Connection refused; For more details see: http://wiki.apache.org/hadoop/ConnectionRefused

kishoretiwari · ‎09-04-2017

@Geoffrey Shelton Okot Can you please hint how to fix ?

kishoretiwari · ‎09-04-2017

@Geoffrey Shelton Okot traceroute -T www.google.com traceroute to www.google.com (74.125.21.99), 30 hops max, 60 byte packets 1 16.250.16.3 (16.250.16.3) 0.476 ms 0.409 ms 0.395 ms 2 * * * 3 * * * perl ping.pl google.com Protocol tcp port 443 google.com is NOT reachable Protocol udp port 7 google.com is NOT reachable Protocol icmp port 7 google.com is NOT reachable Protocol syn port 7 google.com is reachable

kishoretiwari · ‎09-03-2017

Hi Team Any update or help on my issue ?

kishoretiwari · ‎08-31-2017

I am able to curl to the Twitter API . But not connecting from NiFi curl --get 'https://stream.twitter.com/1.1/statuses/filter.json?delimited=length&stall_warnings=true ' --data 'count=2&screen_name=twitterapi' --header 'Authorization: OAuth oauth_consumer_key="ccccccccc", oauth_nonce="BBBBBBBBBBBBBBBBBBBBBBB", oauth_signature="CCCCCCCCCCCCCCCCCCCCCCCCCCC", oauth_signature_method="HMAC-SHA1", oauth_timestamp="1471672391", oauth_token="9009090909", oauth_version="1.0"' --verbose * About to connect() to proxy proxy.houston.hpecorp.net port 8080 (#0) * Trying 16.85.88.10... connected * Connected to proxy.houston.hpecorp.net (16.85.88.10) port 8080 (#0) * Establish HTTP proxy tunnel to stream.twitter.com:443 > CONNECT stream.twitter.com:443 HTTP/1.1 > Host: stream.twitter.com:443 > User-Agent: curl/7.19.7 (x86_64-redhat-linux-gnu) libcurl/7.19.7 NSS/3.19.1 Basic ECC zlib/1.2.3 libidn/1.18 libssh2/1.4.2 > Proxy-Connection: Keep-Alive > Authorization: OAuth oauth_consumer_key="ZCY8L9UGJ4GO1c3fV4vw3jPCJ", oauth_nonce="BBBBBBBBBBBBBBBBBBBBBBB", oauth_signature="CCCCCCCCCCCCCCCCCCCCCCCCCCC", oauth_signature_method="HMAC-SHA1", oauth_timestamp="1471672391", oauth_token="75463767-XhrwuoEAmHaeFD6RHWyvJXLphcsU8PA0oaCeCNVQD", oauth_version="1.0" > < HTTP/1.1 200 Connection established

kishoretiwari · ‎08-31-2017

Here is more details out put of curl command curl --get 'https://stream.twitter.com/1.1/statuses/filter.json?delimited=length&stall_warnings=true ' --data 'count=2&screen_name=twitterapi' --header 'Authorization: OAuth oauth_consumer_key="ZCY8L9UGJ4GO1c3fV4vw3jPCJ", oauth_nonce="BBBBBBBBBBBBBBBBBBBBBBB", oauth_signature="CCCCCCCCCCCCCCCCCCCCCCCCCCC", oauth_signature_method="HMAC-SHA1", oauth_timestamp="1471672391", oauth_token="75463767-XhrwuoEAmHaeFD6RHWyvJXLphcsU8PA0oaCeCNVQD", oauth_version="1.0"' --verbose * About to connect() to proxy port 8080 (#0) * Trying 16.85.88.10... connected * Connected to (16.85.88.10) port 8080 (#0) * Establish HTTP proxy tunnel to stream.twitter.com:443 > CONNECT stream.twitter.com:443 HTTP/1.1 > Host: stream.twitter.com:443 > User-Agent: curl/7.19.7 (x86_64-redhat-linux-gnu) libcurl/7.19.7 NSS/3.19.1 Basic ECC zlib/1.2.3 libidn/1.18 libssh2/1.4.2 > Proxy-Connection: Keep-Alive > Authorization: OAuth oauth_consumer_key="ZCY8L9UGJ4GO1c3fV4vw3jPCJ", oauth_nonce="BBBBBBBBBBBBBBBBBBBBBBB", oauth_signature="CCCCCCCCCCCCCCCCCCCCCCCCCCC", oauth_signature_method="HMAC-SHA1", oauth_timestamp="1471672391", oauth_token="75463767-XhrwuoEAmHaeFD6RHWyvJXLphcsU8PA0oaCeCNVQD", oauth_version="1.0" > < HTTP/1.1 200 Connection established

kishoretiwari · ‎08-31-2017

@Geoffrey Shelton Okot. Yeah "Grab Garden Hose" . Using the curl from NiFi server, i am able to access that end point . curl https://stream.twitter.com/1.1/statuses/sample.json?delimited=length&stall_warnings=true [1] 5432 [root@c9t21841 nifi]# <html>\n<head>\n<meta http-equiv="Content-Type" content="text/html; charset=utf-8"/>\n<title>Error 401 Unauthorized</title> </head> <body> <h2>HTTP ERROR: 401</h2> <p>Problem accessing '/1.1/statuses/sample.json?delimited=length'. Reason: <pre> Unauthorized</pre> </body> </html>

kishoretiwari · ‎08-31-2017

@Joe Here is the output # service iptables status iptables: Firewall is not running.

kishoretiwari · ‎08-31-2017

@Geoffrey Shelton Okot I am selecting all then running he processors . It fails at the Twitter processor itself . .

kishoretiwari · ‎08-30-2017

@Geoffrey Shelton Okot Any finding please ? I am blocked due to that .

kishoretiwari · ‎08-30-2017

Try that as well. Same error . d4734] IOException caught when establishing connection to https://stream.twitter.com/1.1/statuses/sample.json?delimited=length&stall_warnings=true 2017-08-30 00:37:06,092 ERROR [Timer-Driven Process Thread-2] o.a.nifi.processors.twitter.GetTwitter GetTwitter[id=17f6d19f-6a6f-46df-a98c-5059921d4734] Received error CONNECTION_ERROR: connect timed out. Will attempt to reconnect 2017-

kishoretiwari · ‎08-29-2017

@Geoffrey Shelton Okot Here is the screen shot of Processor Properties . Following document i am following . https://hortonworks.com/tutorial/analyzing-social-media-and-customer-sentiment-with-apache-nifi-and-hdp-search/ @Geoffrey Shelton Okot Forgot to mention Error : 2017-08-29 11:06:12,043 WARN [hosebird-client-io-thread-0] com.twitter.hbc.httpclient.ClientBase GetTwitter[id=17f6d19f-6a6f-46df-a98c-5059921d4734] IOException caught when establishing connection to https://stream.twitter.com/1.1/statuses/filter.json?delimited=length&stall_warnings=true 2017-08-29 11:06:12,206 ERROR [Timer-Driven Process Thread-6] o.a.nifi.processors.twitter.GetTwitter GetTwitter[id=17f6d19f-6a6f-46df-a98c-5059921d4734] Received error CONNECTION_ERROR: connect timed out. Will attempt to reconnect 201 2017-08-29 11:06:17,212 ERROR [Timer-Driven Process Thread-6] o.a.nifi.processors.twitter.GetTwitter GetTwitter[id=17f6d19f-6a6f-46df-a98c-5059921d4734] Received error CONNECTION_ERROR: connect timed out. Will attempt to reconnect

kishoretiwari · ‎08-29-2017

@Geoffrey Shelton Okot NiFi Version : Version 1.2.0.3.0.0.0-453 .Its Cluster with HDP and Ambari Kerberized : No Bare Metal

kishoretiwari · ‎08-29-2017

@Geoffrey Shelton Okot . Can you please help here ?

kishoretiwari · ‎08-29-2017

Hi Team , Any update on my this issue ? Best regards ~Kishore

kishoretiwari · ‎08-28-2017

@Wynner Please find the attache screen clip of GetTwitter Processor conf .

kishoretiwari · ‎08-28-2017

Hi Team , I am getting following error while connecting from Nifi to Twitter . 2017-08-28 16:41:52,443 ERROR [Timer-Driven Process Thread-8] o.a.nifi.processors.twitter.GetTwitter GetTwitter[id=17f6d19f-6a6f-46df-95b5-23335e63fedd] Received error CONNECTION_ERROR: Failed to establish connection properly. Will attempt to reconnect

kishoretiwari · ‎08-24-2017

@Jay SenSharma . Tried that option didn't work .

kishoretiwari · ‎08-24-2017

@Jay SenSharma While installing the Solr from Ambari , i am getting following exception File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", line 303, in _call raise ExecutionFailed(err_msg, code, out, err) resource_management.core.exceptions.ExecutionFailed: Execution of '/usr/bin/yum -d 0 -e 0 -y install lucidworks-hdpsearch' returned 1. Error: failure: repodata/a2e514aba11a5426bbdbb7744c3d68f3ca97510b-primary.sqlite.bz2 from Delivery-SharedHosting-RedHat-6.5Server-x86_64: [Errno 256] No more mirrors to try. stdout:.

kishoretiwari · ‎08-24-2017

Thanks @Jay SenSharma With this i am able to get the Nifi . Solr didnt show up into "Choose Services " still .

kishoretiwari · ‎08-24-2017

Hi Team , I want to added Solr and NiFi into my exiting Ambari Cluster . Please help . Best regards ~Kishore

kishoretiwari · ‎08-23-2017

@Geoffrey Shelton Okot . Sorry i missed the last message . Can you please let me know how to do Accept the Response ?

kishoretiwari · ‎08-20-2017

@Geoffrey Shelton Okot Now all works . After deleting the old view . Thanks a lot @Geoffrey Shelton Okot for helping and answering question very prompt .

kishoretiwari · ‎08-20-2017

@Geoffrey Shelton Okot Now all those errors are fixed with this and i could mostly all Views . For Smart Sense view i am getting following error . ster information associated with this view instance 20 Aug 2017 11:07:02,068 ERROR [ambari-client-thread-28] ViewRegistry:930 - Could not find the cluster identified by 2. 20 Aug 2017 11:07:02,070 ERROR [ambari-client-thread-28] ContainerResponse:419 - The RuntimeException could not be mapped to a response, re-throwing to the HTTP container org.apache.ambari.server.view.IllegalClusterException: Failed to get cluster information associated with this view instance at org.apache.ambari.server.view.ViewRegistry.getCluster(ViewRegistry.java:931) at org.apache.ambari.server.view.ViewContextImpl.getCluster(ViewContextImpl.java:370) at org.apache.ambari.server.view.ViewContextImpl.getPropertyValues(ViewContextImpl.java:437) at org.apache.ambari.server.view.ViewContextImpl.getProperties(ViewContextImpl.java:171) at com.hortonworks.support.tools.view.ServerProxy.buildHeaders(ServerProxy.java:243) at com.hortonworks.support.tools.view.ServerProxy.execute(ServerProxy.java:133) at com.hortonworks.support.tools.view.ServerProxy.execute(ServerProxy.java:112) at com.hortonworks.support.tools.view.ServerProxy.execute(ServerProxy.java:94)

kishoretiwari · ‎08-20-2017

@Geoffrey Shelton Okot That use dosnt exist in Ambari server node . Its there in rest of Cluster hosts . Here is the output. drwxrwx--- - ambari-qa hdfs 0 2017-08-18 04:21 /user/ambari-qa drwxr-xr-x - hcat hdfs 0 2017-08-18 04:18 /user/hcat drwxr-xr-x - hive hdfs 0 2017-08-18 04:19 /user/hive Error now . Failed to transition to undefined Server status: 500 Server Message: <small> User: hdp is not allowed to impersonate admin </small>

Online	Offline
Last Visited	‎09-06-2017 07:59 AM

Date Registered	‎08-17-2017 07:42 AM
Last Visited	‎09-06-2017 07:59 AM
Total Messages Posted	54
Total Kudos Received	2

Re: Service 'hdfs' check failed-From Ambari

Re: Nifi behind proxy

Nifi behind proxy

Re: Unable to start the HDFS using Ambari

Re: Unable to start the HDFS using Ambari

Re: NiFi unable to connect Twitter

Unable to start the HDFS using Ambari

Re: NiFi unable to connect Twitter

Re: NiFi unable to connect Twitter

Re: NiFi unable to connect Twitter

Re: NiFi unable to connect Twitter

Re: NiFi unable to connect Twitter

Re: NiFi unable to connect Twitter

Re: NiFi unable to connect Twitter

Re: NiFi unable to connect Twitter

Re: NiFi unable to connect Twitter

Re: NiFi unable to connect Twitter

Re: NiFi unable to connect Twitter

Re: NiFi unable to connect Twitter

Re: NiFi unable to connect Twitter

Re: NiFi unable to connect Twitter

Re: NiFi unable to connect Twitter

NiFi unable to connect Twitter

Re: How to add NiFi and Solr using Ambari

Re: How to add NiFi and Solr using Ambari

Re: How to add NiFi and Solr using Ambari

How to add NiFi and Solr using Ambari

Re: "/usr" mount issue during the cluster creatio...

Re: Service 'hdfs' check failed-From Ambari

Re: Service 'hdfs' check failed-From Ambari

Re: Service 'hdfs' check failed-From Ambari