Member since
07-23-2017
15
Posts
1
Kudos Received
0
Solutions
08-09-2017
05:21 AM
Not a lot of insights until now... I suspect that my free subscription to AWS EC2 could be the culprit (how could I be sure that it's the root cause?). It is possible that the default config (t2.micro) does not give enough memory to run nifi. I'll try with a t2.small instance.
... View more
08-09-2017
05:13 AM
Hi everybody, I'm installing Nifi with Ambari on AWS EC2. I got a similar error. What shall I do? Here the nifi-app.log: 2017-08-09 04:42:52,225 WARN [main] org.apache.nifi.web.server.JettyServer Failed to start web server... shutting down.
java.net.BindException: Cannot assign requested address
at sun.nio.ch.Net.bind0(Native Method)
at sun.nio.ch.Net.bind(Net.java:433)
at sun.nio.ch.Net.bind(Net.java:425)
at sun.nio.ch.ServerSocketChannelImpl.bind(ServerSocketChannelImpl.java:223)
at sun.nio.ch.ServerSocketAdaptor.bind(ServerSocketAdaptor.java:74)
at org.eclipse.jetty.server.ServerConnector.open(ServerConnector.java:298)
at org.eclipse.jetty.server.AbstractNetworkConnector.doStart(AbstractNetworkConnector.java:80)
at org.eclipse.jetty.server.ServerConnector.doStart(ServerConnector.java:236)
at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:68)
at org.eclipse.jetty.server.Server.doStart(Server.java:431)
at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:68)
at org.apache.nifi.web.server.JettyServer.start(JettyServer.java:705)
at org.apache.nifi.NiFi.<init>(NiFi.java:160)
at org.apache.nifi.NiFi.main(NiFi.java:267)
2017-08-09 04:42:52,228 INFO [Thread-1] org.apache.nifi.NiFi Initiating shutdown of Jetty web server...
2017-08-09 04:42:52,236 INFO [Thread-1] o.eclipse.jetty.server.AbstractConnector Stopped ServerConnector@25b88b09{HTTP/1.1,[http/1.1]}{<FQDN-of-my-EC2-instance>:9090}
2017-08-09 04:42:52,236 INFO [Thread-1] org.eclipse.jetty.server.session Stopped scavenging
... View more
08-04-2017
12:43 PM
So I "proceed anyway". Nifi starts on all nodes but after a couple of minutes stopped. I can't connect to the NFI UI on any node (error return by Edge: INET_E_RESOURCE_NOT_FOUND). What's wrong ? Where to look?
... View more
08-03-2017
07:48 PM
Hi I am a newbie on HDF. I try to test Nifi on a AWS EC2 4 nodes cluster using Ambari to install HDF 3.0. In the cluster install wizard I choose to setup only up Nifi Zookeeper (as it is a pre-requisite). After setting Zookeeper and Nifi as shown on the nodes_config picture, the only change I've done at the Customize Services step is to setup the Encrypt Configuration Master Key Password and the Sensitive property values encryption password. When clicking Next I got a warning and an error as shown inthe attached picture errors-config-nifi-with-ambari. What should I do?
... View more
Labels:
- Labels:
-
Apache Ambari
-
Cloudera DataFlow (CDF)
08-03-2017
06:44 PM
It seems that the content of this page has changed. There's no more information about ambari. Does somebody know where to find a tutorial to start nifi with ambari (for beginner)?
... View more
07-28-2017
01:56 PM
Note: Most usefull doc on the subject for me: https://docs.hortonworks.com/HDPDocuments/HDF2/HDF-2.1.4/bk_ambari-installation/bk_ambari-installation.pdf
... View more
07-28-2017
01:37 PM
Again replying my own last question, I find here that it is possible to configure Ambari for non-root access.
... View more
07-28-2017
11:58 AM
I passed a step forward now: I achieve password-less connection between instances using my key1 key pair with the ec2-user. For future me (and others who still wonder how), here are the steps: With key1.pem (my private key associated to the ec2-user of AWS), I generate the corresponding key1.pub key using putTTYgen (open puTTYgen, load the key1.pem or key1.ppk private key and then click "Save public key" button. I open a CMD Windows and do: pscp -i Key1.ppk Key1.pem ec2-user@<node name>.us-west-2.compute.amazonaws.com:.ssh/ pscp -i Key1.ppk Key1.pub ec2-user@<node name>.us-west-2.compute.amazonaws.com:.ssh/ (each time you will see something like : Key1.xxx | 0 kB | 0.5 kB/s | ETA: 00:00:00 | 100%) I open a terminal window on my EC2 node using PUTTY as ec2-user (with my Key1.ppk private key) and then I go into .ssh directory. [ec2-user@ip-xxx-xx-xx-xx ~]$ cd .ssh Then I protect the 2 key files (otherwize they will be refused by ssh) [ec2-user@ip-xxx-xx-xxx-xx .ssh]$ chmod 600 Key1* Now I can connect from this node to any other node without any password using the command: [ec2-user@ip-xxx-xx-xxx-xx .ssh]$ ssh -i Key1.pem ec2-user@<second node>.us-west-2.compute.amazonaws.com That's it! Remaining question: to install and setup Ambari do I need to use root or can I do it as ec2-user?
... View more
07-28-2017
09:55 AM
Thanks @Jay SenSharma for the information.
... View more
07-28-2017
09:23 AM
I begin to doubt that it is possible to reuse the same private key to connect to the instances as ec2-user from my local machine and to setup passowrd-less connections between the different instances. All installation documents of Ambari (to setup HDF or Nifi) point to the use of root user. But I could'nt connect as root@<myinstancename> from one instance to another or with putty on my local machine Under Windows to one instance.
... View more
07-28-2017
08:03 AM
Hi everybody, I have started a 4 instances cluster in AWS EC2 running RHEL 7.3 64 bits. I go through the step of converting my private ky with PuTTYgen. I connect to the first node using the ec2-user and the private key (call it key1.ppk) by using puTTY. So far so good. Now next steps are to set up password-less ssh between the different nodes so that later ambari can access to the different nodes to install the services. I'm trying to reuse my private key key1.ppk to do that by appending it to the authorized_keys file of each instances using the pscp command provided with puTTY. It seems that I need to add the keys to the root user of each instance but I can't find any mean to connect as root to my instances (only ec2-user is allowed)... How can I do that? I also try to append it to the ec2-user authorized_keys file but couln'dt also because of access denied it seems. What is the correct list of instructions with those tools? Thanks in advance for any hint.
... View more
Labels:
- Labels:
-
Apache Ambari
-
Apache NiFi
07-28-2017
07:51 AM
1 Kudo
All is in the question...
... View more
07-28-2017
07:33 AM
Thanks @Jay SenSharma. I used this document but I can't achieve what I want to do : setup password-less SSH between my EC2 instances running RHEL7 from my local machine running Windows. I've open a new thread (here) to give more details.
... View more
07-26-2017
01:25 PM
Hi how can i do the same with a local system running Windows?
... View more