Member since
07-15-2018
5
Posts
0
Kudos Received
0
Solutions
01-23-2019
04:55 PM
Hello, you cannot create a NIFI cluster with only 2 nodes. You need 3 nodes (quorum). There is nothing specific to Ubuntu of my pov. Start by creating a zookeeper cluster to get a 3 nodes (leader/follower/follower) configuration's working. Then install one nifi, connect it to zookeeper cluster (with nifi.properties and properties like nifi.zookeeper.connect.string) and start. Then install node 2 & 3, copy thd config/flow.xml.gz from 1 then start. More details here : https://pierrevillard.com/2016/08/13/apache-nifi-1-0-0-cluster-setup/ (The full installation process can be more complicated if you need HTTPS, LDAP users etc).
... View more
08-15-2018
05:19 PM
Solved : i had to import cloudamqp cert (.cer) inside a JKS trustore, referenced in the SSL Context.
... View more
07-15-2018
04:38 PM
If you use large attributes, you will have serious issue with the "snapshot" file in the flow content repository. I've just killed my PROD this way last week : the snapshot was too big too fit in memory at startup : my data was lost.
... View more
07-15-2018
04:33 PM
With NIFI 1.7.0 (windows 10, jre8) i'm trying to consume message from CloudAMPQ using AMQPS (amqp / tls) My URI is : amqps://xmabtrto:xxxxxxxxxx@sheep.rmq.cloudamqp.com/xmabtrto With processor executeScript + groovy : OK (but i do not pool connection, so it is low-perf...) With processor ConsumeAMQP : KO Bulletin : Failed to establish connection with AMQP Broker: com.rabbitmq.client.ConnectionFactory@2a835d25; My ConsumeAMQP settings are : host : sheep.rmq.cloudamqp.com virtualhost : xmabtrto user : xmabtrto port : 5671 (5672 works since it is plain amqp). SSL Context Service : no value Use Certificate Authentication : false Client Auth : REQUIRED I've tried using an SSL Context generated by the toolkit but it doesn't work neither (and i don't want to auth with cert). Working executeScript groovy code : import com.rabbitmq.client.*
import org.apache.commons.io.IOUtils
import java.nio.charset.*
def factory = new ConnectionFactory();
factory.setUri("amqps://xmabtrto:xxxxxxxxxx@sheep.rmq.cloudamqp.com/xmabtrto");
def conn = factory.newConnection();
def channel = conn.createChannel()
//...
channel.close()
conn.close()
Any idea how to make ConsumeAMQP works with amqps ?
... View more
Labels:
- Labels:
-
Apache Kafka
-
Apache NiFi