Support Questions
Find answers, ask questions, and share your expertise

Connection problem Fiware CygnusKafka with HDP kafka

New Contributor

Hello everyone,

I am trying to connect the Fiware-cygnus (https://fiware-cygnus.readthedocs.io/en/latest/) with kafka HDP(I use the VM version).

The problem is following:

[2018-09-22 19:37:50,550] WARN [Consumer clientId=consumer-1, groupId=console-consumer-68523] Connection to node -1 could not be established. Broker may not be available. (org.apache.kafka.clients.NetworkClient)

[2018-09-22 19:37:50,615] WARN [Consumer clientId=consumer-1, groupId=console-consumer-68523] Connection to node -1 could not be established. Broker may not be available. (org.apache.kafka.clients.NetworkClient)

[2018-09-22 19:37:50,716] WARN [Consumer clientId=consumer-1, groupId=console-consumer-68523] Connection to node -1 could not be established. Broker may not be available. (org.apache.kafka.clients.NetworkClient)

[2018-09-22 19:37:50,968] WARN [Consumer clientId=consumer-1, groupId=console-consumer-68523] Connection to node -1 could not be established. Broker may not be available. (org.apache.kafka.clients.NetworkClient)

To evaluate if the cygnys is the problem, I have used the apache kafka package to connect with HDP kafka.

The producer:

./bin/kafka-console-producer.sh --broker-list sandbox-hdp.hortonworks.com:6667 --topic test

OpenJDK 64-Bit Server VM warning: If the number of processors is expected to increase from one, then you should configure the number of parallel GC threads appropria tely using -XX:ParallelGCThreads=N

>Hello

[2018-09-22 19:37:53,965] WARN [Producer clientId=console-producer] Connection to node -1 could not be established. Broker may not be available (org.apache.kafka.clients.NetworkClient)

[2018-09-22 19:37:54,073] WARN [Producer clientId=console-producer] Connection to node -1 could not be established. Broker may not be available. (org.apache.kafka.clients.NetworkClient)

The consumer:

./bin/kafka-console-consumer.sh --bootstrap-server sandbox-hdp.hortonworks.com:6667 --topic test --from-beginning OpenJDK 64-Bit Server VM warning: If the number of processors is expected to increase from one, then you should configure the number of parallel GC threads appropriately using -XX:ParallelGCThreads=N

[2018-09-22 19:37:50,550] WARN [Consumer clientId=consumer-1, groupId=console-consumer-68523] Connection to node -1 could not be established. Broker may not be available. (org.apache.kafka.clients.NetworkClient)

When I use the Fiware cygnus or producer and consumer kafka generic always have got the same error.

could someone help me? please.

Thak you very much.

Best regard.