Cloudera Community
gitanjali_bare
user rank
Explorer

Re: Publish Kafka Error --- Time out

by Explorer in Support Questions
‎09-28-2018 10:08 AM
‎09-28-2018 10:08 AM
@Rohit Sharma Thanks for the reply. I have followed same steps. It also worked for me. Its Either way, the UDP connections should open for KDC port OR add "udp_preference_limit =1" in krb5.conf file. ... View more

Re: Publish Kafka Error --- Time out

by Explorer in Support Questions
‎09-26-2018 09:43 PM
‎09-26-2018 09:43 PM
@dbains please find logs in detail: Exception in thread "main" org.apache.kafka.common.KafkaException: Failed to construct kafka producer at org.apache.kafka.clients.producer.KafkaProducer.<init>(KafkaProducer.java:335) at org.apache.kafka.clients.producer.KafkaProducer.<init>(KafkaProducer.java:188) at com.ril.fnl.kafka.producer.service.BasicProducerExample.main(BasicProducerExample.java:30) Caused by: org.apache.kafka.common.KafkaException: javax.security.auth.login.LoginException: Receive timed out at org.apache.kafka.common.network.SaslChannelBuilder.configure(SaslChannelBuilder.java:86) at org.apache.kafka.common.network.ChannelBuilders.create(ChannelBuilders.java:70) at org.apache.kafka.clients.ClientUtils.createChannelBuilder(ClientUtils.java:83) at org.apache.kafka.clients.producer.KafkaProducer.<init>(KafkaProducer.java:277) ... 2 more Caused by: javax.security.auth.login.LoginException: Receive timed out at com.sun.security.auth.module.Krb5LoginModule.attemptAuthentication(Krb5LoginModule.java:808) at com.sun.security.auth.module.Krb5LoginModule.login(Krb5LoginModule.java:617) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at javax.security.auth.login.LoginContext.invoke(LoginContext.java:755) at javax.security.auth.login.LoginContext.access$000(LoginContext.java:195) at javax.security.auth.login.LoginContext$4.run(LoginContext.java:682) at javax.security.auth.login.LoginContext$4.run(LoginContext.java:680) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.login.LoginContext.invokePriv(LoginContext.java:680) at javax.security.auth.login.LoginContext.login(LoginContext.java:587) at org.apache.kafka.common.security.authenticator.AbstractLogin.login(AbstractLogin.java:69) at org.apache.kafka.common.security.kerberos.KerberosLogin.login(KerberosLogin.java:110) at org.apache.kafka.common.security.authenticator.LoginManager.<init>(LoginManager.java:46) at org.apache.kafka.common.security.authenticator.LoginManager.acquireLoginManager(LoginManager.java:68) at org.apache.kafka.common.network.SaslChannelBuilder.configure(SaslChannelBuilder.java:78) ... 5 more Caused by: java.net.SocketTimeoutException: Receive timed out at java.net.PlainDatagramSocketImpl.receive0(Native Method) at java.net.AbstractPlainDatagramSocketImpl.receive(AbstractPlainDatagramSocketImpl.java:143) at java.net.DatagramSocket.receive(DatagramSocket.java:812) at sun.security.krb5.internal.UDPClient.receive(NetClient.java:206) at sun.security.krb5.KdcComm$KdcCommunication.run(KdcComm.java:411) at sun.security.krb5.KdcComm$KdcCommunication.run(KdcComm.java:364) at java.security.AccessController.doPrivileged(Native Method) at sun.security.krb5.KdcComm.send(KdcComm.java:348) at sun.security.krb5.KdcComm.sendIfPossible(KdcComm.java:253) at sun.security.krb5.KdcComm.send(KdcComm.java:229) at sun.security.krb5.KdcComm.send(KdcComm.java:200) at sun.security.krb5.KrbAsReqBuilder.send(KrbAsReqBuilder.java:316) at sun.security.krb5.KrbAsReqBuilder.action(KrbAsReqBuilder.java:361) at com.sun.security.auth.module.Krb5LoginModule.attemptAuthentication(Krb5LoginModule.java:776) ... 22 more ... View more

Publish Kafka Error --- Time out

by Explorer in Support Questions
‎09-25-2018 06:37 AM
‎09-25-2018 06:37 AM
Hello, We have already done with the configuration for Publishkafka_0_10 kerberized kafka for DEV server. The configuration we done are as follows: 1. relnm entry in krb5.conf. 2. Done with kinit using keytab file and principal/ checked with klist. 3.change in nifi_jaas.conf. 4. added entry for jaas in bootstrap.conf file. with above configuration we were able to send messages in DEV kafka server topics. Now, we want to point the same to PROD server, so we have made same changes to point it to PROD from the same source server. checked telnet with the KDC port (88) , kafka broker port (6667) and zookeeper port (2181). changed relnm. But still we are facing time out error. kindly help. Thanks, Gitanjali ... View more
Labels:

Re: Error while using publish kafka

by Explorer in Support Questions
‎08-06-2018 01:48 PM
‎08-06-2018 01:48 PM
@Steven Matison Hi Steven, Thanks For Reply. 1. Kafka Broker: hostname:6667 - many times documentation shows a different port, use 6667=== Used same port 6667 2. Topic Name: Mine is a variable, you can enter anything here: "test", etc====Entered fixed topic 3. Kafka Key: Not required you can leave it empty.====Its empty We are using Kerberized Kafka. Keytab and principal have defined in properties. PFA for properties. nifi-property.png Thanks, Gitanjali ... View more

Error while using publish kafka

by Explorer in Support Questions
‎08-06-2018 08:52 AM
‎08-06-2018 08:52 AM
Hello, Trying to push message to kafka using PublishKafka processor. Getting Error as given below: 2018-08-06 13:55:42,563 ERROR [Timer-Driven Process Thread-4] o.a.n.p.kafka.pubsub.PublishKafka_0_10 PublishKafka_0_10[id=01641014-a4dd-1982-315b-470a1ec73b5b] PublishKafka_0_10[id=01641014-a4dd-1982-315b-470a1ec73b5b] failed to process session due to org.apache.kafka.common.KafkaException: Failed to construct kafka producer: {} org.apache.kafka.common.KafkaException: Failed to construct kafka producer at org.apache.kafka.clients.producer.KafkaProducer.<init>(KafkaProducer.java:342) at org.apache.kafka.clients.producer.KafkaProducer.<init>(KafkaProducer.java:166) at org.apache.nifi.processors.kafka.pubsub.PublisherPool.createLease(PublisherPool.java:61) at org.apache.nifi.processors.kafka.pubsub.PublisherPool.obtainPublisher(PublisherPool.java:56) at org.apache.nifi.processors.kafka.pubsub.PublishKafka_0_10.onTrigger(PublishKafka_0_10.java:312) at org.apache.nifi.processor.AbstractProcessor.onTrigger(AbstractProcessor.java:27) at org.apache.nifi.controller.StandardProcessorNode.onTrigger(StandardProcessorNode.java:1122) at org.apache.nifi.controller.tasks.ContinuallyRunProcessorTask.call(ContinuallyRunProcessorTask.java:147) at org.apache.nifi.controller.tasks.ContinuallyRunProcessorTask.call(ContinuallyRunProcessorTask.java:47) at org.apache.nifi.controller.scheduling.TimerDrivenSchedulingAgent$1.run(TimerDrivenSchedulingAgent.java:128) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) Caused by: org.apache.kafka.common.KafkaException: javax.security.auth.login.LoginException: ICMP Port Unreachable at org.apache.kafka.common.network.SaslChannelBuilder.configure(SaslChannelBuilder.java:94) at org.apache.kafka.common.network.ChannelBuilders.create(ChannelBuilders.java:93) at org.apache.kafka.common.network.ChannelBuilders.clientChannelBuilder(ChannelBuilders.java:51) at org.apache.kafka.clients.ClientUtils.createChannelBuilder(ClientUtils.java:84) at org.apache.kafka.clients.producer.KafkaProducer.<init>(KafkaProducer.java:305) ... 16 common frames omitted ... View more
Labels:

Re: Hi, Why Input port should be created on top le...

by Explorer in Support Questions
‎07-10-2018 06:10 AM
‎07-10-2018 06:10 AM
Thanks for reply, Will try this out 🙂 ... View more

Re: Hi, Why Input port should be created on top le...

by Explorer in Support Questions
‎07-06-2018 12:52 PM
‎07-06-2018 12:52 PM
Thanks a lot!!! ... View more
Contact Me
Online
Offline
Last Visited
‎01-17-2019 08:20 AM
Community Statistics
Member Since ‎07-04-2018 06:55 AM
Last Visited ‎01-17-2019 08:20 AM
Posts 11