Support Questions

Find answers, ask questions, and share your expertise
Announcements
Celebrating as our community reaches 100,000 members! Thank you!

kafka connect thread is disappearing

avatar
New Contributor

i have run kafka connect in distribute mode for a few months,  but this morning, one kafka connect node is down, and i can not see the kafka connect thread using "ps -ef | grep connect", and connect.log has no error message, can anyone help me? how do i handle this? thanks a lot.

1 REPLY 1

avatar
Expert Contributor

If the connector is running on top of CDP, you can check the log files under /var/log/kafka or /run/cloudera-scm-agent/process/xxxxxxxx-kafka-KAFKA_CONNECT/logs

 

If this is standalone kafka connect and no details in any log file, I would suggest adding the below JVM property to the process:

 

-XX:ErrorFile=targetDir/hs_err_pid_%p.log

 

The above property is to create a file when the JVM crash, when this happens no details are added to the log files.

 

Hope that helps to find the root cause.