Hello Champions
I am experiencing "HeapDumpOnOutOfMemoryError" issue, kafka fails to start. I tired with increasing broker memory size from 1 GIB to 8 GIB gradually, but didn't worked out. I checked with the cloudera documentation of it says incompatible java-version cloud lead to this error, It is working with different version of kafka. Kafka ends with supervisor FATAL Error. Please help me in fix this.
1. CDH-5.16.1
2. KAFKA-4.0.0-1.4.0.0.p0.1
3. oracle-j2sdk1.7-1.7.0+update67-1
4. referred documentation url
https://www.cloudera.com/documentation/kafka/latest/topics/kafka_requirements.html
Enclosures
Output of Log files
STDERR
+ KAFKA_JVM_PERFORMANCE_OPTS='-XX:+HeapDumpOnOutOfMemoryError -XX:HeapDumpPath=/tmp/kafka_kafka-KAFKA_BROKER-68060b45508aa72beab22be5c6595321_pid16923.hprof -XX:OnOutOfMemoryError=/usr/lib64/cmf/service/common/killparent.sh -server -XX:+UseParNewGC -XX:+UseConcMarkSweepGC -XX:+CMSClassUnloadingEnabled -XX:+CMSScavengeBeforeRemark -XX:+DisableExplicitGC -Djava.awt.headless=true'
+ [[ false == \t\r\u\e ]]
+ exec /opt/cloudera/parcels/KAFKA-4.0.0-1.4.0.0.p0.1/lib/kafka/bin/kafka-server-start.sh /run/cloudera-scm-agent/process/163-kafka-KAFKA_BROKER/kafka.properties
Exception in thread "main" java.lang.UnsupportedClassVersionError: org/apache/kafka/common/utils/KafkaThread : Unsupported major.minor version 52.0
at java.lang.ClassLoader.defineClass1(Native Method)
at java.lang.ClassLoader.defineClass(ClassLoader.java:800)
at java.security.SecureClassLoader.defineClass(SecureClassLoader.java:142)
at java.net.URLClassLoader.defineClass(URLClassLoader.java:449)
at java.net.URLClassLoader.access$100(URLClassLoader.java:71)
at java.net.URLClassLoader$1.run(URLClassLoader.java:361)
at java.net.URLClassLoader$1.run(URLClassLoader.java:355)
at java.security.AccessController.doPrivileged(Native Method)
at java.net.URLClassLoader.findClass(URLClassLoader.java:354)
at java.lang.ClassLoader.loadClass(ClassLoader.java:425)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:308)
at java.lang.ClassLoader.loadClass(ClassLoader.java:358)
at kafka.utils.Log4jControllerRegistration$.<init>(Logging.scala:30)
at kafka.utils.Log4jControllerRegistration$.<clinit>(Logging.scala)
at kafka.utils.Logging$class.$init$(Logging.scala:47)
at com.cloudera.kafka.wrap.Kafka$.<init>(Kafka.scala:29)
at com.cloudera.kafka.wrap.Kafka$.<clinit>(Kafka.scala)
at com.cloudera.kafka.wrap.Kafka.main(Kafka.scala)
STDOUT
Kafka version found: 2.1.0-kafka4.0.0
Sentry version found: 1.5.1-cdh5.10.2
ZK_PRINCIPAL_NAME: zookeeper
Final Zookeeper Quorum is cdh-3.us-east4-b.c.static-protocol-238105.internal:2181
security.inter.broker.protocol inferred as PLAINTEXT
LISTENERS=listeners=PLAINTEXT://cdh-3.us-east4-b.c.static-protocol-238105.internal:9092,
Sat Apr 27 15:59:21 UTC 2019
JAVA_HOME=/usr/java/jdk1.7.0_67-cloudera
Using -XX:+HeapDumpOnOutOfMemoryError -XX:HeapDumpPath=/tmp/kafka_kafka-KAFKA_BROKER-68060b45508aa72beab22be5c6595321_pid16923.hprof -XX:OnOutOfMemoryError=/usr/lib64/cmf/service/common/killparent.sh as CSD_JAVA_OPTS
Using /run/cloudera-scm-agent/process/163-kafka-KAFKA_BROKER as conf dir
Using scripts/control.sh as process script
CONF_DIR=/run/cloudera-scm-agent/process/163-kafka-KAFKA_BROKER
CMF_CONF_DIR=/etc/cloudera-scm-agent
Date: Sat Apr 27 15:59:22 UTC 2019
Host: cdh-3.us-east4-b.c.static-protocol-238105.internal
Pwd: /run/cloudera-scm-agent/process/163-kafka-KAFKA_BROKER
CONF_DIR: /run/cloudera-scm-agent/process/163-kafka-KAFKA_BROKER
KAFKA_HOME: /opt/cloudera/parcels/KAFKA-4.0.0-1.4.0.0.p0.1/lib/kafka
Zookeeper Quorum: cdh-3.us-east4-b.c.static-protocol-238105.internal:2181
Zookeeper Chroot:
PORT: 9092
JMX_PORT: 9393
SSL_PORT: 9093
ENABLE_MONITORING: true
METRIC_REPORTERS: nl.techop.kafka.KafkaHttpMetricsReporter
BROKER_HEAP_SIZE: 4096
BROKER_JAVA_OPTS: -server -XX:+UseParNewGC -XX:+UseConcMarkSweepGC -XX:+CMSClassUnloadingEnabled -XX:+CMSScavengeBeforeRemark -XX:+DisableExplicitGC -Djava.awt.headless=true
BROKER_SSL_ENABLED: false
KERBEROS_AUTH_ENABLED: false
KAFKA_PRINCIPAL:
SECURITY_INTER_BROKER_PROTOCOL: INFERRED
AUTHENTICATE_ZOOKEEPER_CONNECTION: true
SUPER_USERS: kafka
Kafka version found: 2.1.0-kafka4.0.0
Sentry version found: 1.5.1-cdh5.10.2
ZK_PRINCIPAL_NAME: zookeeper
Final Zookeeper Quorum is cdh-3.us-east4-b.c.static-protocol-238105.internal:2181
security.inter.broker.protocol inferred as PLAINTEXT
LISTENERS=listeners=PLAINTEXT://cdh-3.us-east4-b.c.static-protocol-238105.internal:9092
