Hi Nilesh, I know it is too late to answer, still lets add a solution for future issues Please try --conf "spark.executor.extraJavaOptions=-XX:+UseG1GC -Djava.security.auth.login.config=kafka_jaas.conf" instead of --conf "spark.executor.extraJavaOptions=-XX:+UseG1GC -Djava.security.auth.login.config=/home/user/sparktest/kafka_jaas.conf" Also ensure to use just the file name 'user.headless.keytab' in jaas file (not absolute file path) . eg: KafkaClient { com.sun.security.auth.module.Krb5LoginModule required doNotPrompt=true useTicketCache=false principal="userprincipalname" useKeyTab=true serviceName="kafka" keyTab="user.headless.keytab" client=true; }; Thanks Vinod ... View more

@Venkata Sudheer Kumar M Can you please share the spark documentation which refers "SPARK_YARN_DIST_FILES" ? In Spark 2.2 code, I couldn't locate usage of this env variable. ... View more

Hi Anilkumar, While submitting spark application , you need to pass your Teradata jdbc Driver jar file that with --jar option Thanks Vinod ... View more

Updated link : https://github.com/hortonworks/data-tutorials/blob/master/tutorials/hdf/hdf-2.1/realtime-event-processing-in-hadoop-with-nifi-kafka-and-storm/assets/IoT_Lab_Series_DataFlow.xml ... View more