@Krish Khambadkone - I noticed in the command that you posted that... spark-streaming_2.11-2.1.1.2.6.2.0-205.jar--class KafkaMain has no space between "jar" and "--class"... I assume this was maybe a typo, but I thought I would mention it. Can you run one of the Spark examples successfully? (e.g. try org.apache.spark.examples.streaming.JavaNetworkWordCount from /usr/hdp/current/spark-client/lib/spark-examples-*.jar (you will need to double check for the exact jar name). If that fails, I recommending sharing the YARN applications logs (i.e. run "yarn logs -applicationId <app id>"). ... View more

you can stage your data somewhere and use "Insert into AcidTable Select * from ..." If the data originates in some streaming fashion then Streaming Ingest may be appropriate - this has been integrated with Stork, Flume and NiFi. Load Data statement is not supported in 2.x. ... View more

Thank you for the detailed response. The reason for my questions was, it seems in this process of deploying and running LLAP, some zip files are generated and some custom zip input and output formats are being used to read these at runtime. Is this part of the standard process or you think this could have been streamlined and made more generic. ... View more

I also tried setting "xasecure.add-hadoop-authorization" = false but get the same error. What am I missing here. I believe I have followed all the steps and put the right policies in place. Could someone please help ... View more