Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

User impersonation for Spark yarn-cluster mode not working in Zeppelin in a kerberized HDP cluster

User impersonation for Spark yarn-cluster mode not working in Zeppelin in a kerberized HDP cluster

New Contributor

Hey there,

I'm trying to use user impersonation for the Spark interpreter in yarn-cluster mode to reduce the load of the Zeppelin host. The HDP cluster is kerberized and Zeppelin is in version 0.8.0. After trying to execute some spark code I get the following error:

java.lang.RuntimeException: Error: Only one of --proxy-user or --principal can be provided.

A short Google search shows that you can't use spark-submit with both a principal and proxy user, what Zeppelin is trying to do I guess?

Does anyone know how I can fix this and use the Spark interpreter in yarn-cluster mode with user impersonation on a kerberized cluster? Any help would be appreciated.

Best regards,

Markus