I'm trying to use user impersonation for the Spark interpreter in yarn-cluster mode to reduce the load of the Zeppelin host. The HDP cluster is kerberized and Zeppelin is in version 0.8.0. After trying to execute some spark code I get the following error:
java.lang.RuntimeException: Error: Only one of --proxy-user or --principal can be provided.
A short Google search shows that you can't use spark-submit with both a principal and proxy user, what Zeppelin is trying to do I guess?
Does anyone know how I can fix this and use the Spark interpreter in yarn-cluster mode with user impersonation on a kerberized cluster? Any help would be appreciated.