Can you try livy.spark.master as YARN ... View more

Can you please let us know which spark and zeppelin version you are using? Is Kerberos is enabled in you cluster ? Below are few things to check to resolve this issue : 1)Make sure you configured livy.host and livy.group in custom-core.site (hdfs->Custom-core.site) Make sure they are configure to * for livy 2)Also you need to configure livy.superuser in your Livy interpreter too. 3)Yarn Queue access ? 4)if ranger is enabled , please make sure you have access to YARN queqe Hope this helps ... View more

I am also having the similar problem , My user login into Zeppelin notenook and authenticated by LDAP . After that they want to use 1)%livy2.pyspark 2)%livy2.sql with their login user no zeppelin. But when i enable user impersonation in livy, It fails My error is org.apache.zeppelin.livy.LivyException: {"msg":"User 'zeppelin-goa_datalake_1' not allowed to impersonate 'Some(sameer.dalai)'."} org.springframework.web.client.HttpClientErrorException: 403 Forbidden at org.springframework.web.client.DefaultResponseErrorHandler.handleError(DefaultResponseErrorHandler.java:91) at org.springframework.web.client.RestTemplate.handleResponse(RestTemplate.java:667) at org.springframework.web.client.RestTemplate.doExecute(RestTemplate.java:620) at org.springframework.security.kerberos.client.KerberosRestTemplate.doExecuteSubject(KerberosRestTemplate.java:202) at org.springframework.security.kerberos.client.KerberosRestTemplate.access$100(KerberosRestTemplate.java:67) at org.springframework.security.kerberos.client.KerberosRestTemplate$1.run(KerberosRestTemplate.java:191) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:360) How do i ensure to enable data scientist to use zeppelin to submit spark jobs using livy interpreter ? ... View more

how did you fixed this ... View more

Please refer to this website if this helps https://atlas.apache.org/ ... View more