question Re: Zeppelin Cannot access - Public Cloud in Support Questions

Zeppelin Cannot access - Public Cloud

LakshmiSegu — Fri, 06 May 2022 08:28:23 GMT

I am having a challenge with the access control for credentials while trying to execute the spark process in Zeppelin, can anyone help?

ERROR idbroker.AbstractIDBClient: Cloud Access Broker response: { "error": "There is no mapped role for the group(s) associated with the authenticated user.",

Regards

Lakshmi Segu

Re: Zeppelin Cannot access - Public Cloud

shehbazk — Wed, 11 May 2022 08:28:06 GMT

Hello Lakshmi

- The role you are mapping to the user in the IDBroker mapping section has the right S3 bucket specified? Or are you using the same bucket created during the DataLake deployment?
	- Can you also make sure that Spark is configured to point to the S3 bucket [1]. For Spark, it is required to define the S3 bucket name in the following property "spark.yarn.access.hadoopFileSystems".
	Example: If using a DataHub cluster, Access to the DH in the Management Console > CM-UI > Clusters > Spark > Configurations > Create a file names "spark-defaults.conf" or update the existing file with the property:
	spark.yarn.access.hadoopFileSystems=s3a://bucket_name

DL--Manage Access-- IDBroker Mappings -- edit -- It was given the Data Access Role.
DH --Manage Access-- Assigned your self required roles

Re: Zeppelin Cannot access - Public Cloud

smdas — Wed, 22 Jun 2022 06:38:37 GMT

Hello @LakshmiSegu

We hope your query was addressed by Shehbaz's response. In Summary,

(I) Ensure you Username has an IDBroker Mapping (Actions > Manage Access > IDBroker Mappings).

(II) Include the "spark.yarn.access.hadoopFileSystems" Parameter to point to the S3 Path [1].

Regards, Smarak

[1] https://docs.cloudera.com/runtime/7.2.15/developing-spark-applications/topics/spark-s3.html

Re: Zeppelin Cannot access - Public Cloud

smdas — Wed, 06 Jul 2022 14:49:19 GMT

Hello @LakshmiSegu

We hope your Q concerning the Zeppelin Access issue is addressed by our 06/21 Post. As such, We shall mark the Post as Resolved. If you have any concerns, Feel free to update the Post & we shall get back to you accordingly.

Regards, Smarak