Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

python environments with "local" and "yarn-client" - Boto failing on HDP2.5

python environments with "local" and "yarn-client" - Boto failing on HDP2.5

New Contributor

I am making some calls with Boto3 in my pyspark which is working fine in master=local mode but when I switch to master=yarn I am getting "NoCredentialsError: Unable to locate credentials" which is a bit annoying as I cannot work out why!I have been running this application fine on Mesos and EMR. Does HDP PySpark2 run within a virtualenv or something?