Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Passing Unix Exported Variable in Pyspark code using Cluster mode in one go.

Highlighted

Passing Unix Exported Variable in Pyspark code using Cluster mode in one go.

New Contributor

Hi Techies,

 

Is there any way to pass all the unix exported variables into the pyspark script which is executing in the cluster mode. I can pass then as arguments but I am looking for a way as we do pass in beeline through parameter files, It can replace all the parameters in one go. If yes, how to do it.

 

Please guide.

 

Thanks,

Manu

Don't have an account?
Coming from Hortonworks? Activate your account here