Reply
New Contributor
Posts: 12
Registered: ‎09-09-2017

Passing Unix Exported Variable in Pyspark code using Cluster mode in one go.

Hi Techies,

 

Is there any way to pass all the unix exported variables into the pyspark script which is executing in the cluster mode. I can pass then as arguments but I am looking for a way as we do pass in beeline through parameter files, It can replace all the parameters in one go. If yes, how to do it.

 

Please guide.

 

Thanks,

Manu

Announcements