question Access to —files in driver in spark on k8s in Support Questions https://community.cloudera.com/t5/Support-Questions/Access-to-files-in-driver-in-spark-on-k8s/m-p/377460#M243275 <P>Hi, I’m running spark on k8s and would love to access files that are submitted with —files on the driver (not executor). I know files are uploaded to /tmp/spark-XXXX/ folder that is random, but I can’t find any environment variable that I can use in driver to access them.&nbsp;<BR /><BR /></P><P>the reason I want this is to pass a config file in —files with some parameters , and I want to access this file before I initialize spark context.</P> Wed, 11 Oct 2023 01:07:35 GMT Manado 2023-10-11T01:07:35Z Access to —files in driver in spark on k8s https://community.cloudera.com/t5/Support-Questions/Access-to-files-in-driver-in-spark-on-k8s/m-p/377460#M243275 <P>Hi, I’m running spark on k8s and would love to access files that are submitted with —files on the driver (not executor). I know files are uploaded to /tmp/spark-XXXX/ folder that is random, but I can’t find any environment variable that I can use in driver to access them.&nbsp;<BR /><BR /></P><P>the reason I want this is to pass a config file in —files with some parameters , and I want to access this file before I initialize spark context.</P> Wed, 11 Oct 2023 01:07:35 GMT https://community.cloudera.com/t5/Support-Questions/Access-to-files-in-driver-in-spark-on-k8s/m-p/377460#M243275 Manado 2023-10-11T01:07:35Z Re: Access to —files in driver in spark on k8s https://community.cloudera.com/t5/Support-Questions/Access-to-files-in-driver-in-spark-on-k8s/m-p/377465#M243276 <P><a href="https://community.cloudera.com/t5/user/viewprofilepage/user-id/107331">@Manado</a>,&nbsp;Welcome to our community! To help you get the best possible answer, I have tagged in our Spark experts <a href="https://community.cloudera.com/t5/user/viewprofilepage/user-id/78612">@RangaReddy</a>&nbsp;<a href="https://community.cloudera.com/t5/user/viewprofilepage/user-id/81193">@Babasaheb</a>&nbsp;who may be able to assist you further.<BR /><BR />Please feel free to provide any additional information or details about your query, and we hope that you will find a satisfactory solution to your question.</P> Wed, 11 Oct 2023 04:56:07 GMT https://community.cloudera.com/t5/Support-Questions/Access-to-files-in-driver-in-spark-on-k8s/m-p/377465#M243276 VidyaSargur 2023-10-11T04:56:07Z