question pass parameters to file with sql statement using Scala to be used sqlContext.sql(string) in Support Questions

pass parameters to file with sql statement using Scala to be used sqlContext.sql(string)

TF123 — Tue, 21 Apr 2026 11:38:12 GMT

I am using Scala on data science workbench and I have file with sql stataement would like to make it dynamic sql by passing argument to parameters. I then would like to pass it sqlContext.sql(string) .

This is what I have tried but does not work.

val FromDate = "2019-02-25"

val sqlfile = fromFile("sql3.py").getLines.mkString

val result = sqlContext.sql(sqlfile)

On the file I have:

Select col1, col2 from table1 where transdate = '${FromDate}'

Any help would be appreciated.

Thanks

Re: pass parameters to file with sql statement using Scala to be used sqlContext.sql(string)

Gopinath — Thu, 07 Mar 2019 12:17:24 GMT

Did you try CDSW environment variables?

https://www.cloudera.com/documentation/data-science-workbench/latest/topics/cdsw_environment_variables.html#access_env_variables

Re: pass parameters to file with sql statement using Scala to be used sqlContext.sql(string)

TF123 — Thu, 07 Mar 2019 13:55:10 GMT

This worked at the end..

val FromDate = "2019-02-25"

val sqlfile = fromFile("sql3.py").getLines.mkString

val sqlfil2= sqlfile.replace("${From_timeStamp}",From_timeStamp)

val result = sqlContext.sql(sqlfile2)

On the file I have:

Select col1, col2 from table1 where transdate = '${FromDate}'

Re: pass parameters to file with sql statement using Scala to be used sqlContext.sql(string)

rohit19 — Sat, 09 Oct 2021 18:56:40 GMT

Only one question I have the line which you made bold in that you are trying to replace "from_timestamp" but you are using "fromdate" in your sql file.

Any reason behind it ?