Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

pass parameters to file with sql statement using Scala to be used sqlContext.sql(string)

SOLVED Go to solution
Highlighted

pass parameters to file with sql statement using Scala to be used sqlContext.sql(string)

New Contributor

I am using Scala on data science workbench and I have file with sql stataement would like to make it dynamic sql by passing argument to parameters. I then would like to pass it  sqlContext.sql(string) .

 

This is what I have tried but does not work.

val FromDate = "2019-02-25"

val sqlfile = fromFile("sql3.py").getLines.mkString

val result = sqlContext.sql(sqlfile)

On the file I have:

Select col1, col2 from table1 where transdate = '${FromDate}'

 

Any help would be appreciated

 

Thanks

1 ACCEPTED SOLUTION

Accepted Solutions

Re: pass parameters to file with sql statement using Scala to be used sqlContext.sql(string)

New Contributor

This worked at the end..

 

val FromDate = "2019-02-25"

val sqlfile = fromFile("sql3.py").getLines.mkString

val sqlfil2= sqlfile.replace("${From_timeStamp}",From_timeStamp)

val result = sqlContext.sql(sqlfile2)

On the file I have:

Select col1, col2 from table1 where transdate = '${FromDate}'

2 REPLIES 2

Re: pass parameters to file with sql statement using Scala to be used sqlContext.sql(string)

Cloudera Employee

Re: pass parameters to file with sql statement using Scala to be used sqlContext.sql(string)

New Contributor

This worked at the end..

 

val FromDate = "2019-02-25"

val sqlfile = fromFile("sql3.py").getLines.mkString

val sqlfil2= sqlfile.replace("${From_timeStamp}",From_timeStamp)

val result = sqlContext.sql(sqlfile2)

On the file I have:

Select col1, col2 from table1 where transdate = '${FromDate}'