Solved
How to set default time zone/local time for SparkSql on Hue Sessions.
Hello
I am struggling to set the time zone for the sessions on Spark Sql while submitting the query over the HUE.Maybe somebody already has this problem and know how to solve it - I would be grateful for the help.
So far I checked that:
on pyspak session running on linux the time zone is the one i want :
spark.conf.get("spark.sql.session.timeZone")
'Europe/Warsaw'
However then i submit the TIMESTAMP on HUE running query against SparkSql I got the UTC Time Stamp.
SELECT TIMESTAMP 'now';
TIMESTAMP '2024-07-02 08:01:06.157849' My current time
| 1 | 2024-07-02T06:01:06Z |
I have also added the variable to the spark-defaults.conf file like spark.sql.session.timeZone=Europe/Warsaw
But after restarting Spark3 and Hue nothing has changed.
Thank you for your help in advance.
Regards,
Bart

