Running a script as a oozie action, I'm missing (it's not logged anywhere) output from spark log4j and python logging. I can see only stdout from python (print() function) and bash. I did not figured it out why logger dont work in oozie. ... View more

Unfortunatelly, it does not work anymore. I've been told, that oozie pyspark is not supported anymore. Is it true? Launcher ERROR, reason: Main class [org.apache.oozie.action.hadoop.SparkMain], exit code [1] Truth is, I tried lots of different solutions, but the results is the same... ... View more

I suggest to read you this topic. Might be helpful. ... View more

saveAsTable("my_table") is deprecated. Create new ampty table, insert and overwrite data into it. ... View more