Created 12-02-2019 03:21 PM
Hi All,
I need to write Spark job output file to NFS mount point from spark2 shell. can you please let me know if there is any way to do it by defining absolute path in Spark2 shell.
Thanks,CS
Created 12-03-2019 11:12 AM
Created 01-06-2020 11:07 PM
@Chittu
Can you share your code example? The should be an option to specify mode='overwrite' when saving a DataFrame:
myDataFrame.save(path='"/output/folder/path"', source='parquet', mode='overwrite')
Please revert