Hi can you help me on this, I'm trying to write data on hdfs using pyspark
I'm using cdh-6.3.1, it is a single node
32GB RAM
45 GB storage
8 core CPU.
I'm getting this exception, the directory is creating in hdfs location but data not loading.
this is my log
INFO SecurityManager
SecurityManager: authentication disabled; ui acls disabled; users with view permissions: Set(spark); groups with view permissions: Set(); users with modify permissions: Set(spark); groups with modify permissions: Set()
NFO FsHistoryProvider
History server ui acls disabled; users with admin permissions: groups with admin permissions
Thanks
Prasanna