Hi can you help me on this, I'm trying to write data on hdfs using pyspark
I'm using cdh-6.3.1, it is a single node
45 GB storage
8 core CPU.
I'm getting this exception, the directory is creating in hdfs location but data not loading.
this is my log
SecurityManager: authentication disabled; ui acls disabled; users with view permissions: Set(spark); groups with view permissions: Set(); users with modify permissions: Set(spark); groups with modify permissions: Set()
History server ui acls disabled; users with admin permissions: groups with admin permissions
Hi I'm getting this exception please help me
WARN cluster.YarnScheduler: Initial job has not accepted any resources; check your cluster UI to ensure that workers are registered and have sufficient resources