Created 12-29-2020 10:42 PM
Hi can you help me on this, I'm trying to write data on hdfs using pyspark
I'm using cdh-6.3.1, it is a single node
32GB RAM
45 GB storage
8 core CPU.
I'm getting this exception, the directory is creating in hdfs location but data not loading.
this is my log
INFO SecurityManager
SecurityManager: authentication disabled; ui acls disabled; users with view permissions: Set(spark); groups with view permissions: Set(); users with modify permissions: Set(spark); groups with modify permissions: Set()
NFO FsHistoryProvider
History server ui acls disabled; users with admin permissions: groups with admin permissions
Thanks
Prasanna
Created 12-30-2020 12:50 AM
Hi I'm getting this exception please help me
WARN cluster.YarnScheduler: Initial job has not accepted any resources; check your cluster UI to ensure that workers are registered and have sufficient resources
Thanks
Prasanna
Created 01-01-2021 02:05 PM
Your problem resembles this one check your cluster UI to ensure that workers are registered and have sufficient resources
Happy hadooping