About bwang

bwang · ‎10-20-2017

The culprit is "Send Diagnostic Data to Cloudera Automatically" in Administration -> Settings -> Support. Because my cluster is running CDH 5.3.2, I guessed Cloudera probably shut down a service, so my cluster could not connect to the service, then the agent became crazy. After turning that off, such an issue never happen again.

bwang · ‎02-13-2017

If I have a cluster with two kinds of data nodes, one has 48TB disks and the other has 7TB disks. Will HDFS block placement strategy consider the free space of disk on a data node? If I run a Spark job, will the final write operation take the free disk space into consideration? I could not find the answer by myself. Could you point me some document talking about this? Thanks

bwang · ‎11-16-2016

I'm running Cloudera Manager 5.3.2 and have the exact same issue every Wednesday at sometime between 4:00pm to 4:40pm. Because the cloudera-scm-agent is too busy, cloudera manager sends a lot of warnings and errors. It suddenly happened in July, 2016. Before that, it had been running ok for a year. I have to restart the service clouder-scm-agent when this happens. Is there something I can do? We may not upgrade to the latest version soon.

Online	Offline
Last Visited	‎01-09-2018 03:44 PM

Member Since	‎11-16-2016 05:08 PM
Last Visited	‎01-09-2018 03:44 PM
Posts	5

Cloudera Community

Re: python process takes 100% cpu time

Hadoop data nodes with different disk space

Re: python process takes 100% cpu time