Member since
03-31-2015
10
Posts
0
Kudos Received
0
Solutions
07-18-2018
12:24 AM
@saileshmukil Thanks for this, we had 'rdns = false' in the krb5.conf, setting to true resolved this issue. Seems that this error (realm message) is another by-product of the bug. I've spent about 3 man days troubleshooting this issue so I'm glad I can move on!
... View more
07-12-2018
08:57 AM
1 Kudo
@mcalnd, Thank you for bringing this to our attention. I just tested on CM 5.13.1 and 5.15.0. I changed the percentage from 90 to 91. After about 10 seconds, both YARN services showed the configuration was stale. The diff showed the change I made I wonder if there may have been a problem with the staleness detection in CM in your case. If this happens again, you might try restarting Cloudera Manager and see if the stale config is detected and then review the CM log to see if there was anything going wrong with "staleness" detection. Thanks again!
... View more
06-18-2015
04:33 PM
1 Kudo
Hi Neil, As you said in your message, it all depends or what you want to run, however here are some guidelines. I'm not talking about the "data" drives since you can have as many as you want with the size you need. 1) CM requirements will apply to CDH, like for the /var folder 2) CM will start to alert you when Journal Nodes, Namenodes, and other processes directories start to be under 10GB. Therefore, accounting at least 20GB per service for the "meta" (logs, configs, binaries, etc.) is a good idea. So if you have a YARN + DN + Spark on a node, give them at least 60GB of disk space for 3) Master processes will use space based on the size of the cluster. Indeed, the bigger the cluster is, the more data, the more blocks, the more space is used on the NN and JN directories. So for clusters bigger than 30 nodes you might want to think about giving them a bit more. Now. It is not recommended to run any sercive on the OS disk (and not just partition). And since disks are bigger and bigger, you might end up with something like 1TB available on your partitition sur CM agaent + CDH services (on worker nodes). If that's the case, I don't think you should really worry about the available space and just share this space between the different mounting points (if split in partitions). Let me know if I can provide anymore details or information or if this doesn't reply to your question. JM
... View more
05-06-2015
04:10 AM
Thanks for the second command, this is very useful and a lot simpler to identify than netstat - Cheers!
... View more