@SatyamKumar I run a bigger cluster with less cores on my CDH manager server than you do, and I have my limit at 40,000. It works fine for me.
My best advice to you is increase your limit until you are able to pull up the graphs you need without errors. Then look at historical performance metrics for your CDH manager server to see if any resources are being pegged out. Practically speaking though, you should be able to increases it a lot and be just fine without adding more memory or cores.
As per your cluster can you provide me below information please. Based upon that I will tweak my cluster.
- Number of nodes in cluster
- Streaming limit (For my cluster it is 250)
- Number of cores per node
- Memory/RAM provided per node