Support Questions
Find answers, ask questions, and share your expertise

How do I view cluster specifications?

New Contributor

I'm very new to Cloudera and Spark. I need to know the specifications of the cluster I'm using, so I can better optimize my Spark session configuration (executors/cores/ram/etc). I'm trying to view these details in Cloudera Manager, but I'm not sure where to look. I want to know on the specific cluster I'm using, how many nodes it has, and how many cores and how much memory per node? Forgive my naivety, but some guidance would be appreciated!

1 ACCEPTED SOLUTION

Super Collaborator

Hello @Data1701 ,

 

The metrics you are looking for would be under the Hosts view in Cloudera Manager. On the left-hand panel in Cloudera Manager click on Hosts > All Hosts. This will list all of the hosts in the cluster, along with their physical memory and cores for each. Note that, by default, not all of the necessary columns may be visible in the table. To add columns of interest (e.g. cores), in the top right corner next to "Columns:" click Selected dropdown menu and choose the columns you need to see.

 

Hope this helps.

 

 

Regards,

Alex

View solution in original post

3 REPLIES 3

Super Collaborator

Hello @Data1701 ,

 

The metrics you are looking for would be under the Hosts view in Cloudera Manager. On the left-hand panel in Cloudera Manager click on Hosts > All Hosts. This will list all of the hosts in the cluster, along with their physical memory and cores for each. Note that, by default, not all of the necessary columns may be visible in the table. To add columns of interest (e.g. cores), in the top right corner next to "Columns:" click Selected dropdown menu and choose the columns you need to see.

 

Hope this helps.

 

 

Regards,

Alex

New Contributor

I did need to manually add 'cores' to the list, but I got it now. Thanks!

Super Collaborator

Happy to hear, @Data1701 . Accept reply as Solution if the answer helped. 

; ;