Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

HDC Is there s difference in the configuration of worker and compute nodes?

Highlighted

HDC Is there s difference in the configuration of worker and compute nodes?

New Contributor

Hi there

I am doing some evaluation of HDC and I am looking to spin up EDW-Analytics:Apache Hive 2 LLAP, Apache Zepplin 0.7.0 in HDP 2.6 (Cloud)

I would like to know the difference in configuration between worker and compute nodes. The reason I ask is that I want to take advantage of spot pricing and I am not that concerned if I loose the nodes during my testing phase. However I would like to understand if these nodes are configured differently.

Thanks

Sharon

2 REPLIES 2

Re: HDC Is there s difference in the configuration of worker and compute nodes?

Expert Contributor

@Sharon Kirkham

Worker nodes and compute nodes contain the same services. The basic advantage of compute nodes is, that if you want to use spot priced instances than you don't have to be afraid of losing any data because those nodes are only for compute purposes. You can also shrink down your compute group to 0 instance after the creation of the cluster.

Br

R

Re: HDC Is there s difference in the configuration of worker and compute nodes?

@Sharon Kirkham Compute nodes give you the ability to include nodes in the cluster that are just for compute work (i.e. no DataNode). This is similar to a “Task” type node in the EMR world.

Here are screenshots for EDW-Analytics:Apache Hive 2 LLAP, Apache Zepplin 0.7.0 from Ambari illustrating the components installed on worker and compute nodes:

23410-screen-shot-2017-08-03-at-115800-am.png

23411-screen-shot-2017-08-03-at-115728-am.png

The worker node has DataNode, while the compute node does not.

23413-screen-shot-2017-08-03-at-115720-am.png