Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

virtualizing master services

Solved Go to solution
Highlighted

virtualizing master services

New Contributor

Hello I have question what is difference between virtual namenode and physical dedicated namenode server

consider that all workernodes I have physical dedicated servers

will it be performance difference of data processing between virtual and physical master servers, even if virtual and physical servers will have same storeage capacity cpu number and ram, and not only namenodes for example can I have virtual hbase master, yarn, resource manager etc..

what services can I virtualize without impact performance?

thank you

1 ACCEPTED SOLUTION

Accepted Solutions

Re: virtualizing master services

Guru

hi @Shota Akhalaia

The master services for the various tech are not usually overly IO heavy, and therefore, can be virtualized (and backed by SAN) without too much of an issue, including the NN but also the master services for the other technologies within the platform. Keeping the worker nodes on physical can help you to maximize your cluster's performance.

4 REPLIES 4

Re: virtualizing master services

Guru

hi @Shota Akhalaia

The master services for the various tech are not usually overly IO heavy, and therefore, can be virtualized (and backed by SAN) without too much of an issue, including the NN but also the master services for the other technologies within the platform. Keeping the worker nodes on physical can help you to maximize your cluster's performance.

Re: virtualizing master services

New Contributor

Thank you for answer, as I understand I could virtualize most of dataflow services too: kafka, storm, nifi and SAM

is it right?

Re: virtualizing master services

Guru

Hi @Shota Akhalaia

Most of the deployments I have been involved with has seen these services be installed on bare metal machines also as a lot of organizations tend to do HDP and HDF together, but, I think these should be ok to virtualize as well.

Re: virtualizing master services

Thank you for the answer . It was really helpful for me to apply for my Industrial lubricants Dubai 's pages