virtualizing master services

[#1]

Hello I have question what is difference between virtual namenode and physical dedicated namenode server

consider that all workernodes I have physical dedicated servers

will it be performance difference of data processing between virtual and physical master servers, even if virtual and physical servers will have same storeage capacity cpu number and ram, and not only namenodes for example can I have virtual hbase master, yarn, resource manager etc..

what services can I virtualize without impact performance?

thank you

[#2 · Accepted solution]

hi @Shota Akhalaia

The master services for the various tech are not usually overly IO heavy, and therefore, can be virtualized (and backed by SAN) without too much of an issue, including the NN but also the master services for the other technologies within the platform. Keeping the worker nodes on physical can help you to maximize your cluster's performance.

[#3]

Thank you for answer, as I understand I could virtualize most of dataflow services too: kafka, storm, nifi and SAM

is it right?

[#4]

Hi @Shota Akhalaia

Most of the deployments I have been involved with has seen these services be installed on bare metal machines also as a lot of organizations tend to do HDP and HDF together, but, I think these should be ok to virtualize as well.

[#5]

Thank you for the answer . It was really helpful for me to apply for my Industrial lubricants Dubai 's pages