question Re: virtualizing master services in Support Questions

virtualizing master services

shota — Fri, 01 Sep 2017 19:38:55 GMT

Hello I have question what is difference between virtual namenode and physical dedicated namenode server

consider that all workernodes I have physical dedicated servers

will it be performance difference of data processing between virtual and physical master servers, even if virtual and physical servers will have same storeage capacity cpu number and ram, and not only namenodes for example can I have virtual hbase master, yarn, resource manager etc..

what services can I virtualize without impact performance?

thank you

Re: virtualizing master services

ssahi — Fri, 01 Sep 2017 22:17:48 GMT

hi @Shota Akhalaia

The master services for the various tech are not usually overly IO heavy, and therefore, can be virtualized (and backed by SAN) without too much of an issue, including the NN but also the master services for the other technologies within the platform. Keeping the worker nodes on physical can help you to maximize your cluster's performance.

Re: virtualizing master services

shota — Mon, 04 Sep 2017 18:58:00 GMT

Thank you for answer, as I understand I could virtualize most of dataflow services too: kafka, storm, nifi and SAM

is it right?

Re: virtualizing master services

ssahi — Tue, 05 Sep 2017 22:09:15 GMT

Hi @Shota Akhalaia

Most of the deployments I have been involved with has seen these services be installed on bare metal machines also as a lot of organizations tend to do HDP and HDF together, but, I think these should be ok to virtualize as well.

Re: virtualizing master services

Former Member — Mon, 11 Sep 2017 19:25:26 GMT

Thank you for the answer . It was really helpful for me to apply for my Industrial lubricants Dubai 's pages