Hi In a simplified model, Kubernetes is just a container orchestration tool. Most of the discussions I hear for Kubernetes/Docker is about the "workload" side. How about the "management" side of this Platform? I would love to see a solution where we could: 1) Build and deploy containers for individual Hadoop Service instances 2) Manage these service instances through CM Example: Build a Hive Server container (pre-configured to point to the right cluster,etc) which could be deployed on a client edge node. The Hive metastore could be another container but running on the "service" node only. Similarly for Sentry or some other Hadoop service which is not in HA mode yet. Having a container for them would simplify deployment and get rid of the need to have HA built in. Another example could be: A gateway container which config xml's pointing to a specific cluster. this way clients do not need to manually or programatically update xmls to point to the right cluster. what do you all think?
... View more
