Member since
06-21-2018
5
Posts
0
Kudos Received
0
Solutions
07-16-2018
02:13 PM
Say that I need to have a 3 or 4 node cluster. What is the best way to set it up? How do I distribute the services through the nodes. Apart from the basic serivices like HDFS,MapReduce,YARN etc.,I definitely require Spark and Zeppelin on the cluster. Is it okay to install Spark on each of the nodes? How do I proceed with choosing services for my cluster? In other words, can someone suggest a Blueprint.json file for a 3 and 4 node cluster setup
... View more
Labels:
07-13-2018
10:16 AM
@Jay Kumar SenSharma
... View more
07-13-2018
09:38 AM
I have been looking into if all the services and components can be 'dockerized', that is run the services through docker containers. I went through Cloudworks and found that the services are dockerized in it. I would like to know if there are any dockers available for on-premise use, that is, on 3 or 4 local nodes/machine. I am looking to do something like dockerize each service. https://github.com/sequenceiq/docker-ambari#multi-node-hadoop-cluster I went through this and don't exactly understand how this works. Its uploaded by SeqquenceIQ - does this mean that the nodes are on cloud? Becuase I don't see any place where I will have to provide the hosts machine details. And all it says is run : curl -Lo .amb j.mp/docker-ambari && source .amb && amb-deploy-cluster I have been using playbooks to install Clusters (on premise physical machines) Is there anyway I can do this using Docker? @Jay Kumar SenSharma
... View more
Labels:
- Labels:
-
Apache Ambari
-
Docker
06-22-2018
01:23 PM
Thanks @Jay Kumar SenSharma! This worked. So I am setting up a cluster without the internet. During the Services Install and start step, the installer is still trying to access the internet. It tries to 'yum install' a package as it is not there. For example, python-devel,gcc,mysql-server etc were some packages that it tried to install and failed because internet is not available. My HDP repositories have all been setup on local itself. Is this a problem with my CentOS local repository. If yes, how do I maintain an updated repository. Is there access to a list of packages that the HDP-Services would be installing. This would help account for the packages that are required.
... View more
06-21-2018
03:17 PM
I'm getting an error while setting up HDP-Services. I'm doing it without Internet and I have setup a local repository on the same machine itself. I used a tar file and saved it on the same server itself and accessed it using file:/// Somehow it is still trying to install from internet. Please Help
... View more
Labels: