question Re: Installation of Hortonworks suite in Archives of Support Questions (Read Only)

Installation of Hortonworks suite

dnyanesh_kulkar — Fri, 16 Sep 2022 10:25:29 GMT

Hello,

In my Organization we have currently Datawarehouse setup. We want to migrate it to HDFS.

I need an HDFS, sqoop, five, hbase, pig at bear minimum + the admin side details for this.

Can anybody help me in this. It will help me a lot

Re: Installation of Hortonworks suite

sunile_manjee — Wed, 15 Jun 2016 23:38:26 GMT

@dnyanesh kulkarnni

loaded question. Can you be more specific?

Re: Installation of Hortonworks suite

dnyanesh_kulkar — Thu, 16 Jun 2016 12:41:15 GMT

@Sunile Manjee : I need all the information which is required to setup an hadoop environment using HORTON WORKS Suite and also the admin part ( which things to consider).

Re: Installation of Hortonworks suite

sunile_manjee — Fri, 17 Jun 2016 09:24:32 GMT

@dnyanesh kulkarnni

Ambari is your central operations tools to manage manage. I would start here for all the information regarding setting up your HDP environment . HPD documentation is available here to maintain and deploy your cluster.

This is where all beginingers and experts start.

Re: Installation of Hortonworks suite

ashneesharma88 — Fri, 17 Jun 2016 16:45:54 GMT

@Sunile Manjee

Steps to setup cluster:-

There are some pre-requisites required for hadoop that we need to take care of before we set up the cluster. We will do them one by one now.

1) Setup password-less ssh from master to slaves.

2) Update /etc/hosts file

3) Update it on each node to contain entries for all hosts in the cluster.

4) install Java

5) disable seliux and iptable

6)Download amabari repo

wget -nv http://public-repo-1.hortonworks.com/ambari/centos6/2.x/updates/2.1.0/ambari.repo -O /etc/yum.repos.d/ambari.repo

7) install amabari

yum install ambari-server

😎 run command to setup amabari

ambari-server setup and press enter for all question

9) Now start the ambari server

ambari-server start

10) Once service is started successfully then check UI at <ambari IP>:8080

11) You will see UI. Default login credentials are admin:admin (username:password)

For the next steps follow the link:-

http://docs.hortonworks.com/HDPDocuments/Ambari-2.1.0.0/bk_Installing_HDP_AMB/content/_launching_the_ambari_install_wizard.html

If this is help you please accept the ans and lets close this.

Re: Installation of Hortonworks suite

Shelton — Fri, 17 Jun 2016 19:15:20 GMT

@dnyanesh kulkarnni

Apart from the above answers of Ashnee and Sunile the number of question that need to be answered to deploy correctly the HDP components

1. What is the business case for this cluster build? DWH???

2. Is it a POC or intended for production?

3. How many nodes in this cluster ? For HA you need to consider NN ,DN and zookeeper redundancy etc

4. Definitely with RDBMS you will need sqoop but what other components do you want deployed?

5. Remember to build your Hadoop architecture to map your business needs

@Ashnee

You forgot to mention NTP synchronization between the nodes in the cluster which is very important for the zookeeper etc

Re: Installation of Hortonworks suite

ashneesharma88 — Fri, 17 Jun 2016 19:50:18 GMT

@dnyanesh kulkarnni

Yes right. Please install ntp, refer hte link

http://www.openkb.info/2014/06/ntp-tips-for-hadoop-cluster.html

Re: Installation of Hortonworks suite

ashneesharma88 — Tue, 12 Jul 2016 15:36:55 GMT

@dnyanesh kulkarnni

If you got the answer, then lets close this.

Re: Installation of Hortonworks suite

ashneesharma88 — Tue, 04 Oct 2016 16:46:31 GMT

@dnyanesh kulkarnni

1)Can you update how much data is there?

2) You want to build poc cluster or production?