question Re: Installation of HDP : Step by Step in Archives of Support Questions (Read Only)

Installation of HDP : Step by Step

ashish_rastogi — Fri, 29 Apr 2016 19:34:37 GMT

Hello Team,

We are planning to install the HDP pseude mode ( Installtion on single machine)

We have 5.9 GB RAM

and 71GB of Free disk

Please help in installation of HDP ? Will appreciate if you have explain in broader way 🙂

what version should we use ..

Please look into this as w have to install the hdp by today 🙂

Re: Installation of HDP : Step by Step

pvillard — Fri, 29 Apr 2016 19:41:43 GMT

The installation guide is pretty well documented and should be the first thing to read :

https://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.4.0/bk_installing_manually_book/content/ch_getting_ready_chapter.html

In terms of version, you should consider the last one released.

And if you only want to install HDP on a single machine, depending of what your are expecting, you should consider downloading the Sandbox :

http://hortonworks.com/products/sandbox/

Hope that helps.

Re: Installation of HDP : Step by Step

drussell — Fri, 29 Apr 2016 19:46:55 GMT

@ASHISH Rastogi Honestly, you'll really struggle with that little RAM. Even the Hortonworks Sandbox suggests a bare mimimum of 8GB of RAM for a single node HDP environment, and while you might manage to trim that down a bit by reducing things to the bare minimum, it won't be a plesant experience.

I would recommend you perhaps investigate the HDP Sandbox instead and just run it on VMware or Virtualbox

http://hortonworks.com/products/sandbox/

If you're absolutely dead set on your origional approach, then I think you'll have to go without Ambari and instead do everything manually, the complete step by step for this is shown here:

http://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.4.0/bk_installing_manually_book/content/ch_getting_ready_chapter.html

But honestly that's quite a complex procedure, and accident prone. Best of luck!

Re: Installation of HDP : Step by Step

ashish_rastogi — Fri, 29 Apr 2016 20:03:05 GMT

@drussell

Hi , Please see the scree_shot for memory we have for setting up the HDP.

Please help in the installation

memory.jpg

Re: Installation of HDP : Step by Step

drussell — Fri, 29 Apr 2016 20:16:01 GMT

@ASHISH Rastogi ok so 11GB of RAM with about 5.9GB of RAM free. That should be enough to deploy HDP, you just need to follow the instructions mentioned in the posts above!

Re: Installation of HDP : Step by Step

ashish_rastogi — Fri, 29 Apr 2016 20:35:18 GMT

@drussell

I am completely confused Right now.

I have explained you my scenerio and memory... Please assist on : - from which step I start the installation ? - How Much time does It take to get instaled successfully on my single node

- Can we have a webex , now . So that you have look into my server and help me what actually i have to do or not

Please help ... Because this we are doing for 1st time with Hortonworks Distribution, Hope u undestands !!! :))

Re: Installation of HDP : Step by Step

drussell — Fri, 29 Apr 2016 20:43:31 GMT

@ASHISH Rastogi you would need to start the installation with the following steps:

http://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.4.0/bk_installing_manually_book/content/ch_getting_ready_chapter.html

If you would like someone to walk you through it step by step above and beyond the documentation, I'd suggest that you look into Hortonworks support services and possibly even Hortonworks consulting services http://hortonworks.com/services/support/

Re: Installation of HDP : Step by Step

ashish_rastogi — Tue, 03 May 2016 19:21:12 GMT

@drussell

Hi , drussell, Much appreciate for your help and letting me know to go for the above link according to my cluster memory . As you know I am creating a single node cluster . I am stuck with the Database Installation part ,I am planning for Hive . and also using the Centos 6.7 version .

Can you please suggest me from the link , which one database I go ahead for ?? Yoy can attach the screenshot also :)

Re: Installation of HDP : Step by Step

drussell — Tue, 03 May 2016 19:24:24 GMT

Hi @ASHISH Rastogi given you're using CentOS I'd suggest either MySQL or Postgres, both are supported options and available from the CentOS repos. Installation is via the normal yum methods.

Re: Installation of HDP : Step by Step

ashish_rastogi — Tue, 03 May 2016 19:42:42 GMT

Thanks @drussell 🙂

Also , I was trying for the below command via terminal , but the below command through the error (Please check the attachment of error

wget -nv http://public-repo-1.hortonworks.com/HDP/centos6/2.x/updates/2.4.0.0/hdp.repo

NOTE : BUT ON THE OTHER HAND THE SAME HAS BEEN DOWNLOADED , WHEN I GIVE THIS ABOVE LINK FROM BROWSER .

Please assist on this , and provide me the resolution for the error (attachment)error.jpg

Re: Installation of HDP : Step by Step

drussell — Tue, 03 May 2016 19:46:48 GMT

@ASHISH Rastogi You have a "/" (without the quotes) at the end of your proxy configuration, straight after the port number, if you remove that the wget command should work too!

Re: Installation of HDP : Step by Step

ashish_rastogi — Tue, 03 May 2016 19:53:23 GMT

@drussell ... Do I have to make configuration changes . And how and from where I can do this I know these are Basics , But I am new to administrator part . Please assist 🙂

Re: Installation of HDP : Step by Step

ashish_rastogi — Tue, 03 May 2016 20:25:25 GMT

Hi @drussell Please let me know how I can can changes . In which File

Re: Installation of HDP : Step by Step

ashish_rastogi — Wed, 04 May 2016 13:19:59 GMT

Hello @drussell , Please assist me on the files or how I can make the changes into the proxy

Re: Installation of HDP : Step by Step

drussell — Wed, 04 May 2016 14:17:18 GMT

Please speak to whoever setup that linux instance to confirm as there are many places that your proxy configuration could have been set. It is possible to temporarily override the settings by running the following commands (replace proxysrv with your web proxy server name including any potential user/pass info, and 8080 with whatever port your proxy service runs on):

export http_proxy="http://proxysrv:8080
export https_proxy="https://proxysrv:8080