question Re: HDP Best practices in Support Questions

HDP Best practices

techiegreenhorn — Fri, 29 Jan 2016 07:44:03 GMT

Are there any recommendations / guidelines / best practices from Hortonworks or any other Hadoop provider in order to setup and maintain a cluster of any size?

Thanks in advance

Re: HDP Best practices

nsabharwal — Fri, 29 Jan 2016 07:47:55 GMT

@Greenhorn Techie

Deploy - Ambari Operations tool

Security - Ranger and Kerberos

Data Governance - Falcon and Atlas

Now, Get familiar with http://docs.hortonworks.com as it has all the resources that you need to deploy and maintain the cluster.

Start with this

Re: HDP Best practices

nsabharwal — Fri, 29 Jan 2016 07:50:09 GMT

@Greenhorn Techie HCC has really good articles and content link

Re: HDP Best practices

techiegreenhorn — Fri, 29 Jan 2016 07:57:29 GMT

@Neeraj Sabharwal Thanks for this. I was looking slightly technical and more specific coverage, primarily from an administrative perspective. For example,

1. Better split master services onto various nodes

2. what is the recommendation in choosing hardware when different work loads are present - think of lambda architecture etc.

3. What kind of disks are best suited and any particular configuration to arrange them (for example RAID?) when they are going to be explicitly used by Kafka brokers and not share the disks with Datanodes.

Thanks

Re: HDP Best practices

nsabharwal — Fri, 29 Jan 2016 08:02:20 GMT

@Greenhorn Techie You need to read this and also follow Hortonworks on slideshare.

Re: HDP Best practices

techiegreenhorn — Fri, 29 Jan 2016 08:20:22 GMT

Thanks @Neeraj Sabharwal This is precisely what I was looking for. Best Regards

Re: HDP Best practices

nsabharwal — Fri, 29 Jan 2016 08:48:52 GMT

@Greenhorn Techie perfect !

Please accept the answer to close the thread. Great question !!

Re: HDP Best practices

aervits — Fri, 29 Jan 2016 09:45:27 GMT

@Greenhorn Techie and install SmartSense, it will push best practices to you.

Re: HDP Best practices

nsabharwal — Fri, 29 Jan 2016 09:51:54 GMT

@Greenhorn Techie Thanks to @Artem Ervits for bringing this up

SmartSense is MUST

http://hortonworks.com/support/smart-sense/