@sangeeta rawat https://spark.apache.org/docs/1.0.2/sql-programming-guide.html ... View more

@Dhanooj kolathuparmabil I suggest to use ambari to add falcon in the stack ... View more

@suresh kumar You can download the document. See this If you are looking for technical doc then I am afraid that I don't have any template or generic as it's always customer driven based on the engagement. ... View more

@Özgür Akdemirci They look good to me. Also, we can add client tools in any node after the install if we have to ... View more

@suresh kumar You have to build/implement your own standards. It's like with any software stack. You have a software install, data is being stored and users accessing it. HDP is a platform and it comes with security solutions that you can leverage to meet some of security requirements , rest you have to build or rely on 3rd part solutions. See this ... View more

@Özgür Akdemirci You can install clients in ambari server and one of data nodes. Region server will be on data nodes (not master nodes) Node manager on data nodes ... View more

@suresh kumar HDP is a platform and you have to build/implement your own compliance standards around it. Ranger for Authorization, Auditing , Centralized admin console to manage policies Kerberos is MUST - Authentication Data encryption at rest - TDE or your preferred vendor You have to implement your own scripts to fullfil following requirements. Password expiration every xx days and that includes service accounts too. Auditing and more auditing ..anything that touches any part of the stack needs to be audited (Ranger and HDFS audit log is helpful) Password complexity Failed login attempts Data encryption in motion Data Retention - Data must expire after specific time otherwise you would have to retain the data for longer time (Falcon can help) You can read this http://hortonworks.com/blog/hadoop-security-enterprise/ ... View more