@Neeraj Sabharwal Yes I did and it was very helpful. Appreciate you providing the awesome insights. ... View more

@Sunile Manjee See this thread on HS2 and ZK relationship https://community.hortonworks.com/questions/1342/how-to-enable-zookeeper-discovery-for-hiveserver2.html ... View more

@Saurabh Kumar ... View more

@Sunile Manjee -d statusdir=<> this option is used to specify the hdfs directory to store the log files.( stdout,stderr) for the executed job. ... View more

Typically when referring to site-to-site we are referring to a Remote Process Group on one NiFi instance, communicating with an Input Port or Output Port on another NiFi instance. This is a TCP based protocol which is internal to NiFi, and makes a direct connection between the two instances. It can optionally be secured with TLS/SSL. The side of the connection that is receiving data, or providing data to be pulled, must configure the following properties in nifi.properties: # Site to Site properties nifi.remote.input.socket.host= nifi.remote.input.socket.port= nifi.remote.input.secure=true ... View more

@Sunile Manjee there's multiple ways of doing things, you can split a large file into smaller files, I've done that with CSV and split by column types. This is just one way. ... View more

Thanks @Chris Nauroth the NameNode can tell clients like MapReduce the locations of hosts that contain a replica of the block. MapReduce uses that information in its scheduling decisions, so if there are many MapReduce jobs that all need to read the same block, then having more replicas increases the chances for all of those concurrent tasks to be scheduled to a host containing a replica (and therefore getting a short-circuit read) ... View more

@Sunile Manjee I think Ancil answer is best one 😉 You are the judge. ... View more

done. https://community.hortonworks.com/articles/16151/yarn-que-utilization-ambari-widget.html ... View more

Hi, If you have any other please let us know. Actually the aws role json can find here: https://github.com/sequenceiq/cloudbreak-deployer/blob/master/include/aws-roles.bash#L162 ... View more