About arunpoy

arunpoy · ‎03-16-2016

Some items i noticed are , the scripts kerberos-setup.sh doesnt have the setting for redhat 7 , i added it. But there are a couple of other issues too . The script removes the sudo permissions too. Instead the old script of generate_keytabs.sh is better. but that script is not part of the latest ambari. Do someone have the rectified version of this script or is the old script available somewhere in the github repos, i would take that and proceed.

arunpoy · ‎03-16-2016

I am trying to use the option "Manage Kerberos principals and keytabs manually" in ambari while trying to kerberise the cluster. I am trying to use the kerberos_Setup.sh provided by ambari. does it work as expected? I dont see that, it is throwing up lot of errors and trying to replace the krb5.conf (i changed) with the default one. also it is trying to create a kdc database. what is the password for that. Also the script is not installing rngd,pdsh, i did it manually. Finally i do see the error . Even though i see the hosts entry at accepted_hosts. HAs anyone the correct version of this script. I am using HDP 2.4 pdsh@instance-1: no remote hosts specified

arunpoy · ‎03-11-2016

Is there any way for hbase to return case insensitive values from the cells. if a cell has value 'XYZ' and If a query it with 'xyZ' . is there a way to get the result back as value present?

arunpoy · ‎03-09-2016

Hi @Jonas Straub, i have a question regarding the HDP search installation. Since we are using the machines running datanodes to host the Solr instances. how do we control resources used by solr, so that the cluster resources are not dominated by solr alone. There are lot more other stuff running on the slave nodes. I guess we can't do the resource management with yarn for this case. I guess this would be a common usecase for most of them using solr with hadoop

arunpoy · ‎03-08-2016

Thanks @Jonas Straub. the information you provided was extremely useful. As of now i am going to setup the solrcloud on a HDP cluster without kerberos. I followed your steps and it worked fine. Is HDP search and solr on yarn both different.? Any clarity would be great.

arunpoy · ‎03-07-2016

I have a smalll dev cluster with 5 nodes (2 masters and 3 slaves). I want to install solr (hdp search) in the cluster. Which all nodes should i install solr (hdp search). Is there any document where i can refer the configuration inforamation.

arunpoy · ‎03-03-2016

Thanks @Shivaji. If i use s3 for storage , then it should be fine right. But my use case is we wont have the data on hdfs for a longer duration. it will be just for processing. Also we plan to have hbase also in the same cluster. we plan to have more of a static cluster for hbase. so say we will have abase cluster with 5 nodes and have hdfs/yarn/hbase on it and only the dfs and yarn on the elastic nodes. will it that be possible. also is there a doc, tutorial or url where i can refer to set up an elastic cluster using cloudbreak and HDP

arunpoy · ‎03-03-2016

I want to setup an elastic cluster using AWS EC2 and install HDP on it. How can i do it. What are the options available. I dont want to use AWS EMR. Is it possible to bring up and down datnodes with HDP stack installed on it automatically. Any suggestions would be great.

arunpoy · ‎02-18-2016

Thanks @Vikas Gadade. It helped.

arunpoy · ‎02-17-2016

Hi @Sagar Shimpi, @Vikas Gadade may be correct. This is the info i got from one of the hadoop admins. Can someone clarify or validate In non-security mode (without kerberos), an account on edgenode is sufficient because user's container will run on slave nodes under the yarn account. In secure mode (with kerberos), you should have accounts on all machines, because user's container should run on slave nodes under the real username.

Online	Offline
Last Visited	‎03-14-2019 05:48 AM

Member Since	‎01-21-2016 11:26 AM
Last Visited	‎03-14-2019 05:48 AM
Posts	290
Kudos received	76

Cloudera Community

Re: Dead region server showing on ambari even afte...

Re: Zeppelin phoenix error

Re: job history not available

Re: Manual KDC and kerberos option in ambari

Manual KDC and kerberos option in ambari

hbase case insensitive query

Re: hdp search installation

Re: hdp search installation

hdp search installation

Re: Scalable HDP cluster on AWS

Scalable HDP cluster on AWS

Re: Adding a new user to the cluster

Re: Adding a new user to the cluster