About chrsvarma

chrsvarma · ‎01-02-2018

I want to find files owned by a user in HDFS and delete all of them at once.

chrsvarma · ‎08-10-2017

in default.url you can define queue name along with connection string as below: jdbc:hive2://servername:10001/default;transportMode=http;httpPath=cliservice;tez.queue.name=queue.name

chrsvarma · ‎07-21-2017

I've created a new interpreter for Hive, now i want to route all who uses this interpreter to a dedicated YARN queue. Is it possible with version 0.7? btw i'm using HDP 2.6.1

chrsvarma · ‎07-11-2017

@Ekantheshwara Basappa can you share how you configured it with AD? i'm trying to achieve the same with AD.

chrsvarma · ‎07-10-2017

i updated directory path to hdfs:CLUSTERNAMEHA/tmp and it worked.

chrsvarma · ‎07-10-2017

I do not see this permission denied in ranger audit as well.

chrsvarma · ‎07-10-2017

INSERT OVERWRITE DIRECTORY '/tmp' ROW FORMAT DELIMITED FIELDS TERMINATED BY '\t' STORED AS TEXTFILE SELECT visit_id, ivm from abcd.xyz WHERE feed_date BETWEEN '2006-04-01' and '2006-05-01' AND ivm IS NOT NULL limit 10; Error: Error while compiling statement: FAILED: HiveAccessControlException Permission denied: user [rvchinta] does not have [WRITE] privilege on [/tmp] (state=42000,code=40000) 0: jdbc:hive2://hostname.abc.com:8443> ranger policy /tmp has 777 to public HDP version 2.6.1

chrsvarma · ‎05-16-2017

i need to store all infra_solr_datadir to HDFS instead of local to save disk space

chrsvarma · ‎04-10-2017

this issue is fixed. root cause is /etc/hosts on worker nodes. we had to add /etc/hosts to test another component and i did not follow the order , FQDN is not followed by ip. that was the reason RS freaked-out.

chrsvarma · ‎04-05-2017

HMaster: Master failed to complete initialization after 900000ms. Please consider submitting a bug report including a thread dump of this process I guess it got something to do with Zookeeper. HDP 2.3.4

chrsvarma · ‎03-22-2017

@pbarna i tested firefox and i did make the changes you specified. issue here is not about the error message, it is how can we make http authentication against ad credentials to access any UI. I was able to access UI if i login with local credentials, i want to get the same when i login with my ad credentials when i login to domain pc.

chrsvarma · ‎03-21-2017

i got kerberos enabled. all spn's authenticate against local kdc and upn authenticate against AD. I've setup one way trust between ad and mit kdc. upon login to any host using ad credentials i was able to access hadoop components, but not UI. any idea how to debug this issue? or any fix? HDP version 2.5.3

chrsvarma · ‎03-20-2017

how do we troubleshoot spark hung jobs? have a job where several executers execute in no time and last few executers hung and there are running since 24 hrs. trying to understand what that process is doing? where it got hung.

chrsvarma · ‎03-05-2017

followed below document and able to see the status of NN & RM. http://docs.hortonworks.com/HDPDocuments/Ambari-2.2.1.0/bk_Ambari_Security_Guide/content/_set_up_kerberos_for_ambari_server.html

chrsvarma · ‎03-05-2017

i can get which node is active from command line with out any issue though

chrsvarma · ‎03-05-2017

this is HDP 2.5.3 cluster & ambari is 2.4.2 with Kerberos enabled Same with resource manager..both were gone after trying to setup http authentication for NN/RM/oozie UI

chrsvarma · ‎03-05-2017

@Jay SenSharma i got MIT kDC on linux host where SPN's were created by ambari. users will get their ticket from AD. I've setup one way trust between AD & MIT KDC. i followed below link even this didnot help https://community.hortonworks.com/articles/28537/user-authentication-from-windows-workstation-to-hd.html

chrsvarma · ‎03-05-2017

@Jay SenSharma i got 5 node HDP cluster along with win2k8 AD. I'm using browser on my windows 10 machine. i do not have any krb5.conf configured on my windows 10.

chrsvarma · ‎03-05-2017

goal is to get authenticate oozie/nn/rm etc in browser currently i'm getting below error HTTP ERROR 403 Problem accessing /solr/. Reason: GSSException: Defective token detected (Mechanism level: GSSHeader did not find the right tag)

chrsvarma · ‎03-04-2017

Followed this document, but i was not able to make any progress.. https://docs.hortonworks.com/HDPDocuments/Ambari-2.2.1.0/bk_Ambari_Security_Guide/content/ch_enable_spnego_auth_for_hadoop.html goal is to enable authentication against activedirectory.. below are the settings i used. please educate me if i do anything wrong.. hadoop.http.authentication.signature.secret.file=/etc/security/http_secret hadoop.http.authentication.type=kerberos hadoop.http.authentication.kerberos.keytab=/etc/security/keytabs/spnego.service.keytab hadoop.http.authentication.kerberos.principal=HTTP/master2.chrsv.com@KERBEROS.COM hadoop.http.filter.initializers=org.apache.hadoop.security.AuthenticationFilterInitializer hadoop.http.authentication.cookie.domain=chrsv.com KERBEROS.COM is local KDC & CHRSV.COM is AD

chrsvarma · ‎03-04-2017

I was able to resolve this by adding RULE:[1:$1@$0](.*@CHRSV.COM)s/@.*// in hadoop.seucirty.auth.local in hdfs

chrsvarma · ‎03-04-2017

I've configured centrify express for AD/Linux integration. I was able to login to linux machine using windows credentials. I had setup one way trust between AD & Local MIT KDC. [root@master2 ~]# ssh rvchinta@master2 Red Hat Enterprise Linux Server release 6.4 (Santiago) Kernel 2.6.32-358.el6.x86_64 on an x86_64 Password: Last login: Sat Mar 4 07:22:34 2017 from 192.168.56.22 [rvchinta@master2 ~]$ klist Ticket cache: FILE:/tmp/krb5cc_cdc201327698_saYNYF Default principal: rvchinta@CHRSV.COM Valid starting Expires Service principal 03/04/17 10:02:32 03/04/17 20:02:32 krbtgt/CHRSV.COM@CHRSV.COM renew until 03/11/17 10:02:32 [rvchinta@master2 ~]$ when i access hadoop components it thinks my user name is rvchinta@CHRSV.COM. Any idea how to handle this? i should be rvchinta but not rvchinta@CHRSV.COM. thanks

chrsvarma · ‎03-03-2017

you saved my life 🙂

chrsvarma · ‎03-03-2017

centrify express is best option available & good part is it is free

chrsvarma · ‎02-22-2017

@mqureshi i'm looking for MS AD.

chrsvarma · ‎02-22-2017

@Rajesh it is no longer free version.

chrsvarma · ‎02-22-2017

Any open source tool available in market for testing purpose..i want gui tool (no winbind/sssd).

chrsvarma · ‎02-21-2017

I found this article in HW, but i want to configure it to authenticate against AD instead of local KDC.. Any suggestions? https://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.5.3/bk_security/content/_configuring_http_authentication_for_HDFS_YARN_MapReduce2_HBase_Oozie_Falcon_and_Storm.html

chrsvarma · ‎02-21-2017

@mqureshi every keytab and principal was created by ambari...and all of them are valid..

chrsvarma · ‎02-20-2017

I was able to make a successful connection, but i still see some error's in hs2 log.... Failed to authenticate with http/_HOST kerberos principal, trying with hive/_HOST kerberos principal 2017-02-20 14:43:45,116 ERROR [HiveServer2-HttpHandler-Pool: Thread-57]: thrift.ThriftHttpServlet (ThriftHttpServlet.java:doKerberosAuth(406)) - Failed to authenticate with hive/_HOST kerberos principal 2017-02-20 14:43:45,116 ERROR [HiveServer2-HttpHandler-Pool: Thread-57]: thrift.ThriftHttpServlet (ThriftHttpServlet.java:doPost(209)) - Error:

Online	Offline
Last Visited	‎01-02-2018 09:29 AM

Date Registered	‎12-09-2015 03:37 PM
Last Visited	‎01-02-2018 09:29 AM
Total Messages Posted	115
Total Kudos Received	43

Re: insert overwrite directory - beeline

Re: Master failed to complete initialization after...

Re: centrify express user principal

Re: hive metastore authentication

Re: Kerberos principal should have 3 parts: hive

cleanup hdfs files owned by a user

Re: Zeppelin Hive interpreter queue

Zeppelin Hive interpreter queue

Re: How to configure groups and roles mapping usin...

Re: insert overwrite directory - beeline

Re: insert overwrite directory - beeline

insert overwrite directory - beeline

ambari infra on cloud

Re: Master failed to complete initialization after...

Master failed to complete initialization after 900...

Re: http authentication with AD

http authentication with AD

debug spark hung process

Re: Ambari does not show status of NN

Re: Ambari does not show status of NN

Ambari does not show status of NN

Re: spnego+kerberos+firefox

Re: spnego+kerberos+firefox

spnego+kerberos+firefox

spnego authentication to ad

Re: centrify express user principal

centrify express user principal

Re: Ambari: Manually disable kerberos authenticati...

Re: AD-Linux user integration

Re: AD-Linux user integration

Re: AD-Linux user integration

AD-Linux user integration

Configuring HTTP Authentication for HDFS, YARN, Ma...

Re: hiveserver2 error

Re: hiveserver2 error