About hadcloudera

hadcloudera · ‎07-08-2017

I have enabled namespacing property in hbase-site.xml , but I am unable to create schema using Java Phoenix connectivity. Error message shows that namespacing property should be enabled ( which is already the case) . Any way to specifically mention/override the hbase properties in the java program ?

hadcloudera · ‎06-12-2017

I have a program for bulk loading of data to HBase using creation of HFile , for which I have used configureIncrementalLoad () of HFileOutputFormat2 . But , this HFile is created using 'hbase' user, I want this user to be actual user , who is running the java program. Any suggestions on it ? I have researched about hadoop.proxyusers.hbase related properties, but little confused regarding the same.

hadcloudera · ‎05-31-2017

Initially we had cluster name as ClusterHW_1 in ambari and corresponding ranger default policies as ClusterHW_1_hadoop,Cluster HW_1_hbase,ClusterHW_1_hive . After couple of days , we renamed the cluster ClusterHW_2 and restarted most of the services due to change in Hadoop.proxy.hosts value to *. We observed that earlier ranger policies were not working and ambari has created new ranger policies as ClusterHW_2_hadoop,Cluster HW_2_hbase,ClusterHW_2_hive . Can someone explain this behaviour and how is it working in detailed way and how to prevent this , if possible?

hadcloudera · ‎05-31-2017

Current configuration: Yarn site (Scheduler conf) : yarn.scheduler.capacity.queue-mappings= u:user1: queue1, u: user2: queue 2 Yarn.queue.overriding.enabled: false Mapred-site.Xml : Mapreduce.queue.name : queue1. User 2 submitting the mapreduce job is going to queue 1 , but ideally it should go to queue 2( as per mapping). If I set yarn.override property to true, will user2 mapreduce job get submitted to queue 2 directly ? Please suggest/confirm.

hadcloudera · ‎05-31-2017

I have two users,user 1 and user 2 mapped to queue1 and queue 2 respectively in yarn queue Mapping property. mapreduce.queue.name is set to queue1. After submitting mapreduce job from user 2, job is getting submitted to queue1 (because of mapreduce queue name).However , I am not expecting this behaviour. My expectation is that user 2 mapreduce job should be submitted to queue 2 and (user 1 to queue 1)directly as per yarn queue Mapping. I don't want to set queue name , while submitting the job. Any suggestions on this? How could I achieve desired functionality ?

hadcloudera · ‎05-27-2017

Regarding yarn queues, how will yarn allocate resource to user , when it's part of multiple queues?

hadcloudera · ‎05-26-2017

1) Can we import unix groups (group 1, group 2 etc) in to Ranger as groups direclty 2) Can we directly have yarn queues as per unix group ? Like group1 queue , group 2 queue 3) If user 1 is part of two yarn queues(queue1 and queue2) at the same time, which queue will user1 be allocated to?

hadcloudera · ‎05-25-2017

I can see lot of pyspark jobs with Progress (10%) with fixed allocated memory. How do I enable dynamic memory deallocation ? Developers are running pyspark jobs inside Zeppelin interpreter and spark shell . Any suggestion on above issue ?

hadcloudera · ‎05-22-2017

Hi, I have created user úser1' in zeppelin. I am running some shell scripts to create directories in my hdfs directory, but its throwing access denied exception Error , user=zeppelin, Access denied May I know the way to execute shell script as user1 from zeppelin interpreter rather than 'zeppelin'

hadcloudera · ‎05-17-2017

Hi Jay, I am trying to get all critical alerts from ambari using: curl -u username:password -i -H 'X-Requested-By:ambari' -X GET http://ambari-server:8080/api/v1/clusters/clustername/alerts?Alert/state=CRITICAL I don't want all fields here . For e.g I need service name and definition name , how to incorporate it in above curl

hadcloudera · ‎05-17-2017

Hi, This worked . May I know , how to prevent user 1 to see applications submitted by themselves not others and admin should be able to view all jobs ?

hadcloudera · ‎05-14-2017

Thanks for your inputs. Will %user will prevent killing jobs both from command line and RM UI ?

hadcloudera · ‎05-13-2017

Hi Ward, Thanks for your inputs. I went through the docs and saw some property related to acl queues . May I know the difference between yarn.admin.acl property and ones mentioned in the link given by you.How do I restrict user 1 to kill jobs submitted by user 2 and vice versa ?

hadcloudera · ‎05-13-2017

I am able to create File/Tez/Hive view using Ambari api. How do i create smartsense view using rest api?

hadcloudera · ‎05-13-2017

As a Hadoop Admin, I don't want any other user to kill the yarn application except admin or only user who is owner of the job should be able to kill including admin. Any way to accomplish it ? Presently anyone can kill the application .

hadcloudera · ‎05-13-2017

I have 5 worker nodes in Hortonworks cluster with 15 cores per worker node for Yarn and 1 TB Yarn memory in total with default spark config values as of now i.e 1 G executor memory etc. 1. Which parameters should I tune for maximum utilization of spark job for each user ? 2. What should be the recommended values for max number of executors, executor memory and executor per cores for above Hardware configuration Note : Dynamic resource allocation is already enabled. Any tips on tuning spark jobs are always welcomed. @Guilherme Braccialli @Andrew Watson

hadcloudera · ‎05-12-2017

Is VIEW.USER permission specific to File view ? How do I grant access to Tez/Hive view. Any documentation on this ?

hadcloudera · ‎05-12-2017

Need curl calls to grant different view access through rest apis. I am currently able to create user and reset the password using ambari rest api as of now @Neeraj Sabharwal

Online	Offline
Last Visited	‎08-03-2017 11:53 AM

Date Registered	‎08-02-2017 02:25 AM
Last Visited	‎08-03-2017 11:53 AM
Total Messages Posted	19

Namespace mapping issue in HBase-Phoenix Java

HBase User Impersonation

Cluster Name affect on Ranger policies

Re: Yarn queue Mapping

Yarn queue Mapping

Re: Importing unix groups in to ranger groups/queu...

Importing unix groups in to ranger groups/queue

Spark Session timeout

Zeppelin User Impersonation

Re: How do I grant different view access like Hive...

Re: Preventing users from Killing the yarn applica...

Re: Preventing users from Killing the yarn applica...

Re: Preventing users from Killing the yarn applica...

SmartSense view creation using ambari rest api

Preventing users from Killing the yarn application

Spark2 Tuning running on Yarn

Re: How do I grant different view access like Hive...

How do I grant different view access like Hive/Tez...