Member since
08-02-2017
19
Posts
0
Kudos Received
0
Solutions
07-08-2017
04:46 PM
I have enabled namespacing property in hbase-site.xml , but I am unable to create schema using Java Phoenix connectivity. Error message shows that namespacing property should be enabled ( which is already the case) . Any way to specifically mention/override the hbase properties in the java program ?
... View more
Labels:
- Labels:
-
Apache HBase
-
Apache Phoenix
06-12-2017
01:44 PM
I have a program for bulk loading of data to HBase using creation of HFile , for which I have used configureIncrementalLoad () of HFileOutputFormat2 . But , this HFile is created using 'hbase' user, I want this user to be actual user , who is running the java program. Any suggestions on it ? I have researched about hadoop.proxyusers.hbase related properties, but little confused regarding the same.
... View more
Labels:
- Labels:
-
Apache HBase
05-31-2017
05:01 PM
Initially we had cluster name as ClusterHW_1 in ambari and corresponding ranger default policies as ClusterHW_1_hadoop,Cluster HW_1_hbase,ClusterHW_1_hive . After couple of days , we renamed the cluster ClusterHW_2 and restarted most of the services due to change in Hadoop.proxy.hosts value to *. We observed that earlier ranger policies were not working and ambari has created new ranger policies as ClusterHW_2_hadoop,Cluster HW_2_hbase,ClusterHW_2_hive . Can someone explain this behaviour and how is it working in detailed way and how to prevent this , if possible?
... View more
Labels:
- Labels:
-
Apache Ambari
-
Apache Ranger
05-31-2017
04:51 PM
Current configuration: Yarn site (Scheduler conf) :
yarn.scheduler.capacity.queue-mappings= u:user1: queue1, u: user2: queue 2 Yarn.queue.overriding.enabled: false Mapred-site.Xml :
Mapreduce.queue.name : queue1. User 2 submitting the mapreduce job is going to queue 1 , but ideally it should go to queue 2( as per mapping).
If I set yarn.override property to true, will user2 mapreduce job get submitted to queue 2 directly ?
Please suggest/confirm.
... View more
05-31-2017
03:32 PM
I have two users,user 1 and user 2 mapped to queue1 and queue 2 respectively in yarn queue Mapping property. mapreduce.queue.name is set to queue1. After submitting mapreduce job from user 2, job is getting submitted to queue1 (because of mapreduce queue name).However , I am not expecting this behaviour. My expectation is that user 2 mapreduce job should be submitted to queue 2 and (user 1 to queue 1)directly as per yarn queue Mapping. I don't want to set queue name , while submitting the job. Any suggestions on this? How could I achieve desired functionality ?
... View more
Labels:
- Labels:
-
Apache Hadoop
-
Apache YARN
05-27-2017
05:12 AM
Regarding yarn queues, how will yarn allocate resource to user , when it's part of multiple queues?
... View more
05-26-2017
11:15 AM
1) Can we import unix groups (group 1, group 2 etc) in to Ranger as groups direclty 2) Can we directly have yarn queues as per unix group ? Like group1 queue , group 2 queue 3) If user 1 is part of two yarn queues(queue1 and queue2) at the same time, which queue will user1 be allocated to?
... View more
Labels:
- Labels:
-
Apache Ranger
-
Apache YARN
05-25-2017
04:48 PM
I can see lot of pyspark jobs with Progress (10%) with fixed allocated memory. How do I enable dynamic memory deallocation ? Developers are running pyspark jobs inside Zeppelin interpreter and spark shell . Any suggestion on above issue ?
... View more
Labels:
- Labels:
-
Apache Spark
-
Apache Zeppelin
05-22-2017
09:23 AM
Hi, I have created user úser1' in zeppelin. I am running some shell scripts to create directories in my hdfs directory, but its throwing access denied exception Error , user=zeppelin, Access denied May I know the way to execute shell script as user1 from zeppelin interpreter rather than 'zeppelin'
... View more
Labels:
- Labels:
-
Apache Zeppelin
05-17-2017
09:34 AM
Hi Jay, I am trying to get all critical alerts from ambari using: curl -u username:password -i -H 'X-Requested-By:ambari' -X GET http://ambari-server:8080/api/v1/clusters/clustername/alerts?Alert/state=CRITICAL I don't want all fields here . For e.g I need service name and definition name , how to incorporate it in above curl
... View more
05-17-2017
04:24 AM
Hi, This worked . May I know , how to prevent user 1 to see applications submitted by themselves not others and admin should be able to view all jobs ?
... View more
05-14-2017
09:02 AM
Thanks for your inputs. Will %user will prevent killing jobs both from command line and RM UI ?
... View more
05-13-2017
03:10 PM
Hi Ward, Thanks for your inputs. I went through the docs and saw some property related to acl queues . May I know the difference between yarn.admin.acl property and ones mentioned in the link given by you.How do I restrict user 1 to kill jobs submitted by user 2 and vice versa ?
... View more
05-13-2017
10:16 AM
I am able to create File/Tez/Hive view using Ambari api. How do i create smartsense view using rest api?
... View more
Labels:
- Labels:
-
Apache Ambari
05-13-2017
09:44 AM
As a Hadoop Admin, I don't want any other user to kill the yarn application except admin or only user who is owner of the job should be able to kill including admin. Any way to accomplish it ? Presently anyone can kill the application .
... View more
Labels:
- Labels:
-
Apache YARN
05-13-2017
06:43 AM
I have 5 worker nodes in Hortonworks cluster with 15 cores per worker node for Yarn and 1 TB Yarn memory in total with default spark config values as of now i.e 1 G executor memory etc. 1. Which parameters should I tune for maximum utilization of spark job for each user ? 2. What should be the recommended values for max number of executors, executor memory and executor per cores for above Hardware configuration Note : Dynamic resource allocation is already enabled. Any tips on tuning spark jobs are always welcomed. @Guilherme Braccialli @Andrew Watson
... View more
Labels:
- Labels:
-
Apache Spark
05-12-2017
06:42 PM
Is VIEW.USER permission specific to File view ? How do I grant access to Tez/Hive view. Any documentation on this ?
... View more
05-12-2017
06:08 PM
Need curl calls to grant different view access through rest apis. I am currently able to create user and reset the password using ambari rest api as of now @Neeraj Sabharwal
... View more
Labels:
- Labels:
-
Apache Ambari