Member since
08-02-2017
19
Posts
0
Kudos Received
0
Solutions
05-31-2017
04:51 PM
Current configuration: Yarn site (Scheduler conf) :
yarn.scheduler.capacity.queue-mappings= u:user1: queue1, u: user2: queue 2 Yarn.queue.overriding.enabled: false Mapred-site.Xml :
Mapreduce.queue.name : queue1. User 2 submitting the mapreduce job is going to queue 1 , but ideally it should go to queue 2( as per mapping).
If I set yarn.override property to true, will user2 mapreduce job get submitted to queue 2 directly ?
Please suggest/confirm.
... View more
05-31-2017
03:32 PM
I have two users,user 1 and user 2 mapped to queue1 and queue 2 respectively in yarn queue Mapping property. mapreduce.queue.name is set to queue1. After submitting mapreduce job from user 2, job is getting submitted to queue1 (because of mapreduce queue name).However , I am not expecting this behaviour. My expectation is that user 2 mapreduce job should be submitted to queue 2 and (user 1 to queue 1)directly as per yarn queue Mapping. I don't want to set queue name , while submitting the job. Any suggestions on this? How could I achieve desired functionality ?
... View more
Labels:
- Labels:
-
Apache Hadoop
-
Apache YARN
05-25-2017
04:48 PM
I can see lot of pyspark jobs with Progress (10%) with fixed allocated memory. How do I enable dynamic memory deallocation ? Developers are running pyspark jobs inside Zeppelin interpreter and spark shell . Any suggestion on above issue ?
... View more
Labels:
- Labels:
-
Apache Spark
-
Apache Zeppelin
05-17-2017
09:34 AM
Hi Jay, I am trying to get all critical alerts from ambari using: curl -u username:password -i -H 'X-Requested-By:ambari' -X GET http://ambari-server:8080/api/v1/clusters/clustername/alerts?Alert/state=CRITICAL I don't want all fields here . For e.g I need service name and definition name , how to incorporate it in above curl
... View more
05-17-2017
04:24 AM
Hi, This worked . May I know , how to prevent user 1 to see applications submitted by themselves not others and admin should be able to view all jobs ?
... View more
05-14-2017
09:02 AM
Thanks for your inputs. Will %user will prevent killing jobs both from command line and RM UI ?
... View more
05-13-2017
03:10 PM
Hi Ward, Thanks for your inputs. I went through the docs and saw some property related to acl queues . May I know the difference between yarn.admin.acl property and ones mentioned in the link given by you.How do I restrict user 1 to kill jobs submitted by user 2 and vice versa ?
... View more
05-13-2017
09:44 AM
As a Hadoop Admin, I don't want any other user to kill the yarn application except admin or only user who is owner of the job should be able to kill including admin. Any way to accomplish it ? Presently anyone can kill the application .
... View more
Labels:
- Labels:
-
Apache YARN
05-12-2017
06:42 PM
Is VIEW.USER permission specific to File view ? How do I grant access to Tez/Hive view. Any documentation on this ?
... View more
05-12-2017
06:08 PM
Need curl calls to grant different view access through rest apis. I am currently able to create user and reset the password using ambari rest api as of now @Neeraj Sabharwal
... View more
Labels:
- Labels:
-
Apache Ambari