Member since
05-17-2016
190
Posts
46
Kudos Received
11
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
1413 | 09-07-2017 06:24 PM | |
1818 | 02-24-2017 06:33 AM | |
2640 | 02-10-2017 09:18 PM | |
7117 | 01-11-2017 08:55 PM | |
4793 | 12-15-2016 06:16 PM |
08-30-2016
05:14 PM
Thanks @Ravi Mutyala, what I have done is a queuename to group mapping. Does this not work? Should I explicitly add the user names rather than the group names?
Current configuration q1 - group sales
q2 - group marketing
q3 - group dev
Should I change this to q1 - salesuser1,salesuser2,salesuser3
q2 - mktguser1,mktguser2
q3 - devuser1,devuser2,devuser3,devuser4
... View more
08-30-2016
03:07 PM
1 Kudo
Hi All,
I created 3 yarn queues under root queue. Assigned the right ACLs and verified the user permissions by submitting the job as permitted and non permitted users. Every thing looks fine.I was using wordcount jar to submit the program to queue using the property -Dmapreduce.job.queuename=whatever.
However, when I submit a job without the queuename property, the job gets submitted to a queue called "default", which no longer exists. I have renamed this queue and all the services were restarted.
What could be the property that I have missed configuring?
Current issue is
java.io.IOException: Failed to run job : Application application_1472567001293_0007 submitted by user whoever to unknown queue: default
... View more
Labels:
- Labels:
-
Apache YARN
08-30-2016
06:11 AM
Hi @peeyush, no I have not used the cli. I was expecting I could create a cluster using the web page. This is my Hello World on falcon. So was following http://hortonworks.com/hadoop-tutorial/create-falcon-cluster/. Does this not apply to my version of HDP and Falcon?
... View more
08-30-2016
05:57 AM
@peeyush I am running HDP-2.2.9.0-3393 with Falcon 0.6.0.2.2. The problem here is that though I have the urls, clicking on them does not yield any action. I don't get any error messages too.
... View more
08-30-2016
05:25 AM
Hi All,
I just added the falcon service to my cluster using the ambari "add service". Logged into the host running the falcon server and verified the falcon service. The service is running as expected. However, when I launch the falcon webpage, it asks me a user name. I keyed in the default ambari-qa and there after it never prompted me a password. It just displays a webpage with three links that route back to the same page.
The links are Data Set, Processes, Clusters
Could you point out what could be the issue?
Below are the log line that I could gather from the server
2016-08-30 01:22:35,069 INFO - [173162436@qtp-364268090-2:c2029cec-0d49-4a01-9479-4e73faaa5f23 ambari-qa:GET//entities/list/cluster] ~ Request from authenticated user: ambari-qa, URL=/api/entities/list/cluster?fields=status&user.name=ambari-qa (FalconAuthenticationFilter:181)
2016-08-30 01:22:35,071 DEBUG - [173162436@qtp-364268090-2:c2029cec-0d49-4a01-9479-4e73faaa5f23] ~ Audit: ambari-qa/69.142.204.204 performed request http://52.87.252.214:15000/api/entities/list/cluster?fields=status&user.name=ambari-qa (172.31.12.149) at time 2016-08-30T05:22Z (FalconAuditFilter:83)
2016-08-30 01:26:01,923 INFO - [Thread-11:] ~ config.location is set, using: /usr/hdp/current/falcon-server/conf/runtime.properties (ApplicationProperties:107)
2016-08-30 01:26:01,924 INFO - [Thread-11:] ~ Initializing org.apache.falcon.util.RuntimeProperties properties with domain falcon (ApplicationProperties:144)
2016-08-30 01:26:01,924 DEBUG - [Thread-11:] ~ log.cleanup.frequency.hours.retention=minutes(1) (ApplicationProperties:150)
2016-08-30 01:26:01,924 DEBUG - [Thread-11:] ~ log.cleanup.frequency.months.retention=months(3) (ApplicationProperties:150)
2016-08-30 01:26:01,924 DEBUG - [Thread-11:] ~ log.cleanup.frequency.minutes.retention=hours(6) (ApplicationProperties:150)
2016-08-30 01:26:01,924 DEBUG - [Thread-11:] ~ domain=falcon (ApplicationProperties:150)
2016-08-30 01:26:01,924 DEBUG - [Thread-11:] ~ log.cleanup.frequency.days.retention=days(7) (ApplicationProperties:150)
2016-08-30 01:26:01,924 INFO - [Thread-11:] ~ config.location is set, using: /usr/hdp/current/falcon-server/conf/runtime.properties (ApplicationProperties:107)
2016-08-30 01:26:01,924 INFO - [Thread-11:] ~ Initializing org.apache.falcon.util.RuntimeProperties properties with domain falcon (ApplicationProperties:144)
2016-08-30 01:26:01,925 DEBUG - [Thread-11:] ~ log.cleanup.frequency.hours.retention=minutes(1) (ApplicationProperties:150)
2016-08-30 01:26:01,925 DEBUG - [Thread-11:] ~ log.cleanup.frequency.months.retention=months(3) (ApplicationProperties:150)
2016-08-30 01:26:01,925 DEBUG - [Thread-11:] ~ log.cleanup.frequency.minutes.retention=hours(6) (ApplicationProperties:150)
2016-08-30 01:26:01,925 DEBUG - [Thread-11:] ~ domain=falcon (ApplicationProperties:150)
2016-08-30 01:26:01,925 DEBUG - [Thread-11:] ~ log.cleanup.frequency.days.retention=days(7) (ApplicationProperties:150)
... View more
Labels:
- Labels:
-
Apache Falcon
08-26-2016
07:03 PM
Not Sure why, but when a user "x" was created in IPA, there was an entry for x under users and also under groups. Could be this lead to ambiguity for the search to locate the right user "x" (arun in my case). To resolve the ambiguity, I thought of referring users by their uid rather than the default cn, which could conflict.
... View more
08-26-2016
06:53 PM
The only problem here is that the user list specified while sync'ing need to have the uid rather than the user name.
... View more
08-26-2016
06:51 PM
Hi @Constantin Stanca, there wasn't multiple user by the name Arun. However after changing the default values for userObjectClass and usernameAttribute, I got it working.
... View more
08-26-2016
06:49 PM
Started working now. Below are the changes I made
New Values
authentication.ldap.userObjectClass=person
authentication.ldap.usernameAttribute=uid Old Values
authentication.ldap.userObjectClass=mepManagedEntry
authentication.ldap.usernameAttribute=cn
... View more