Member since
08-08-2013
339
Posts
132
Kudos Received
27
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
13431 | 01-18-2018 08:38 AM | |
1159 | 05-11-2017 06:50 PM | |
8159 | 04-28-2017 11:00 AM | |
2970 | 04-12-2017 01:36 AM | |
2432 | 02-14-2017 05:11 AM |
02-05-2016
07:53 PM
1 Kudo
Hello, there is a strange situation within Ambari (v2.0.1) where Ranger suddenly lost the connectivity, since Ambari shows "Heartbeat lost" for Ranger-admin/-usersync. The node where Ranger is/should run is fine, since it is the same as Ambari is running itself. Trying to restart Ranger results in the following => and the corresponding log entries of ambari-server: What the hell has happened here ?!?!
... View more
Labels:
- Labels:
-
Apache Ambari
-
Apache Ranger
02-04-2016
05:06 PM
@All, sorry for any inconvenience 😉
... View more
02-04-2016
05:06 PM
1 Kudo
Seems like for that particular job the log setting got overwritten by a local container-log4j.properties, which included DEBUG loglevel.
... View more
02-02-2016
05:01 PM
1 Kudo
Hi @Jonas Straub , enabling SSL seems to cause the troubles, since in the Ranger xa_portal.log I see lots of the following errors: 2016-02-02 00:49:43,512 [http-bio-6182-exec-2] INFO com.xasecure.common.RESTErrorUtil (RESTErrorUtil.java:282) - Operation error. response=VXResponse={com.xasecure.view.VXResponse@34ca3410statusCode={1} msgDesc={Unauthorized access - unable to get client certificate} messageList={[VXMessage={com.xasecure.view.VXMessage@47202183name={OPER_NOT_ALLOWED_FOR_ENTITY} rbKey={xa.error.oper_not_allowed_for_state} message={Operation not allowed for entity} objectId={null} fieldName={null} }]} }
javax.ws.rs.WebApplicationException
...
2016-02-02 00:49:46,856 [http-bio-6182-exec-4] INFO com.xasecure.common.RESTErrorUtil (RESTErrorUtil.java:66) - Request failed. SessionId=null, loginId=null, logMessage=Unauthorized access - unable to get client certificate
javax.ws.rs.WebApplicationException I am a bit lost in how to dive into that issue. The steps to enable SSL for ranger-plugins I made, are:
ranger admin node: created a keystore, exported its key into file 'ranger-admin-trust.cer' and copied it to namenodes on both namenodes, created a keystore (and remembered the input for the first question) in file 'ranger-plugin-keystore.jks' imported ranger-admin key from ranger-admin-trust.cer into file 'ranger-plugin-truststore.jks' exported plugin key from ranger-plugin-keystore.jks into truststore 'ranger-hdfsagent-trust.cer' copied ranger-hdfsagent-trust.cer to RangerAdmin server imported ranger-hdfsagent-trust.cer into general keystore 'cacerts' on RangerAdmin server so that at the end the file 'cacerts' should contain the keys from all the HDFS-/Hive-/HBase plugins I configured. This is the config. of Ranger-HDFS-Plugin in Ambari: Especially step 6.) does the file 'cacerts' on the RangerAdmin server (containing all the certs) needs to be configured somehwere? I cannot find that in Ambari config. section?!!
... View more
02-02-2016
12:32 PM
@Jonas Straub yep, SSL has been enabled/added, good starting point for analyzing the issue
... View more
02-02-2016
10:58 AM
Hi @Jonas Straub , thanks for that hint with checking the "Agents" tab.
Indeed the timestamp there is pretty old, all entries are from Jan 27th.
Where can I investigate into why the updated policies are not getting updated/synced to the plugins itself ?
... View more
02-02-2016
10:43 AM
2 Kudos
Hi, I created a policy for HDFS in Ranger and gave a dedicated user full permissions to the corresponding folder.
But that user is not able to list the contents of that folder due to HDFS-access denied-error. It seems like that the Ranger policy is not really in effect / not applied, see screenshots below for the details. What I want to do (normally pretty simple 😉 ) grant user w999711 full permissions to HDFS folder /data/raw. Authorization shall be handled completely by Ranger, therefore HDFS permissions on that folder are restrictive (700). The error Policy config Audit log Why isn't the defined policy applied while accessing /data/raw ?!?! It also confuses me that in the Audit log there is enforcer "hadoop-acl", whereas I'd expected "xa-secure-acl" for accessing /data/raw Any hints highly appreciated.....thanks, Gerd PS: HDP2.2.4.2, Ambari 2.1.2.1
... View more
Labels:
- Labels:
-
Apache Hadoop
-
Apache Ranger
01-28-2016
08:25 PM
1 Kudo
Hi @Neeraj Sabharwal , thanks...a restart brought back Ambari into life.....right after opening a ticket 😉
... View more
01-28-2016
07:48 PM
This is the error after providing credentials to login
... View more
01-28-2016
07:43 PM
Hi, wired situation...while deleting a node from HDP-cluster I received a popup from Ambari with a very long error message. But the node has been deleted, at least it disappeared from the node list. Unfortunately now Ambari (MySQL as backend) is no longer working, it is hanging in the "Loading" state and nothing happens further. Here is an excerpt from Ambari-server log of the time of deleting the node: 28 Jan 2016 20:14:53,448 INFO [qtp-client-1030] ServiceComponentImpl:626 - Deleting servicecomponenthost for cluster, clusterName=hdpprd, serviceName=SPARK, componentName=SPARK_CLIENT, hostname=b0d0b7k2.com
28 Jan 2016 20:14:53,488 INFO [qtp-client-1030] ServiceComponentImpl:626 - Deleting servicecomponenthost for cluster, clusterName=hdpprd, serviceName=SQOOP, componentName=SQOOP, hostname=b0d0b7k2.com
28 Jan 2016 20:14:53,520 INFO [qtp-client-1030] ServiceComponentImpl:626 - Deleting servicecomponenthost for cluster, clusterName=hdpprd, serviceName=TEZ, componentName=TEZ_CLIENT, hostname=b0d0b7k2.com
28 Jan 2016 20:14:53,840 INFO [qtp-client-1030] ServiceComponentImpl:626 - Deleting servicecomponenthost for cluster, clusterName=hdpprd, serviceName=ZOOKEEPER, componentName=ZOOKEEPER_CLIENT, hostname=b0d0b7k2.com
28 Jan 2016 20:14:53,879 INFO [qtp-client-1030] ServiceComponentImpl:626 - Deleting servicecomponenthost for cluster, clusterName=hdpprd, serviceName=PIG, componentName=PIG, hostname=b0d0b7k2.com
28 Jan 2016 20:14:56,916 INFO [qtp-client-1030] ServiceComponentImpl:626 - Deleting servicecomponenthost for cluster, clusterName=hdpprd, serviceName=YARN, componentName=YARN_CLIENT, hostname=b0d0b7k2.com
28 Jan 2016 20:14:56,920 WARN [qtp-client-1030] ServletHandler:563 - /api/v1/clusters/hdpprd/hosts/b0d0b7k2.com/host_components/YARN_CLIENT
java.lang.NullPointerException
at org.apache.ambari.server.state.svccomphost.ServiceComponentHostImpl.getStateEntity(ServiceComponentHostImpl.java:1644)
at org.apache.ambari.server.state.svccomphost.ServiceComponentHostImpl.removeEntities(ServiceComponentHostImpl.java:1411)
at org.apache.ambari.server.orm.AmbariJpaLocalTxnInterceptor.invoke(AmbariJpaLocalTxnInterceptor.java:68) ... Here is the current log output from ambari-server after I tried to login (this messages are repeating): 28 Jan 2016 20:14:57,381 WARN [qtp-client-1030] ServletHandler:563 - /api/v1/clusters/hdpprd/hosts
java.lang.NullPointerException
at org.apache.ambari.server.state.svccomphost.ServiceComponentHostImpl.getStateEntity(ServiceComponentHostImpl.java:1644)
...
28 Jan 2016 20:14:57,413 ERROR [qtp-client-1030] ReadHandler:91 - Caught a runtime exception executing a query
java.lang.NullPointerException
at org.apache.ambari.server.state.svccomphost.ServiceComponentHostImpl.getStateEntity(ServiceComponentHostImpl.java:1644)
...
28 Jan 2016 20:14:57,900 WARN [qtp-client-1030] ServletHandler:563 - /api/v1/clusters
java.lang.NullPointerException28 Jan 2016 20:14:59,310 ERROR [qtp-client-1030] ReadHandler:91 - Caught a runtime exception executing a query
java.lang.NullPointerException
at org.apache.ambari.server.state.svccomphost.ServiceComponentHostImpl.getStateEntity(ServiceComponentHostImpl.java:1644)
...
28 Jan 2016 20:15:18,873 ERROR [qtp-client-1030] ReadHandler:91 - Caught a runtime exception executing a query
java.lang.NullPointerException
28 Jan 2016 20:15:18,874 WARN [qtp-client-1030] ServletHandler:563 - /api/v1/clusters/hdpprd/
java.lang.NullPointerException
28 Jan 2016 20:15:19,029 ERROR [qtp-client-1030] ReadHandler:91 - Caught a runtime exception executing a query
java.lang.NullPointerException
28 Jan 2016 20:15:19,030 WARN [qtp-client-1030] ServletHandler:563 - /api/v1/clusters/hdpprd/hosts/b0d02ef2.ldc.uk.zurich.com
java.lang.NullPointerException
28 Jan 2016 20:15:19,054 ERROR [qtp-client-1030] ReadHandler:91 - Caught a runtime exception executing a query
java.lang.NullPointerException
28 Jan 2016 20:15:19,056 WARN [qtp-client-1030] ServletHandler:563 - /api/v1/clusters/hdpprd
java.lang.NullPointerException
28 Jan 2016 20:15:19,079 ERROR [qtp-client-1030] ReadHandler:91 - Caught a runtime exception executing a query
java.lang.NullPointerException
28 Jan 2016 20:15:19,081 WARN [qtp-client-1030] ServletHandler:563 - /api/v1/clusters/hdpprd
java.lang.NullPointerException
28 Jan 2016 20:15:19,090 ERROR [qtp-client-1030] ReadHandler:91 - Caught a runtime exception executing a query
java.lang.NullPointerException
28 Jan 2016 20:15:19,092 WARN [qtp-client-1030] ServletHandler:563 - /api/v1/clusters/hdpprd/hosts
java.lang.NullPointerException
28 Jan 2016 20:15:19,279 ERROR [qtp-client-1030] ReadHandler:91 - Caught a runtime exception executing a query
java.lang.NullPointerException
28 Jan 2016 20:15:19,280 WARN [qtp-client-1030] ServletHandler:563 - /api/v1/clusters/hdpprd/hosts
java.lang.NullPointerException
28 Jan 2016 20:15:19,644 ERROR [qtp-client-1030] ReadHandler:91 - Caught a runtime exception executing a query
java.lang.NullPointerException Is there something to check directly in MySQL db?!?! Any hints highly appreciated, Ambari is highly requested to proceed working on that cluster 😉 Thanks in advance...
... View more
Labels:
- Labels:
-
Apache Ambari